Jul 19 16:36:22.745512 ip-10-0-135-68 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 19 16:36:22.745522 ip-10-0-135-68 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 19 16:36:22.745529 ip-10-0-135-68 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 19 16:36:22.745758 ip-10-0-135-68 systemd[1]: Failed to start Kubernetes Kubelet. Jul 19 16:36:32.839720 ip-10-0-135-68 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 19 16:36:32.839740 ip-10-0-135-68 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 148a084805364ad1a69fca5b4721f6af -- Jul 19 16:38:02.945387 ip-10-0-135-68 systemd[1]: Starting Kubernetes Kubelet... Jul 19 16:38:03.399698 ip-10-0-135-68 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 19 16:38:03.399698 ip-10-0-135-68 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 19 16:38:03.399698 ip-10-0-135-68 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 19 16:38:03.399698 ip-10-0-135-68 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 19 16:38:03.399698 ip-10-0-135-68 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 19 16:38:03.399698 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.397673 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402146 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402157 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402161 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402164 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402166 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402169 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402172 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402174 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402177 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402179 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402182 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402184 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402188 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402192 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402196 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402199 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402210 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402213 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402216 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 16:38:03.415930 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402220 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402222 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402225 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402229 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402233 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402236 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402239 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402242 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402245 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402248 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402250 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402253 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402256 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402259 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402261 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402264 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402267 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402270 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402272 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 16:38:03.430464 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402274 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402277 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402280 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402282 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402285 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402288 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402291 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402295 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402297 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402300 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402302 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402305 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402307 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402311 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402314 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402317 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402320 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402323 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402325 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402328 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 16:38:03.432265 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402330 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402333 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402337 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402339 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402342 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402344 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402346 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402349 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402351 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402354 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402357 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402359 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402362 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402364 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402367 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402370 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402372 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402375 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402378 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402380 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 16:38:03.434723 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402383 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402385 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402387 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402390 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402392 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402395 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402397 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402400 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402402 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402404 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402407 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402409 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402412 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402415 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402417 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402419 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402422 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402425 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402427 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402430 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 16:38:03.512696 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.402432 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 16:38:03.467233 ip-10-0-135-68 systemd[1]: Started Kubernetes Kubelet. Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403115 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403123 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403141 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403144 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403147 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403150 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403154 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403158 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403161 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403164 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403167 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403170 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403172 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403175 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403178 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403180 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403183 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403185 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403188 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 16:38:03.533222 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403190 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403193 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403195 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403198 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403200 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403203 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403205 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403208 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403211 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403213 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403216 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403219 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403222 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403224 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403227 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403229 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403232 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403234 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403237 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403239 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 16:38:03.756172 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403242 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403245 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403248 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403250 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403252 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403255 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403258 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403261 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403264 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403266 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403268 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403271 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403273 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403275 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403278 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403280 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403285 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403288 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403293 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403296 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 16:38:03.766506 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403299 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403302 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403305 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403308 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403311 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403313 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403316 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403319 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403321 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403324 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403326 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403329 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403331 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403334 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403337 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403339 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403342 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403344 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403347 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 16:38:03.767556 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403349 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403352 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403354 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403357 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403359 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403363 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403365 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403367 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403370 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403372 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403375 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403382 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403384 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403387 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403389 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403392 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403395 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403398 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403400 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 16:38:03.768403 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403404 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403408 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403755 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403759 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403762 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403764 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403767 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403769 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403772 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403776 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403778 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403781 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403783 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403785 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403788 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403790 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403793 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403795 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403798 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 16:38:03.769452 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403800 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403802 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403808 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403810 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403813 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403816 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403819 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403821 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403824 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403826 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403829 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403832 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403835 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403838 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403840 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403843 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403845 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403848 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403851 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 16:38:03.770101 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403855 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403858 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403861 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403864 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403867 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403869 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403871 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403874 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403876 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403879 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403882 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403884 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403887 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403889 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403891 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403896 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403898 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403901 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403904 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 16:38:03.770749 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403907 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403909 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403912 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403914 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403917 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403920 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403923 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403925 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403927 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403930 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403932 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403935 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403937 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403939 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403942 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403944 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403947 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403950 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403953 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403955 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 16:38:03.771392 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403958 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403960 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403962 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403965 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403967 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403969 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403972 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403974 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403977 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403980 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403983 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403986 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403989 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403991 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403994 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403996 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.403999 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404001 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404006 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404009 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 16:38:03.772008 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404011 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404014 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404017 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404019 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404090 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404096 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404101 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404105 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404109 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404112 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404117 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404121 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404139 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404142 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404145 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404148 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404151 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404154 2563 flags.go:64] FLAG: --cgroup-root="" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404157 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404159 2563 flags.go:64] FLAG: --client-ca-file="" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404164 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404167 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404171 2563 flags.go:64] FLAG: --cluster-domain="" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404175 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 19 16:38:03.772640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404178 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404181 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404184 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404187 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404190 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404193 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404196 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404199 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404202 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404205 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404208 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404211 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404214 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404217 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404220 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404223 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404225 2563 flags.go:64] FLAG: --enable-server="true" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404228 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404232 2563 flags.go:64] FLAG: --event-burst="100" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404235 2563 flags.go:64] FLAG: --event-qps="50" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404238 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404241 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404244 2563 flags.go:64] FLAG: --eviction-hard="" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404247 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 19 16:38:03.773480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404250 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404252 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404255 2563 flags.go:64] FLAG: --eviction-soft="" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404258 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404262 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404265 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404268 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404271 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404274 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404277 2563 flags.go:64] FLAG: --feature-gates="" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404280 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404283 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404286 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404289 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404292 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404295 2563 flags.go:64] FLAG: --help="false" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404298 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404301 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404303 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404306 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404309 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404312 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404315 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 19 16:38:03.774533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404318 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404321 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404323 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404326 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404329 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404332 2563 flags.go:64] FLAG: --kube-reserved="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404335 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404337 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404340 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404343 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404345 2563 flags.go:64] FLAG: --lock-file="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404348 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404350 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404355 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404360 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404362 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404366 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404369 2563 flags.go:64] FLAG: --logging-format="text" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404372 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404375 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404378 2563 flags.go:64] FLAG: --manifest-url="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404381 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404385 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404388 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404391 2563 flags.go:64] FLAG: --max-pods="110" Jul 19 16:38:03.775369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404394 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404397 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404400 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404403 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404405 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404408 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404411 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404418 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404421 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404423 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404426 2563 flags.go:64] FLAG: --pod-cidr="" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404429 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404434 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404437 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404440 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404443 2563 flags.go:64] FLAG: --port="10250" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404446 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404449 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0143a2d7ca62bef9d" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404452 2563 flags.go:64] FLAG: --qos-reserved="" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404454 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404457 2563 flags.go:64] FLAG: --register-node="true" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404461 2563 flags.go:64] FLAG: --register-with-taints="" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404464 2563 flags.go:64] FLAG: --registry-burst="10" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404469 2563 flags.go:64] FLAG: --registry-qps="5" Jul 19 16:38:03.776416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404472 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404474 2563 flags.go:64] FLAG: --reserved-memory="" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404478 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404481 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404484 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404486 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404489 2563 flags.go:64] FLAG: --runonce="false" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404491 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404494 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404497 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404500 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404502 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404505 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404508 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404511 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404514 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404516 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404519 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404522 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404524 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404527 2563 flags.go:64] FLAG: --system-cgroups="" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404530 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404536 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404539 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404541 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 19 16:38:03.777273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404545 2563 flags.go:64] FLAG: --tls-min-version="" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404548 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404551 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404554 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404558 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404560 2563 flags.go:64] FLAG: --v="2" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404565 2563 flags.go:64] FLAG: --version="false" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404569 2563 flags.go:64] FLAG: --vmodule="" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404572 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.404575 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404680 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404685 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404688 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404691 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404694 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404697 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404700 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404703 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404706 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404709 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404711 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 16:38:03.777954 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404720 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404725 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404728 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404731 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404734 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404738 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404741 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404744 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404747 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404750 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404753 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404756 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404759 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404761 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404764 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404768 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404771 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404775 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404777 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 16:38:03.778524 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404780 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404782 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404785 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404787 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404790 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404792 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404796 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404799 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404801 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404804 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404807 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404809 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404812 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404814 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404817 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404819 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404822 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404824 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404826 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404829 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 16:38:03.779115 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404832 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404834 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404836 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404839 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404842 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404844 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404847 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404849 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404853 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404855 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404859 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404862 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404864 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404866 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404869 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404871 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404874 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404876 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404879 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 16:38:03.779658 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404881 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404884 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404886 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404889 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404891 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404893 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404896 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404898 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404901 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404903 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404906 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404908 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404911 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404913 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404915 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404918 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404920 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404923 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404925 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404928 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 16:38:03.780215 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404930 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404934 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404936 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404940 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404943 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404946 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404948 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404950 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404953 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.404956 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.405772 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.411480 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.411494 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.412442 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.412454 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 19 16:38:03.781015 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412508 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412514 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412519 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412522 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412525 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412528 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412531 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412533 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412537 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412541 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412544 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412546 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412549 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412552 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412555 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412557 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412560 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412562 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412564 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 16:38:03.781474 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412567 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412570 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412573 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412575 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412578 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412581 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412583 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412586 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412588 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412591 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412594 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412596 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412599 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412601 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412604 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412606 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412608 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412611 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412613 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 16:38:03.857663 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412616 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412618 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412621 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412623 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412626 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412628 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412630 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412633 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412635 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412638 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412644 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412647 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412649 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412651 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412654 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412657 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412659 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412661 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412664 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412666 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 16:38:03.858291 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412669 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412672 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412674 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412677 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412680 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412683 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412685 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412688 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412690 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412692 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412695 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412697 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412700 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412702 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412705 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412707 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412710 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412712 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412723 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412726 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 16:38:03.858914 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412729 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412732 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412736 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412740 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412742 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412745 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412747 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412750 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412752 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412755 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412757 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412760 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412764 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412767 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412769 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412772 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412775 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412779 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412781 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 16:38:03.859536 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412784 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412787 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.412792 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412895 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412899 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412902 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412905 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412907 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412910 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412913 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412916 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412919 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412921 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412924 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412927 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 16:38:03.860017 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412929 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412934 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412936 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412939 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412942 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412944 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412947 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412949 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412952 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412954 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412957 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412959 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412961 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412964 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412966 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412969 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412972 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412974 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412976 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412979 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 16:38:03.860500 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412981 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412984 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412988 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412992 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412996 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.412999 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413002 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413005 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413008 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413011 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413014 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413017 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413020 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413026 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413029 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413033 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413035 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413039 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413042 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 16:38:03.861010 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413045 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413048 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413051 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413054 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413057 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413060 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413063 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413066 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413071 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413076 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413085 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413088 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413092 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413095 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413097 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413101 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413106 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413109 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413113 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 16:38:03.861538 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413116 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413120 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413123 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413142 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413145 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413149 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413152 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413158 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413161 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413164 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413167 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413170 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413173 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413176 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413179 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413182 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413186 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413189 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413192 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413195 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 16:38:03.862013 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413198 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413201 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413207 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413211 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413216 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413219 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413222 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413225 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:03.413228 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.413234 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.413347 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.415336 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.416492 2563 server.go:1019] "Starting client certificate rotation" Jul 19 16:38:03.862568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.416592 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.416627 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.419209 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.423553 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.431121 2563 log.go:25] "Validated CRI v1 runtime API" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.433282 2563 log.go:25] "Validated CRI v1 image API" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.433980 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.438414 2563 fs.go:135] Filesystem UUIDs: map[3c56efba-98c0-48d2-88fd-90845971547b:/dev/nvme0n1p3 69184c0a-ea2e-4f21-9bdf-84fd4baab67e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 19 16:38:03.862913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.438428 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.442291 2563 manager.go:216] Machine: {Timestamp:2026-07-19 16:38:03.441843782 +0000 UTC m=+0.361491934 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3233776 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec254881b6ba66743efbec98a8b2e4a2 SystemUUID:ec254881-b6ba-6674-3efb-ec98a8b2e4a2 BootID:148a0848-0536-4ad1-a69f-ca5b4721f6af Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:2b:3d:3f:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:2b:3d:3f:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:41:ac:f9:96:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.442380 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.442438 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.443573 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.443598 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.444429 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.444438 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.444445 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.445396 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.447281 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.448323 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451216 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451324 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451349 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451357 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451370 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 19 16:38:03.863251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451380 2563 kubelet.go:398] "Adding apiserver pod source" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451388 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451683 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.451699 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.456271 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.458549 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.458575 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460050 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460070 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460079 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460088 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460102 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460118 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460143 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460152 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460160 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460165 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460177 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.460185 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.461240 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.461253 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.462207 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.462504 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.464447 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.466416 2563 server.go:1268] "Started kubelet" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.466474 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.466488 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.466573 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.467554 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.468567 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.471826 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.477509 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.477519 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.477619 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478295 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478327 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478364 2563 factory.go:55] Registering systemd factory Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478379 2563 factory.go:223] Registration of the systemd container factory successfully Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478402 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478471 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478477 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478564 2563 factory.go:153] Registering CRI-O factory Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478575 2563 factory.go:223] Registration of the crio container factory successfully Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478619 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478640 2563 factory.go:103] Registering Raw factory Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.478652 2563 manager.go:1196] Started watching for new ooms in manager Jul 19 16:38:03.863757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.479232 2563 manager.go:349] Starting recovery of all containers Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.478107 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-68.ec2.internal.18c3be459720f918 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-68.ec2.internal,UID:ip-10-0-135-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-68.ec2.internal,},FirstTimestamp:2026-07-19 16:38:03.466389784 +0000 UTC m=+0.386037937,LastTimestamp:2026-07-19 16:38:03.466389784 +0000 UTC m=+0.386037937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-68.ec2.internal,}" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.480688 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.480772 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.488713 2563 manager.go:354] Recovery completed Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.493737 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.495559 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.495592 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.495602 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.495626 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nr8xl" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.496070 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.496081 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.496098 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.496138 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.497355 2563 policy_none.go:49] "None policy: Start" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.497368 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.497377 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.497553 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-68.ec2.internal.18c3be4598de600c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-68.ec2.internal,UID:ip-10-0-135-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-68.ec2.internal,},FirstTimestamp:2026-07-19 16:38:03.49557966 +0000 UTC m=+0.415227812,LastTimestamp:2026-07-19 16:38:03.49557966 +0000 UTC m=+0.415227812,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-68.ec2.internal,}" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.498094 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.498119 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.498145 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.498432 2563 policy_none.go:47] "Start" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.503934 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nr8xl" Jul 19 16:38:03.864987 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.506466 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-68.ec2.internal.18c3be4598dea561 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-68.ec2.internal,UID:ip-10-0-135-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-68.ec2.internal,},FirstTimestamp:2026-07-19 16:38:03.495597409 +0000 UTC m=+0.415245561,LastTimestamp:2026-07-19 16:38:03.495597409 +0000 UTC m=+0.415245561,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-68.ec2.internal,}" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.508605 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-68.ec2.internal.18c3be4598dec815 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-68.ec2.internal,UID:ip-10-0-135-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-68.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-68.ec2.internal,},FirstTimestamp:2026-07-19 16:38:03.495606293 +0000 UTC m=+0.415254447,LastTimestamp:2026-07-19 16:38:03.495606293 +0000 UTC m=+0.415254447,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-68.ec2.internal,}" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.557939 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.560005 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.560039 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.560063 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.560101 2563 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.562053 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.578160 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.604697 2563 manager.go:337] "Starting Device Plugin manager" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.604735 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.604745 2563 server.go:87] "Starting device plugin registration server" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.604969 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.604980 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.605058 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.605152 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.605160 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.605507 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.605554 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.660659 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal"] Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.660729 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.665099 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.665121 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.665147 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.666409 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.666519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.666555 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.668380 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.668389 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.668407 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.668410 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.668421 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.668425 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.669510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.669529 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.672575 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.672598 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.865651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.672610 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.685981 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-68.ec2.internal\" not found" node="ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.692704 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-68.ec2.internal\" not found" node="ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.697142 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-68.ec2.internal\" not found" node="ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.705030 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.705740 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientMemory" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.705764 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.705777 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeHasSufficientPID" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.705795 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.713547 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.713562 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-68.ec2.internal\": node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.740442 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.779885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0eea55e6310d7a892468f72d28cd3bac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal\" (UID: \"0eea55e6310d7a892468f72d28cd3bac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.779903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eea55e6310d7a892468f72d28cd3bac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal\" (UID: \"0eea55e6310d7a892468f72d28cd3bac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.779920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56f0edff43ab05466ea8a52af03f54d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-68.ec2.internal\" (UID: \"56f0edff43ab05466ea8a52af03f54d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.866719 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.841021 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.880342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0eea55e6310d7a892468f72d28cd3bac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal\" (UID: \"0eea55e6310d7a892468f72d28cd3bac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.880365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eea55e6310d7a892468f72d28cd3bac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal\" (UID: \"0eea55e6310d7a892468f72d28cd3bac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.880379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56f0edff43ab05466ea8a52af03f54d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-68.ec2.internal\" (UID: \"56f0edff43ab05466ea8a52af03f54d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.880412 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56f0edff43ab05466ea8a52af03f54d8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-68.ec2.internal\" (UID: \"56f0edff43ab05466ea8a52af03f54d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.880437 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0eea55e6310d7a892468f72d28cd3bac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal\" (UID: \"0eea55e6310d7a892468f72d28cd3bac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.880446 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eea55e6310d7a892468f72d28cd3bac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal\" (UID: \"0eea55e6310d7a892468f72d28cd3bac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:03.950242 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:03.941628 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:04.028874 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:03.997206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:04.028874 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.001332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" Jul 19 16:38:04.110963 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:04.041829 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:04.178604 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:04.142388 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:04.243354 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:04.242832 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-68.ec2.internal\" not found" Jul 19 16:38:04.339157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.338082 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.379157 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.395524 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.397614 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.406566 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.415612 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.415703 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 19 16:38:04.422511 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.415746 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 19 16:38:04.502313 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.451580 2563 apiserver.go:52] "Watching apiserver" Jul 19 16:38:04.502313 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.478026 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 19 16:38:04.502313 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.483954 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 16:38:04.502313 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.487479 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.504684 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.506658 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cnl2" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.506739 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-x6wk4","openshift-ovn-kubernetes/ovnkube-node-zpnh6","kube-system/global-pull-secret-syncer-s875t","kube-system/konnectivity-agent-ms2gm","kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l","openshift-dns/node-resolver-flxbd","openshift-multus/multus-additional-cni-plugins-dvz5g","openshift-network-diagnostics/network-check-target-dmcvr","openshift-network-operator/iptables-alerter-7fnzr","openshift-cluster-node-tuning-operator/tuned-5sbt9","openshift-image-registry/node-ca-qd6rh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal","openshift-multus/multus-v577f"] Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.507980 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:04.508033 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.508968 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-18 16:33:04 +0000 UTC" deadline="2028-02-03 17:40:25.264107842 +0000 UTC" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.508991 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13537h2m20.755120149s" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.509002 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.511066 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xmqbx\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.511284 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.511403 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.511511 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.511616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.511948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.512467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.513520 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.513752 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4r9c4\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.513889 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.514152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:04.514191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.514281 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.514420 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7hpm8\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.514588 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.514830 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cnl2" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.514898 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.515027 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-79v6x\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.515161 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.516904 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.517252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.583208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.517808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:04.517841 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.517882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.518431 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519338 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v577f" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519537 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wbnzx\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519566 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519691 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519940 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.519946 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520068 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520195 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520386 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mq5c9\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520389 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520515 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520791 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9td7v\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.520928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.521053 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.521271 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.521452 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.521651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.521945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.522159 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.522219 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8lv9m\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.522241 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.522271 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7cz4s\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.522784 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.580540 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-ovnkube-script-lib\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00631596-a145-4788-9027-5d7e8aa14929-host\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:04.584335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-socket-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-multus-certs\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-etc-kubernetes\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mxq\" (UniqueName: \"kubernetes.io/projected/7137a64a-214b-414e-8b44-ac2dd29b37ed-kube-api-access-m4mxq\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-node-log\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5kng\" (UniqueName: \"kubernetes.io/projected/fccb1785-7a2f-466f-a24f-dff097b59069-kube-api-access-h5kng\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e921ab2-20e7-47e9-ae78-818c5afb27a0-dbus\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwb22\" (UniqueName: \"kubernetes.io/projected/124516d4-5d51-483b-b292-de29432d7797-kube-api-access-pwb22\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98sjl\" (UniqueName: \"kubernetes.io/projected/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-kube-api-access-98sjl\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39f8cab8-38fa-4508-aa92-71604ed11526-ovn-node-metrics-cert\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-device-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysctl-conf\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-run\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.585540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-sys\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-env-overrides\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-kubelet\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e921ab2-20e7-47e9-ae78-818c5afb27a0-kubelet-config\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-modprobe-d\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-cni-netd\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-hostroot\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-cnibin\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-host\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-conf-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00631596-a145-4788-9027-5d7e8aa14929-serviceca\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.586403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-systemd-units\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rr5\" (UniqueName: \"kubernetes.io/projected/39f8cab8-38fa-4508-aa92-71604ed11526-kube-api-access-62rr5\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-registration-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-systemd\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-tuned\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.583997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-kubelet\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-system-cni-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-cnibin\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-sys-fs\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtl7r\" (UniqueName: \"kubernetes.io/projected/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-kube-api-access-xtl7r\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b1bc765-ab63-4ff2-bef8-d3c07864669c-host-slash\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-tmp\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-systemd\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584105 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-cni-multus\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fccb1785-7a2f-466f-a24f-dff097b59069-multus-daemon-config\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.587657 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7xxb\" (UniqueName: \"kubernetes.io/projected/00631596-a145-4788-9027-5d7e8aa14929-kube-api-access-x7xxb\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-lib-modules\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-ovn\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-ovnkube-config\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fccb1785-7a2f-466f-a24f-dff097b59069-cni-binary-copy\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-k8s-cni-cncf-io\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-run-netns\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-netns\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-cni-bin\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df21941b-9c93-489c-ac4f-f4ca4125c5da-konnectivity-ca\") pod \"konnectivity-agent-ms2gm\" (UID: \"df21941b-9c93-489c-ac4f-f4ca4125c5da\") " pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72pq\" (UniqueName: \"kubernetes.io/projected/2b1bc765-ab63-4ff2-bef8-d3c07864669c-kube-api-access-c72pq\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-kubernetes\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-cni-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df21941b-9c93-489c-ac4f-f4ca4125c5da-agent-certs\") pod \"konnectivity-agent-ms2gm\" (UID: \"df21941b-9c93-489c-ac4f-f4ca4125c5da\") " pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:04.588486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-system-cni-dir\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysconfig\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-etc-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trsbq\" (UniqueName: \"kubernetes.io/projected/18d09047-630d-4ecb-ac4a-0377506463a1-kube-api-access-trsbq\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-os-release\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysctl-d\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-var-lib-kubelet\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-log-socket\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-os-release\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-socket-dir-parent\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b1bc765-ab63-4ff2-bef8-d3c07864669c-iptables-alerter-script\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/124516d4-5d51-483b-b292-de29432d7797-hosts-file\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/124516d4-5d51-483b-b292-de29432d7797-tmp-dir\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-slash\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-var-lib-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:04.589531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:04.584884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-cni-bin\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-run\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-sys\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-env-overrides\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955542 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-sys\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955626 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-run\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-kubelet\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e921ab2-20e7-47e9-ae78-818c5afb27a0-kubelet-config\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-modprobe-d\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955711 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-kubelet\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-cni-netd\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-hostroot\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955745 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e921ab2-20e7-47e9-ae78-818c5afb27a0-kubelet-config\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955759 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-modprobe-d\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955771 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-cni-netd\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955794 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-hostroot\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.970516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-cnibin\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955827 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.955821 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955841 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-host\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955874 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-cnibin\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955913 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-host\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.955931 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:06.455872874 +0000 UTC m=+2.109765178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-conf-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.955993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00631596-a145-4788-9027-5d7e8aa14929-serviceca\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-conf-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-systemd-units\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62rr5\" (UniqueName: \"kubernetes.io/projected/39f8cab8-38fa-4508-aa92-71604ed11526-kube-api-access-62rr5\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956050 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-env-overrides\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.972397 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-registration-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-systemd\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-tuned\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-kubelet\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956148 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-registration-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956152 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-systemd\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-system-cni-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-cnibin\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956210 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-kubelet\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956220 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-sys-fs\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-systemd-units\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtl7r\" (UniqueName: \"kubernetes.io/projected/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-kube-api-access-xtl7r\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b1bc765-ab63-4ff2-bef8-d3c07864669c-host-slash\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956284 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-cnibin\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956295 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-sys-fs\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-tmp\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-systemd\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b1bc765-ab63-4ff2-bef8-d3c07864669c-host-slash\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:05.973241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956396 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-system-cni-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956429 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-systemd\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-cni-multus\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956452 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00631596-a145-4788-9027-5d7e8aa14929-serviceca\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fccb1785-7a2f-466f-a24f-dff097b59069-multus-daemon-config\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956476 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956547 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-cni-multus\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xxb\" (UniqueName: \"kubernetes.io/projected/00631596-a145-4788-9027-5d7e8aa14929-kube-api-access-x7xxb\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956590 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956616 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-lib-modules\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-ovn\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-ovnkube-config\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fccb1785-7a2f-466f-a24f-dff097b59069-cni-binary-copy\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-k8s-cni-cncf-io\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-run-netns\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.974716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-netns\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956782 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-ovn\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-cni-bin\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-k8s-cni-cncf-io\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956838 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-netns\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df21941b-9c93-489c-ac4f-f4ca4125c5da-konnectivity-ca\") pod \"konnectivity-agent-ms2gm\" (UID: \"df21941b-9c93-489c-ac4f-f4ca4125c5da\") " pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956878 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-lib-modules\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-run-netns\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956934 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956878 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-var-lib-cni-bin\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fccb1785-7a2f-466f-a24f-dff097b59069-multus-daemon-config\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.956900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c72pq\" (UniqueName: \"kubernetes.io/projected/2b1bc765-ab63-4ff2-bef8-d3c07864669c-kube-api-access-c72pq\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-kubernetes\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-cni-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df21941b-9c93-489c-ac4f-f4ca4125c5da-agent-certs\") pod \"konnectivity-agent-ms2gm\" (UID: \"df21941b-9c93-489c-ac4f-f4ca4125c5da\") " pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-system-cni-dir\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysconfig\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.975369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957282 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-ovnkube-config\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-etc-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsbq\" (UniqueName: \"kubernetes.io/projected/18d09047-630d-4ecb-ac4a-0377506463a1-kube-api-access-trsbq\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957573 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-cni-dir\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-os-release\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysctl-d\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-var-lib-kubelet\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957673 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-kubernetes\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-log-socket\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-os-release\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-socket-dir-parent\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957748 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-etc-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-os-release\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957929 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-log-socket\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b1bc765-ab63-4ff2-bef8-d3c07864669c-iptables-alerter-script\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:05.977173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.957994 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysconfig\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-os-release\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958126 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/124516d4-5d51-483b-b292-de29432d7797-hosts-file\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958195 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fccb1785-7a2f-466f-a24f-dff097b59069-cni-binary-copy\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958326 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-multus-socket-dir-parent\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df21941b-9c93-489c-ac4f-f4ca4125c5da-konnectivity-ca\") pod \"konnectivity-agent-ms2gm\" (UID: \"df21941b-9c93-489c-ac4f-f4ca4125c5da\") " pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958573 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-system-cni-dir\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958629 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-var-lib-kubelet\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958675 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysctl-d\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/124516d4-5d51-483b-b292-de29432d7797-hosts-file\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/124516d4-5d51-483b-b292-de29432d7797-tmp-dir\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958758 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18d09047-630d-4ecb-ac4a-0377506463a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-slash\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-var-lib-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-cni-bin\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-ovnkube-script-lib\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00631596-a145-4788-9027-5d7e8aa14929-host\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-socket-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.978192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.958977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-multus-certs\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-etc-kubernetes\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959050 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/124516d4-5d51-483b-b292-de29432d7797-tmp-dir\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mxq\" (UniqueName: \"kubernetes.io/projected/7137a64a-214b-414e-8b44-ac2dd29b37ed-kube-api-access-m4mxq\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-node-log\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00631596-a145-4788-9027-5d7e8aa14929-host\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5kng\" (UniqueName: \"kubernetes.io/projected/fccb1785-7a2f-466f-a24f-dff097b59069-kube-api-access-h5kng\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e921ab2-20e7-47e9-ae78-818c5afb27a0-dbus\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b1bc765-ab63-4ff2-bef8-d3c07864669c-iptables-alerter-script\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959245 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-host-run-multus-certs\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959255 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-slash\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959301 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-var-lib-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-socket-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959350 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-host-cni-bin\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959386 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fccb1785-7a2f-466f-a24f-dff097b59069-etc-kubernetes\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959528 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18d09047-630d-4ecb-ac4a-0377506463a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.981393 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-run-openvswitch\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwb22\" (UniqueName: \"kubernetes.io/projected/124516d4-5d51-483b-b292-de29432d7797-kube-api-access-pwb22\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98sjl\" (UniqueName: \"kubernetes.io/projected/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-kube-api-access-98sjl\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39f8cab8-38fa-4508-aa92-71604ed11526-ovn-node-metrics-cert\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-device-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysctl-conf\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39f8cab8-38fa-4508-aa92-71604ed11526-ovnkube-script-lib\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e921ab2-20e7-47e9-ae78-818c5afb27a0-dbus\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959930 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-sysctl-conf\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.959988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-device-dir\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.960057 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.960118 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:38:06.460102282 +0000 UTC m=+2.113994572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.960118 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39f8cab8-38fa-4508-aa92-71604ed11526-node-log\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.960212 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df21941b-9c93-489c-ac4f-f4ca4125c5da-agent-certs\") pod \"konnectivity-agent-ms2gm\" (UID: \"df21941b-9c93-489c-ac4f-f4ca4125c5da\") " pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.961820 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-tmp\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.962554 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.962575 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:05.982294 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.962588 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:05.962653 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:06.46263771 +0000 UTC m=+2.116530014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.963129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39f8cab8-38fa-4508-aa92-71604ed11526-ovn-node-metrics-cert\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.964747 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rr5\" (UniqueName: \"kubernetes.io/projected/39f8cab8-38fa-4508-aa92-71604ed11526-kube-api-access-62rr5\") pod \"ovnkube-node-zpnh6\" (UID: \"39f8cab8-38fa-4508-aa92-71604ed11526\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.965133 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72pq\" (UniqueName: \"kubernetes.io/projected/2b1bc765-ab63-4ff2-bef8-d3c07864669c-kube-api-access-c72pq\") pod \"iptables-alerter-7fnzr\" (UID: \"2b1bc765-ab63-4ff2-bef8-d3c07864669c\") " pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.965248 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-etc-tuned\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.965833 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7xxb\" (UniqueName: \"kubernetes.io/projected/00631596-a145-4788-9027-5d7e8aa14929-kube-api-access-x7xxb\") pod \"node-ca-qd6rh\" (UID: \"00631596-a145-4788-9027-5d7e8aa14929\") " pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.966198 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsbq\" (UniqueName: \"kubernetes.io/projected/18d09047-630d-4ecb-ac4a-0377506463a1-kube-api-access-trsbq\") pod \"multus-additional-cni-plugins-dvz5g\" (UID: \"18d09047-630d-4ecb-ac4a-0377506463a1\") " pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.966652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5kng\" (UniqueName: \"kubernetes.io/projected/fccb1785-7a2f-466f-a24f-dff097b59069-kube-api-access-h5kng\") pod \"multus-v577f\" (UID: \"fccb1785-7a2f-466f-a24f-dff097b59069\") " pod="openshift-multus/multus-v577f" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.967223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwb22\" (UniqueName: \"kubernetes.io/projected/124516d4-5d51-483b-b292-de29432d7797-kube-api-access-pwb22\") pod \"node-resolver-flxbd\" (UID: \"124516d4-5d51-483b-b292-de29432d7797\") " pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.970000 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mxq\" (UniqueName: \"kubernetes.io/projected/7137a64a-214b-414e-8b44-ac2dd29b37ed-kube-api-access-m4mxq\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.970047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98sjl\" (UniqueName: \"kubernetes.io/projected/489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3-kube-api-access-98sjl\") pod \"tuned-5sbt9\" (UID: \"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3\") " pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:05.984148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.975733 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" Jul 19 16:38:06.055757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:05.990284 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtl7r\" (UniqueName: \"kubernetes.io/projected/e5c26dd8-0325-4d9c-a8f8-a366949af7d5-kube-api-access-xtl7r\") pod \"aws-ebs-csi-driver-node-fnr5l\" (UID: \"e5c26dd8-0325-4d9c-a8f8-a366949af7d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:06.055757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.017215 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7fnzr" Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.073058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.074939 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f0edff43ab05466ea8a52af03f54d8.slice/crio-871ec42e63dc48f9064a898644bfac90c1880be2b67e925626f2a6665d0914eb WatchSource:0}: Error finding container 871ec42e63dc48f9064a898644bfac90c1880be2b67e925626f2a6665d0914eb: Status 404 returned error can't find the container with id 871ec42e63dc48f9064a898644bfac90c1880be2b67e925626f2a6665d0914eb Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.075137 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eea55e6310d7a892468f72d28cd3bac.slice/crio-c7e0072633429ec6e271ff243b30def84f5c45430bd0fc69c644455c5feb6701 WatchSource:0}: Error finding container c7e0072633429ec6e271ff243b30def84f5c45430bd0fc69c644455c5feb6701: Status 404 returned error can't find the container with id c7e0072633429ec6e271ff243b30def84f5c45430bd0fc69c644455c5feb6701 Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.078983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v577f" Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.083384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.088988 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.089902 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f8cab8_38fa_4508_aa92_71604ed11526.slice/crio-be38490c1e1e266f4748e447c7d9942e65fe48dbb122b479de412036fc93c30b WatchSource:0}: Error finding container be38490c1e1e266f4748e447c7d9942e65fe48dbb122b479de412036fc93c30b: Status 404 returned error can't find the container with id be38490c1e1e266f4748e447c7d9942e65fe48dbb122b479de412036fc93c30b Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.096581 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489ba13d_ff4d_4dfd_8f1f_d1a794ab48a3.slice/crio-b109b74418973c6d1f2bf6c88e558ff039c669c29ecc26acba81491c8b20858b WatchSource:0}: Error finding container b109b74418973c6d1f2bf6c88e558ff039c669c29ecc26acba81491c8b20858b: Status 404 returned error can't find the container with id b109b74418973c6d1f2bf6c88e558ff039c669c29ecc26acba81491c8b20858b Jul 19 16:38:06.145952 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.097541 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccb1785_7a2f_466f_a24f_dff097b59069.slice/crio-9032d83662e99f17b333d5ba1b9cc07dc99ca51ef2c71851d0d201435d6929b8 WatchSource:0}: Error finding container 9032d83662e99f17b333d5ba1b9cc07dc99ca51ef2c71851d0d201435d6929b8: Status 404 returned error can't find the container with id 9032d83662e99f17b333d5ba1b9cc07dc99ca51ef2c71851d0d201435d6929b8 Jul 19 16:38:06.242326 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.149504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qd6rh" Jul 19 16:38:06.242326 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.158654 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00631596_a145_4788_9027_5d7e8aa14929.slice/crio-27f6cde074457cfe6419fa022ccd8a9b0008bbb5e8a9cc73f3f83ed93bd51e31 WatchSource:0}: Error finding container 27f6cde074457cfe6419fa022ccd8a9b0008bbb5e8a9cc73f3f83ed93bd51e31: Status 404 returned error can't find the container with id 27f6cde074457cfe6419fa022ccd8a9b0008bbb5e8a9cc73f3f83ed93bd51e31 Jul 19 16:38:06.242326 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.177246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-flxbd" Jul 19 16:38:06.242326 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.187011 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124516d4_5d51_483b_b292_de29432d7797.slice/crio-65bb43001e68e448a73f203aa3d68133e7bcad03bf5836cdc63f9822d631afdd WatchSource:0}: Error finding container 65bb43001e68e448a73f203aa3d68133e7bcad03bf5836cdc63f9822d631afdd: Status 404 returned error can't find the container with id 65bb43001e68e448a73f203aa3d68133e7bcad03bf5836cdc63f9822d631afdd Jul 19 16:38:06.242326 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.210016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:06.242326 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.217369 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf21941b_9c93_489c_ac4f_f4ca4125c5da.slice/crio-5d0823fe593daaa98fbc908128ae27dfcc6382af39569d5f228de5361e33e1da WatchSource:0}: Error finding container 5d0823fe593daaa98fbc908128ae27dfcc6382af39569d5f228de5361e33e1da: Status 404 returned error can't find the container with id 5d0823fe593daaa98fbc908128ae27dfcc6382af39569d5f228de5361e33e1da Jul 19 16:38:06.343554 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.244029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" Jul 19 16:38:06.343554 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.251735 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c26dd8_0325_4d9c_a8f8_a366949af7d5.slice/crio-4b9d253af1f326897b4cce8a3f6eac1ab0cf95eaecea0f1475fbf6fe66852ce6 WatchSource:0}: Error finding container 4b9d253af1f326897b4cce8a3f6eac1ab0cf95eaecea0f1475fbf6fe66852ce6: Status 404 returned error can't find the container with id 4b9d253af1f326897b4cce8a3f6eac1ab0cf95eaecea0f1475fbf6fe66852ce6 Jul 19 16:38:06.343554 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.311180 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 16:38:06.361184 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.361160 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1bc765_ab63_4ff2_bef8_d3c07864669c.slice/crio-cc3e624d3637135f05ced2fb467a2e89d3f1b87d698d9a63310e05e06f176719 WatchSource:0}: Error finding container cc3e624d3637135f05ced2fb467a2e89d3f1b87d698d9a63310e05e06f176719: Status 404 returned error can't find the container with id cc3e624d3637135f05ced2fb467a2e89d3f1b87d698d9a63310e05e06f176719 Jul 19 16:38:06.422438 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:06.422420 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d09047_630d_4ecb_ac4a_0377506463a1.slice/crio-7a699bbaf16f7199c2cd122a9d30d6c9a1e35f2cc315688063b209a38286ea09 WatchSource:0}: Error finding container 7a699bbaf16f7199c2cd122a9d30d6c9a1e35f2cc315688063b209a38286ea09: Status 404 returned error can't find the container with id 7a699bbaf16f7199c2cd122a9d30d6c9a1e35f2cc315688063b209a38286ea09 Jul 19 16:38:06.464551 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.464535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:06.464645 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.464571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:06.464645 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.464598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464667 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464674 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464719 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:07.464703306 +0000 UTC m=+3.118595610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464720 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464734 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:38:07.464727251 +0000 UTC m=+3.118619541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464742 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:06.464759 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464753 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:06.465102 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:06.464810 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:07.464782739 +0000 UTC m=+3.118675046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:06.729385 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.729155 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 16:38:06.783513 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.783424 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 16:33:05 +0000 UTC" deadline="2028-04-12 23:58:14.863900876 +0000 UTC" Jul 19 16:38:06.783513 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.783517 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15199h20m8.080393998s" Jul 19 16:38:06.864904 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.864582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerStarted","Data":"7a699bbaf16f7199c2cd122a9d30d6c9a1e35f2cc315688063b209a38286ea09"} Jul 19 16:38:06.876858 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.876826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qd6rh" event={"ID":"00631596-a145-4788-9027-5d7e8aa14929","Type":"ContainerStarted","Data":"27f6cde074457cfe6419fa022ccd8a9b0008bbb5e8a9cc73f3f83ed93bd51e31"} Jul 19 16:38:06.881725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.881695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"be38490c1e1e266f4748e447c7d9942e65fe48dbb122b479de412036fc93c30b"} Jul 19 16:38:06.886960 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.886934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" event={"ID":"56f0edff43ab05466ea8a52af03f54d8","Type":"ContainerStarted","Data":"871ec42e63dc48f9064a898644bfac90c1880be2b67e925626f2a6665d0914eb"} Jul 19 16:38:06.898527 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.898502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7fnzr" event={"ID":"2b1bc765-ab63-4ff2-bef8-d3c07864669c","Type":"ContainerStarted","Data":"cc3e624d3637135f05ced2fb467a2e89d3f1b87d698d9a63310e05e06f176719"} Jul 19 16:38:06.911023 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.910993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" event={"ID":"e5c26dd8-0325-4d9c-a8f8-a366949af7d5","Type":"ContainerStarted","Data":"4b9d253af1f326897b4cce8a3f6eac1ab0cf95eaecea0f1475fbf6fe66852ce6"} Jul 19 16:38:06.916933 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.916910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ms2gm" event={"ID":"df21941b-9c93-489c-ac4f-f4ca4125c5da","Type":"ContainerStarted","Data":"5d0823fe593daaa98fbc908128ae27dfcc6382af39569d5f228de5361e33e1da"} Jul 19 16:38:06.925011 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.924986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-flxbd" event={"ID":"124516d4-5d51-483b-b292-de29432d7797","Type":"ContainerStarted","Data":"65bb43001e68e448a73f203aa3d68133e7bcad03bf5836cdc63f9822d631afdd"} Jul 19 16:38:06.929717 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.929691 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v577f" event={"ID":"fccb1785-7a2f-466f-a24f-dff097b59069","Type":"ContainerStarted","Data":"9032d83662e99f17b333d5ba1b9cc07dc99ca51ef2c71851d0d201435d6929b8"} Jul 19 16:38:06.933516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.933459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" event={"ID":"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3","Type":"ContainerStarted","Data":"b109b74418973c6d1f2bf6c88e558ff039c669c29ecc26acba81491c8b20858b"} Jul 19 16:38:06.935236 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:06.935177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" event={"ID":"0eea55e6310d7a892468f72d28cd3bac","Type":"ContainerStarted","Data":"c7e0072633429ec6e271ff243b30def84f5c45430bd0fc69c644455c5feb6701"} Jul 19 16:38:07.471610 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.471576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:07.471791 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.471626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:07.471791 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.471656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:07.471955 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.471794 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:07.471955 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.471814 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:07.471955 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.471824 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:07.471955 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.471877 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:09.471859118 +0000 UTC m=+5.125751422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:07.472301 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.472284 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:07.472363 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.472336 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:38:09.472320789 +0000 UTC m=+5.126213080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:07.472422 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.472392 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:07.472469 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.472423 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:09.472412853 +0000 UTC m=+5.126305148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:07.783872 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.783813 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 16:33:05 +0000 UTC" deadline="2028-02-19 22:09:14.09627423 +0000 UTC" Jul 19 16:38:07.783872 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.783871 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13925h31m6.312406792s" Jul 19 16:38:07.826123 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.826048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:07.826123 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.826090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:07.826312 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.826177 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:07.826312 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.826239 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:07.826312 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:07.826301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:07.826464 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:07.826368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:08.624046 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:08.624018 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 16:38:09.488225 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:09.488193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:09.488242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:09.488273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488402 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488422 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488434 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:13.488471786 +0000 UTC m=+9.142364094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488558 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488589 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:38:13.488578474 +0000 UTC m=+9.142470771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488643 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:09.488772 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.488675 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:13.488662895 +0000 UTC m=+9.142555187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:09.826238 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:09.826215 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:09.826382 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:09.826216 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:09.826382 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.826319 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:09.826515 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.826441 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:09.826515 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:09.826216 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:09.826616 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:09.826548 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:11.826625 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:11.826587 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:11.827087 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:11.826706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:11.827087 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:11.826741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:11.827087 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:11.826729 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:11.827087 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:11.826856 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:11.827087 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:11.826960 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:13.520303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:13.520350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:13.520382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520448 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520502 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520508 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:38:21.520489671 +0000 UTC m=+17.174381975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520518 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520530 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:13.520569 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520564 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:21.520554071 +0000 UTC m=+17.174446362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:13.521453 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520617 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:13.521453 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.520645 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:21.520636222 +0000 UTC m=+17.174528512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:13.826220 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:13.826190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:13.826380 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.826306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:13.826458 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:13.826436 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:13.826458 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:13.826445 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:13.826567 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.826528 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:13.826638 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:13.826611 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:15.826195 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:15.826137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:15.826662 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:15.826254 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:15.826662 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:15.826533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:15.826662 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:15.826563 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:15.826822 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:15.826664 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:15.826822 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:15.826717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:17.826148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:17.826109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:17.826557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:17.826128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:17.826557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:17.826229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:17.826557 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:17.826232 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:17.826557 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:17.826319 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:17.826557 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:17.826427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:19.826670 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:19.826633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:19.827100 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:19.826741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:19.827100 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:19.826754 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:19.827100 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:19.826751 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:19.827100 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:19.826837 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:19.827100 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:19.826955 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:21.582133 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:21.582100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:21.582148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:21.582178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582244 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582285 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582303 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582320 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582333 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582321 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:38:37.582297969 +0000 UTC m=+33.236190280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582390 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:37.582375722 +0000 UTC m=+33.236268018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:21.582553 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.582411 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:37.582401211 +0000 UTC m=+33.236293508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:21.826982 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:21.826951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:21.826982 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:21.826964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:21.826982 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:21.826981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:21.827240 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.827050 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:21.827240 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.827116 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:21.827240 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:21.827185 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:23.826340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:23.826308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:23.826813 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:23.826308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:23.826813 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:23.826458 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:23.826813 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:23.826500 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:23.826813 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:23.826308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:23.826813 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:23.826590 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:25.826212 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:25.826118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:25.826603 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:25.826248 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:25.826603 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:25.826324 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:25.826603 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:25.826417 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:25.826603 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:25.826470 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:25.826603 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:25.826555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:25.990049 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:25.989710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v577f" event={"ID":"fccb1785-7a2f-466f-a24f-dff097b59069","Type":"ContainerStarted","Data":"76fb6b831beab47a27733d50f11c9baabfa6abe24092ba5e8ceb60bd17698b6b"} Jul 19 16:38:26.000147 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.000058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" event={"ID":"489ba13d-ff4d-4dfd-8f1f-d1a794ab48a3","Type":"ContainerStarted","Data":"eb0d1885a73ad5ed9b5659755125a0c399ba5ee934fdc432ec6d9e4cf8287222"} Jul 19 16:38:26.002383 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.002355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:38:26.002795 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.002761 2563 generic.go:356] "Generic (PLEG): container finished" podID="39f8cab8-38fa-4508-aa92-71604ed11526" containerID="452a45c2c94586c0c6ee6b7c98f5f8ac9c0d95ba98d29dd87bf365ed01bacf29" exitCode=1 Jul 19 16:38:26.002878 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.002848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerDied","Data":"452a45c2c94586c0c6ee6b7c98f5f8ac9c0d95ba98d29dd87bf365ed01bacf29"} Jul 19 16:38:26.002950 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.002936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"03bb24fe3a556e87892df75a82ac7af4f02e58a0c2d6bec930568525bbd12b5d"} Jul 19 16:38:26.005568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.005548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" event={"ID":"56f0edff43ab05466ea8a52af03f54d8","Type":"ContainerStarted","Data":"70be10393d23eec6eb4a95fe590078c75d3069063bb46e9068fb39e7e6753aa9"} Jul 19 16:38:26.028859 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.028818 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v577f" podStartSLOduration=1.319689215 podStartE2EDuration="21.028803974s" totalImagesPullingTime="19.709114759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:26.010840108 +0000 UTC m=+21.664732447" watchObservedRunningTime="2026-07-19 16:38:26.028803974 +0000 UTC m=+21.682696284" Jul 19 16:38:26.044594 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.044561 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5sbt9" podStartSLOduration=1.5155997829999999 podStartE2EDuration="21.044547872s" totalImagesPullingTime="19.528948089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:26.028737779 +0000 UTC m=+21.682630110" watchObservedRunningTime="2026-07-19 16:38:26.044547872 +0000 UTC m=+21.698440184" Jul 19 16:38:26.045018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:26.044995 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-68.ec2.internal" podStartSLOduration=21.04498983 podStartE2EDuration="21.04498983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:26.044543552 +0000 UTC m=+21.698435864" watchObservedRunningTime="2026-07-19 16:38:26.04498983 +0000 UTC m=+21.698882141" Jul 19 16:38:27.008775 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.008669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" event={"ID":"e5c26dd8-0325-4d9c-a8f8-a366949af7d5","Type":"ContainerStarted","Data":"bc1706d17e542186e8df1d2b1ba8677c4c2d3b14fafde18bd6658dc348b9f0af"} Jul 19 16:38:27.010416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.010170 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ms2gm" event={"ID":"df21941b-9c93-489c-ac4f-f4ca4125c5da","Type":"ContainerStarted","Data":"1e89684b898fda4832be1037119ff07f5d4cc74c1ac587cbd45948de4aa5b8ef"} Jul 19 16:38:27.011682 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.011655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-flxbd" event={"ID":"124516d4-5d51-483b-b292-de29432d7797","Type":"ContainerStarted","Data":"0f0f73c4fae58c4c7b1bfd190496a118b42b0445164241727c80b0781a4a7081"} Jul 19 16:38:27.013254 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.013230 2563 generic.go:356] "Generic (PLEG): container finished" podID="0eea55e6310d7a892468f72d28cd3bac" containerID="36908c9fd3b61b0537759ae4b3a1089805b1187b004b5c3a97045dc80b94b1b8" exitCode=0 Jul 19 16:38:27.013349 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.013310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" event={"ID":"0eea55e6310d7a892468f72d28cd3bac","Type":"ContainerDied","Data":"36908c9fd3b61b0537759ae4b3a1089805b1187b004b5c3a97045dc80b94b1b8"} Jul 19 16:38:27.014949 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.014931 2563 generic.go:356] "Generic (PLEG): container finished" podID="18d09047-630d-4ecb-ac4a-0377506463a1" containerID="f00a5dd6407c6064f6528cbb34fd298d1f98edd54e765387fca439245de04f9f" exitCode=0 Jul 19 16:38:27.015042 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.014998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerDied","Data":"f00a5dd6407c6064f6528cbb34fd298d1f98edd54e765387fca439245de04f9f"} Jul 19 16:38:27.016611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.016546 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qd6rh" event={"ID":"00631596-a145-4788-9027-5d7e8aa14929","Type":"ContainerStarted","Data":"a5928c50d54771f47d24bbe326127d88658c8852d44d4d5ab80dbe9d0b15c212"} Jul 19 16:38:27.019565 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.019549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:38:27.019955 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.019932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"816309bba3ee84fe5ce18c74dbfbf361a2b634a8eac4f5bc54a2040123fe12de"} Jul 19 16:38:27.020046 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.020026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"1f683a0e15cdaad29672a1f3feefdc9da2439742ba73d1377d67102c49f16c60"} Jul 19 16:38:27.020111 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.020075 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"8b3973f9f74fc91461d0579ee1400b2aa6eed2d4f37ba39fa5f14f6981093883"} Jul 19 16:38:27.020111 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.020103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"9e07e658263198a437fae7d9b92e7fb1f46b1b7abd903a30caccd4a27a415ed8"} Jul 19 16:38:27.046978 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.046942 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ms2gm" podStartSLOduration=2.649176275 podStartE2EDuration="22.046924609s" totalImagesPullingTime="19.397748334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:27.024793507 +0000 UTC m=+22.678685813" watchObservedRunningTime="2026-07-19 16:38:27.046924609 +0000 UTC m=+22.700816922" Jul 19 16:38:27.071489 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.071444 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qd6rh" podStartSLOduration=11.670559908 podStartE2EDuration="23.071427317s" totalImagesPullingTime="11.400867409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:27.071128174 +0000 UTC m=+22.725020510" watchObservedRunningTime="2026-07-19 16:38:27.071427317 +0000 UTC m=+22.725319633" Jul 19 16:38:27.085027 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.084980 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-flxbd" podStartSLOduration=2.647989213 podStartE2EDuration="22.084964352s" totalImagesPullingTime="19.436975139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:27.084855451 +0000 UTC m=+22.738747786" watchObservedRunningTime="2026-07-19 16:38:27.084964352 +0000 UTC m=+22.738856664" Jul 19 16:38:27.689286 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.689266 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 19 16:38:27.826194 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.826166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:27.826342 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.826246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:27.826342 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:27.826248 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:27.826342 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:27.826315 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:27.826342 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.826330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:27.826507 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:27.826473 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:27.881569 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.881419 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-19T16:38:27.689281481Z","UUID":"c5b4b2fd-4168-4997-a488-1c94054f5812","Handler":null,"Name":"","Endpoint":""} Jul 19 16:38:27.882872 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.882840 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 19 16:38:27.882872 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:27.882875 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 19 16:38:28.023505 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.023471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7fnzr" event={"ID":"2b1bc765-ab63-4ff2-bef8-d3c07864669c","Type":"ContainerStarted","Data":"64519f03f719de2494d261db38fd0567f0baf85f07f13584f13b655ebb528be8"} Jul 19 16:38:28.025424 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.025395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" event={"ID":"e5c26dd8-0325-4d9c-a8f8-a366949af7d5","Type":"ContainerStarted","Data":"73ced0ce313a3a67bddec2d3228ce76faa93db4f90c9d2ba5579dd00b4e98b9f"} Jul 19 16:38:28.027176 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.027149 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" event={"ID":"0eea55e6310d7a892468f72d28cd3bac","Type":"ContainerStarted","Data":"c5e76b6357dbc6042ada6c62ca9026431be6b631bf6b3f9384ddbb7d9ca53240"} Jul 19 16:38:28.038825 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.038784 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7fnzr" podStartSLOduration=3.774589927 podStartE2EDuration="23.038772603s" totalImagesPullingTime="19.264182676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:28.038369814 +0000 UTC m=+23.692262143" watchObservedRunningTime="2026-07-19 16:38:28.038772603 +0000 UTC m=+23.692664914" Jul 19 16:38:28.052169 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.052134 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-68.ec2.internal" podStartSLOduration=23.052125664 podStartE2EDuration="23.052125664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:28.051614563 +0000 UTC m=+23.705506876" watchObservedRunningTime="2026-07-19 16:38:28.052125664 +0000 UTC m=+23.706017975" Jul 19 16:38:28.877011 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.876983 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:28.877590 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:28.877566 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:29.031564 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:29.031543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:38:29.031991 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:29.031950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"0f035b1ca8b6a355dfef109a6d08dbdc987ed2b029d32c500d75d47edf96151d"} Jul 19 16:38:29.826291 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:29.826262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:29.826435 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:29.826262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:29.826435 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:29.826357 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:29.826435 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:29.826261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:29.826551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:29.826440 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:29.826551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:29.826518 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:30.036541 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:30.036502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" event={"ID":"e5c26dd8-0325-4d9c-a8f8-a366949af7d5","Type":"ContainerStarted","Data":"690c871bd222387d062a6ca0b2018f50127cbf12fe67bd28dcc3b703e8d5841a"} Jul 19 16:38:30.036541 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:30.036528 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 19 16:38:30.052704 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:30.052652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fnr5l" podStartSLOduration=3.065875128 podStartE2EDuration="25.052634492s" totalImagesPullingTime="21.986759364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:30.052004589 +0000 UTC m=+25.705896954" watchObservedRunningTime="2026-07-19 16:38:30.052634492 +0000 UTC m=+25.706526807" Jul 19 16:38:31.096181 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:31.096154 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:31.096596 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:31.096251 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 19 16:38:31.096807 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:31.096789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ms2gm" Jul 19 16:38:31.826900 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:31.826761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:31.827093 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:31.826761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:31.827093 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:31.827016 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:31.827093 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:31.826761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:31.827093 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:31.827084 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:31.827250 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:31.827138 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:32.049102 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:32.049076 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:38:32.049480 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:32.049445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"a16acb4d0dd653d24558aa2463fd455fdcd0c6d3b99ead8d54f6db112f7b3276"} Jul 19 16:38:32.049748 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:32.049727 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:32.049961 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:32.049909 2563 scope.go:117] "RemoveContainer" containerID="452a45c2c94586c0c6ee6b7c98f5f8ac9c0d95ba98d29dd87bf365ed01bacf29" Jul 19 16:38:32.067542 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:32.067520 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:33.054131 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.054094 2563 generic.go:356] "Generic (PLEG): container finished" podID="18d09047-630d-4ecb-ac4a-0377506463a1" containerID="81d1486ae52f9a620015710cf2c2ff105230eae9506df8821d7b3261940ddefa" exitCode=0 Jul 19 16:38:33.055016 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.054182 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerDied","Data":"81d1486ae52f9a620015710cf2c2ff105230eae9506df8821d7b3261940ddefa"} Jul 19 16:38:33.070587 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.070095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:38:33.070998 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.070971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" event={"ID":"39f8cab8-38fa-4508-aa92-71604ed11526","Type":"ContainerStarted","Data":"d7312b6b036fb814c95f168a51022d9f628f1a7ac594fce524549856d0eb7869"} Jul 19 16:38:33.071237 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.071210 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:33.071299 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.071276 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:33.088592 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.088548 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:38:33.132089 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.132047 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" podStartSLOduration=8.552726404 podStartE2EDuration="28.132034213s" totalImagesPullingTime="19.579307809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:33.105322554 +0000 UTC m=+28.759214867" watchObservedRunningTime="2026-07-19 16:38:33.132034213 +0000 UTC m=+28.785926503" Jul 19 16:38:33.767488 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.767235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x6wk4"] Jul 19 16:38:33.767612 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.767541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:33.767657 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:33.767633 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:33.770195 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.770039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dmcvr"] Jul 19 16:38:33.770195 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.770145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:33.770398 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:33.770245 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:33.770666 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.770647 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s875t"] Jul 19 16:38:33.770766 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:33.770740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:33.770846 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:33.770826 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:35.075804 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:35.075775 2563 generic.go:356] "Generic (PLEG): container finished" podID="18d09047-630d-4ecb-ac4a-0377506463a1" containerID="cfca158e1bc396ae0370aac239ee9c946c272f6e5e25e85ab04b27f28f345043" exitCode=0 Jul 19 16:38:35.076194 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:35.075857 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerDied","Data":"cfca158e1bc396ae0370aac239ee9c946c272f6e5e25e85ab04b27f28f345043"} Jul 19 16:38:35.827049 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:35.827023 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:35.827229 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:35.827117 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:35.827229 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:35.827120 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:35.827229 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:35.827164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:35.827396 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:35.827260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:35.827396 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:35.827342 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:37.081145 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.081120 2563 generic.go:356] "Generic (PLEG): container finished" podID="18d09047-630d-4ecb-ac4a-0377506463a1" containerID="fc6f73a6b2d46796e5d034c896fc9618c41982f23ced84b846a8fd798d0f5e4c" exitCode=0 Jul 19 16:38:37.081461 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.081177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerDied","Data":"fc6f73a6b2d46796e5d034c896fc9618c41982f23ced84b846a8fd798d0f5e4c"} Jul 19 16:38:37.605521 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.605495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:37.605625 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.605527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:37.605625 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.605545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:37.605700 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605621 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:37.605700 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605665 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:39:09.605651815 +0000 UTC m=+65.259544108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 16:38:37.605700 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605673 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:37.605786 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605708 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret podName:1e921ab2-20e7-47e9-ae78-818c5afb27a0 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:09.605696412 +0000 UTC m=+65.259588702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret") pod "global-pull-secret-syncer-s875t" (UID: "1e921ab2-20e7-47e9-ae78-818c5afb27a0") : object "kube-system"/"original-pull-secret" not registered Jul 19 16:38:37.605786 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605756 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 16:38:37.605786 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605765 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 16:38:37.605786 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605773 2563 projected.go:196] Error preparing data for projected volume kube-api-access-dj64h for pod openshift-network-diagnostics/network-check-target-dmcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:37.605931 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.605801 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h podName:1bf001be-68a5-4537-b237-d4bb81d2aa08 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:09.605793878 +0000 UTC m=+65.259686168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dj64h" (UniqueName: "kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h") pod "network-check-target-dmcvr" (UID: "1bf001be-68a5-4537-b237-d4bb81d2aa08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 16:38:37.826178 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.826148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:37.826299 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.826184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:37.826299 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:37.826189 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:37.826299 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.826250 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmcvr" podUID="1bf001be-68a5-4537-b237-d4bb81d2aa08" Jul 19 16:38:37.826408 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.826382 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:38:37.826471 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:37.826452 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s875t" podUID="1e921ab2-20e7-47e9-ae78-818c5afb27a0" Jul 19 16:38:38.647753 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.647726 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-68.ec2.internal" event="NodeReady" Jul 19 16:38:38.648136 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.647850 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 19 16:38:38.680699 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.680672 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6"] Jul 19 16:38:38.685025 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.685007 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:38.687295 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.687273 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c998886bb-brtw9"] Jul 19 16:38:38.687632 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.687605 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 19 16:38:38.688223 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.688202 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 19 16:38:38.688315 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.688281 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mqwm4\"" Jul 19 16:38:38.691258 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.691239 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.691509 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.691490 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6"] Jul 19 16:38:38.693870 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.693849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qblxf\"" Jul 19 16:38:38.694009 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.693857 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 19 16:38:38.694009 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.693977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 19 16:38:38.694118 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.694103 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nr4dt"] Jul 19 16:38:38.694422 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.694200 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 19 16:38:38.698445 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.698034 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kxms8"] Jul 19 16:38:38.698445 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.698199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.699650 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.699633 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 19 16:38:38.700513 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.700497 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pk4kh\"" Jul 19 16:38:38.700604 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.700526 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 19 16:38:38.700604 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.700573 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 19 16:38:38.701786 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.701768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.704082 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.704066 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 19 16:38:38.704161 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.704099 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 19 16:38:38.704471 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.704452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wcrqr\"" Jul 19 16:38:38.704572 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.704452 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 19 16:38:38.709063 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.709046 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nr4dt"] Jul 19 16:38:38.709212 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.709095 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxms8"] Jul 19 16:38:38.709212 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.709180 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c998886bb-brtw9"] Jul 19 16:38:38.816306 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rn7\" (UniqueName: \"kubernetes.io/projected/6231b743-d5e6-45d5-bff0-c7cf930c7b78-kube-api-access-58rn7\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.816429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:38.816429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-image-registry-private-configuration\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6231b743-d5e6-45d5-bff0-c7cf930c7b78-config-volume\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.816429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-certificates\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816605 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjk2\" (UniqueName: \"kubernetes.io/projected/ce83ca2b-2ea7-44f9-b123-04f1699eb702-kube-api-access-cpjk2\") pod \"ingress-canary-kxms8\" (UID: \"ce83ca2b-2ea7-44f9-b123-04f1699eb702\") " pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.816605 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:38.816605 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb4dbf62-62fe-4af9-9845-aabedfef8399-ca-trust-extracted\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.816714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6231b743-d5e6-45d5-bff0-c7cf930c7b78-tmp-dir\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.816714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce83ca2b-2ea7-44f9-b123-04f1699eb702-cert\") pod \"ingress-canary-kxms8\" (UID: \"ce83ca2b-2ea7-44f9-b123-04f1699eb702\") " pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.816714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-bound-sa-token\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt8j4\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-kube-api-access-zt8j4\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816794 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-installation-pull-secrets\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.816964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.816829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-trusted-ca\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.917355 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rn7\" (UniqueName: \"kubernetes.io/projected/6231b743-d5e6-45d5-bff0-c7cf930c7b78-kube-api-access-58rn7\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.917355 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:38.917355 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-image-registry-private-configuration\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.917522 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6231b743-d5e6-45d5-bff0-c7cf930c7b78-config-volume\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.917522 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-certificates\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.917522 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjk2\" (UniqueName: \"kubernetes.io/projected/ce83ca2b-2ea7-44f9-b123-04f1699eb702-kube-api-access-cpjk2\") pod \"ingress-canary-kxms8\" (UID: \"ce83ca2b-2ea7-44f9-b123-04f1699eb702\") " pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.918010 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.917985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:38.918091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb4dbf62-62fe-4af9-9845-aabedfef8399-ca-trust-extracted\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.918135 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.918135 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.917974 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:38:38.918135 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6231b743-d5e6-45d5-bff0-c7cf930c7b78-tmp-dir\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.918257 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.918195 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:39.418165068 +0000 UTC m=+35.072057360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:38:38.918257 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce83ca2b-2ea7-44f9-b123-04f1699eb702-cert\") pod \"ingress-canary-kxms8\" (UID: \"ce83ca2b-2ea7-44f9-b123-04f1699eb702\") " pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.918349 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-bound-sa-token\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.918413 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt8j4\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-kube-api-access-zt8j4\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.918706 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918674 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6231b743-d5e6-45d5-bff0-c7cf930c7b78-config-volume\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.918795 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918758 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-certificates\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.918986 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:38.919074 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.918441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.919176 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.919152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-installation-pull-secrets\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.919252 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.919206 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6231b743-d5e6-45d5-bff0-c7cf930c7b78-tmp-dir\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.919350 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.919332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-trusted-ca\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.919421 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.919396 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:38:38.919763 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.919416 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:38:38.921922 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.920033 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:38:38.921922 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.920014 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:39.419877933 +0000 UTC m=+35.073770239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:38:38.921922 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:38.920116 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:39.420099558 +0000 UTC m=+35.073991861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:38:38.921922 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.920316 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb4dbf62-62fe-4af9-9845-aabedfef8399-ca-trust-extracted\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.922803 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.922780 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-trusted-ca\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.923830 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.923804 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-installation-pull-secrets\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.923966 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.923946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-image-registry-private-configuration\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.924020 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.923998 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce83ca2b-2ea7-44f9-b123-04f1699eb702-cert\") pod \"ingress-canary-kxms8\" (UID: \"ce83ca2b-2ea7-44f9-b123-04f1699eb702\") " pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.925669 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.925644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rn7\" (UniqueName: \"kubernetes.io/projected/6231b743-d5e6-45d5-bff0-c7cf930c7b78-kube-api-access-58rn7\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:38.926652 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.926634 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjk2\" (UniqueName: \"kubernetes.io/projected/ce83ca2b-2ea7-44f9-b123-04f1699eb702-kube-api-access-cpjk2\") pod \"ingress-canary-kxms8\" (UID: \"ce83ca2b-2ea7-44f9-b123-04f1699eb702\") " pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:38.927771 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.927752 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-bound-sa-token\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:38.928170 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:38.928154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt8j4\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-kube-api-access-zt8j4\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:39.022072 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.022047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxms8" Jul 19 16:38:39.161655 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.161629 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxms8"] Jul 19 16:38:39.164331 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:38:39.164298 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce83ca2b_2ea7_44f9_b123_04f1699eb702.slice/crio-a9e231492e8e7419113f832fae29e5244f0f9f5ba58ce7df0b06e16271032cd4 WatchSource:0}: Error finding container a9e231492e8e7419113f832fae29e5244f0f9f5ba58ce7df0b06e16271032cd4: Status 404 returned error can't find the container with id a9e231492e8e7419113f832fae29e5244f0f9f5ba58ce7df0b06e16271032cd4 Jul 19 16:38:39.424715 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.424647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:39.424715 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.424707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.424735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424802 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424822 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424832 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424841 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424904 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:40.424864259 +0000 UTC m=+36.078756563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:38:39.424933 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424924 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:40.424913805 +0000 UTC m=+36.078806097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:38:39.425166 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:39.424943 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:40.424935731 +0000 UTC m=+36.078828024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:38:39.827297 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.827266 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:38:39.827297 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.827297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:38:39.828158 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.827641 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:38:39.830160 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.830141 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 19 16:38:39.831573 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.831368 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 19 16:38:39.831573 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.831383 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 19 16:38:39.831573 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.831399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sh2cq\"" Jul 19 16:38:39.831573 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.831445 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 19 16:38:39.831573 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:39.831399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhnw\"" Jul 19 16:38:40.091933 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:40.091839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxms8" event={"ID":"ce83ca2b-2ea7-44f9-b123-04f1699eb702","Type":"ContainerStarted","Data":"a9e231492e8e7419113f832fae29e5244f0f9f5ba58ce7df0b06e16271032cd4"} Jul 19 16:38:40.432176 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:40.432102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:40.432331 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:40.432179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:40.432331 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:40.432215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:40.432331 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432326 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:38:40.432481 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432340 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:38:40.432481 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432395 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:42.432375197 +0000 UTC m=+38.086267503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:38:40.432481 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432474 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:38:40.432589 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432510 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:42.432498088 +0000 UTC m=+38.086390383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:38:40.432589 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432568 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:38:40.432680 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:40.432595 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:42.432585094 +0000 UTC m=+38.086477400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:38:42.447532 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:42.447494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:42.447551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:42.447598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447670 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447715 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447730 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447739 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447750 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:46.447731216 +0000 UTC m=+42.101623508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447768 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:46.447759476 +0000 UTC m=+42.101651768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:38:42.448074 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:42.447788 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:46.447775883 +0000 UTC m=+42.101668185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:38:44.102443 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:44.102411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxms8" event={"ID":"ce83ca2b-2ea7-44f9-b123-04f1699eb702","Type":"ContainerStarted","Data":"670c02b3b596440c810081b348e4fe396b5c99df37a0ad6dfb61f439e2b03c88"} Jul 19 16:38:44.104895 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:44.104858 2563 generic.go:356] "Generic (PLEG): container finished" podID="18d09047-630d-4ecb-ac4a-0377506463a1" containerID="e562d4d10ab75392093e91ee433f9e3426078bee549b85d57ad1033f180d4c8a" exitCode=0 Jul 19 16:38:44.104978 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:44.104933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerDied","Data":"e562d4d10ab75392093e91ee433f9e3426078bee549b85d57ad1033f180d4c8a"} Jul 19 16:38:44.118748 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:44.118712 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kxms8" podStartSLOduration=2.174699362 podStartE2EDuration="6.118700351s" totalImagesPullingTime="3.944000989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:44.117742308 +0000 UTC m=+39.771634644" watchObservedRunningTime="2026-07-19 16:38:44.118700351 +0000 UTC m=+39.772592662" Jul 19 16:38:45.109039 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:45.109015 2563 generic.go:356] "Generic (PLEG): container finished" podID="18d09047-630d-4ecb-ac4a-0377506463a1" containerID="972670c43430803505e42284cdb4c5af1c22402e2a99e383418eac8f0bb53ea5" exitCode=0 Jul 19 16:38:45.109367 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:45.109104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerDied","Data":"972670c43430803505e42284cdb4c5af1c22402e2a99e383418eac8f0bb53ea5"} Jul 19 16:38:46.113969 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:46.113934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" event={"ID":"18d09047-630d-4ecb-ac4a-0377506463a1","Type":"ContainerStarted","Data":"b9808ad3a3c1efd81252ca690679648697bbf881e5ec4a2e42b3206b21504ced"} Jul 19 16:38:46.137683 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:46.137641 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dvz5g" podStartSLOduration=8.473324279 podStartE2EDuration="41.137627124s" totalImagesPullingTime="32.664302845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:38:46.135369481 +0000 UTC m=+41.789261791" watchObservedRunningTime="2026-07-19 16:38:46.137627124 +0000 UTC m=+41.791519434" Jul 19 16:38:46.474365 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:46.474310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:46.474365 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:46.474345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:46.474372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474431 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474443 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474456 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474473 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474485 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:54.47447068 +0000 UTC m=+50.128362974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474498 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:54.474492599 +0000 UTC m=+50.128384889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:38:46.474551 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:46.474524 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:38:54.474509896 +0000 UTC m=+50.128402186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:38:54.526275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:54.526207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:38:54.526275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:54.526249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:38:54.526295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526343 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526359 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526382 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526396 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526407 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:10.526392871 +0000 UTC m=+66.180285186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526426 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:10.526413713 +0000 UTC m=+66.180306003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:38:54.526631 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:38:54.526438 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:10.52643277 +0000 UTC m=+66.180325060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:39:05.090304 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:05.090273 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpnh6" Jul 19 16:39:09.625996 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.625961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:39:09.625996 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.625999 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:39:09.626438 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.626018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:39:09.628667 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.628649 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 19 16:39:09.628714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.628668 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 19 16:39:09.628747 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.628712 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 19 16:39:09.636998 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:09.636975 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 19 16:39:09.637109 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:09.637038 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:40:13.637020253 +0000 UTC m=+129.290912559 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : secret "metrics-daemon-secret" not found Jul 19 16:39:09.639022 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.639006 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 19 16:39:09.639775 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.639759 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e921ab2-20e7-47e9-ae78-818c5afb27a0-original-pull-secret\") pod \"global-pull-secret-syncer-s875t\" (UID: \"1e921ab2-20e7-47e9-ae78-818c5afb27a0\") " pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:39:09.649241 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.649211 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj64h\" (UniqueName: \"kubernetes.io/projected/1bf001be-68a5-4537-b237-d4bb81d2aa08-kube-api-access-dj64h\") pod \"network-check-target-dmcvr\" (UID: \"1bf001be-68a5-4537-b237-d4bb81d2aa08\") " pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:39:09.841097 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.841076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s875t" Jul 19 16:39:09.858561 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.858545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sh2cq\"" Jul 19 16:39:09.866419 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.866399 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:39:09.959763 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.959734 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s875t"] Jul 19 16:39:09.963449 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:39:09.963417 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e921ab2_20e7_47e9_ae78_818c5afb27a0.slice/crio-a699a962d7dc28c402a1685f552b651a9b86396d670b9a20444b057e8e5d214e WatchSource:0}: Error finding container a699a962d7dc28c402a1685f552b651a9b86396d670b9a20444b057e8e5d214e: Status 404 returned error can't find the container with id a699a962d7dc28c402a1685f552b651a9b86396d670b9a20444b057e8e5d214e Jul 19 16:39:09.983429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:09.983391 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dmcvr"] Jul 19 16:39:09.985552 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:39:09.985527 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf001be_68a5_4537_b237_d4bb81d2aa08.slice/crio-57c0f5c0b9f12e3f4f82f9b88e7533a4a9db43a54682c04cf0dfaecaec774d66 WatchSource:0}: Error finding container 57c0f5c0b9f12e3f4f82f9b88e7533a4a9db43a54682c04cf0dfaecaec774d66: Status 404 returned error can't find the container with id 57c0f5c0b9f12e3f4f82f9b88e7533a4a9db43a54682c04cf0dfaecaec774d66 Jul 19 16:39:10.162636 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:10.162582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dmcvr" event={"ID":"1bf001be-68a5-4537-b237-d4bb81d2aa08","Type":"ContainerStarted","Data":"57c0f5c0b9f12e3f4f82f9b88e7533a4a9db43a54682c04cf0dfaecaec774d66"} Jul 19 16:39:10.163612 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:10.163593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s875t" event={"ID":"1e921ab2-20e7-47e9-ae78-818c5afb27a0","Type":"ContainerStarted","Data":"a699a962d7dc28c402a1685f552b651a9b86396d670b9a20444b057e8e5d214e"} Jul 19 16:39:10.531505 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:10.531485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:39:10.531588 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:10.531530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:39:10.531588 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:10.531574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:39:10.531655 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531638 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:39:10.531691 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531666 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:39:10.531722 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531697 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:39:10.531752 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531722 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:42.531706912 +0000 UTC m=+98.185599214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:39:10.531752 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531745 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:42.53173114 +0000 UTC m=+98.185623431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:39:10.531752 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531701 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:39:10.531854 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:10.531771 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:39:42.531765034 +0000 UTC m=+98.185657324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:39:15.178640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:15.178599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dmcvr" event={"ID":"1bf001be-68a5-4537-b237-d4bb81d2aa08","Type":"ContainerStarted","Data":"630ef8806048a12277e38c171d7f5d7d4828169a0a5748b92091ddca801c092f"} Jul 19 16:39:15.179081 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:15.178700 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:39:15.180041 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:15.180018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s875t" event={"ID":"1e921ab2-20e7-47e9-ae78-818c5afb27a0","Type":"ContainerStarted","Data":"f34457c24026504246dba5ec6998a37911ad037be514dad5a628e9c86e6bf412"} Jul 19 16:39:15.194571 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:15.194489 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dmcvr" podStartSLOduration=65.237867105 podStartE2EDuration="1m10.194478498s" totalImagesPullingTime="4.956611393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:39:15.193014887 +0000 UTC m=+70.846907221" watchObservedRunningTime="2026-07-19 16:39:15.194478498 +0000 UTC m=+70.848370809" Jul 19 16:39:15.206456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:15.206421 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s875t" podStartSLOduration=65.224851544 podStartE2EDuration="1m10.206410116s" totalImagesPullingTime="4.981558572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:39:15.206032033 +0000 UTC m=+70.859924345" watchObservedRunningTime="2026-07-19 16:39:15.206410116 +0000 UTC m=+70.860302448" Jul 19 16:39:42.541162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:42.541061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:39:42.541162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:42.541100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:39:42.541162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:42.541136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541209 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541221 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541240 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541257 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:40:46.541245154 +0000 UTC m=+162.195137444 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541209 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541333 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:40:46.541309321 +0000 UTC m=+162.195201614 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:39:42.541634 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:39:42.541349 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:40:46.541341298 +0000 UTC m=+162.195233588 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:39:46.184147 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:39:46.184121 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dmcvr" Jul 19 16:40:13.642744 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:13.642703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:40:13.643202 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:13.642807 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 19 16:40:13.643202 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:13.642860 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:42:15.64284642 +0000 UTC m=+251.296738710 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : secret "metrics-daemon-secret" not found Jul 19 16:40:41.699125 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:41.699078 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" podUID="64e05a95-a2ae-4ab0-a779-908e2f3b96f5" Jul 19 16:40:41.710215 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:41.707877 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c998886bb-brtw9" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" Jul 19 16:40:41.715456 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:41.715432 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nr4dt" podUID="6231b743-d5e6-45d5-bff0-c7cf930c7b78" Jul 19 16:40:42.354482 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:42.354460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nr4dt" Jul 19 16:40:42.354482 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:42.354473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:40:42.354646 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:42.354473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:40:42.849361 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:42.849335 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:40:46.565327 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:46.565296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:46.565335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:46.565366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565433 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565460 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c998886bb-brtw9: secret "image-registry-tls" not found Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565484 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565437 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565519 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls podName:eb4dbf62-62fe-4af9-9845-aabedfef8399 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:48.56549866 +0000 UTC m=+284.219390957 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls") pod "image-registry-c998886bb-brtw9" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399") : secret "image-registry-tls" not found Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565536 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert podName:64e05a95-a2ae-4ab0-a779-908e2f3b96f5 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:48.56552667 +0000 UTC m=+284.219418968 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-shdt6" (UID: "64e05a95-a2ae-4ab0-a779-908e2f3b96f5") : secret "networking-console-plugin-cert" not found Jul 19 16:40:46.565682 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:40:46.565548 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls podName:6231b743-d5e6-45d5-bff0-c7cf930c7b78 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:48.565540971 +0000 UTC m=+284.219433263 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls") pod "dns-default-nr4dt" (UID: "6231b743-d5e6-45d5-bff0-c7cf930c7b78") : secret "dns-default-metrics-tls" not found Jul 19 16:40:55.826354 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:40:55.826315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:42:15.735879 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:15.735833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:42:15.736357 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:15.735971 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 19 16:42:15.736357 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:15.736037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs podName:7137a64a-214b-414e-8b44-ac2dd29b37ed nodeName:}" failed. No retries permitted until 2026-07-19 16:44:17.736022209 +0000 UTC m=+373.389914500 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs") pod "network-metrics-daemon-x6wk4" (UID: "7137a64a-214b-414e-8b44-ac2dd29b37ed") : secret "metrics-daemon-secret" not found Jul 19 16:42:24.612494 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.612462 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg"] Jul 19 16:42:24.614382 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.614361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.616528 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.616503 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m"] Jul 19 16:42:24.618342 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.618325 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl"] Jul 19 16:42:24.618762 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.618741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.619754 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.618961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 19 16:42:24.619754 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.619345 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 19 16:42:24.623474 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.623053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 19 16:42:24.623730 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.623325 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bxjjl\"" Jul 19 16:42:24.624676 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.624658 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 19 16:42:24.625612 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.625591 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n5h7w"] Jul 19 16:42:24.625701 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.625667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" Jul 19 16:42:24.627317 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627298 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg"] Jul 19 16:42:24.627410 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627376 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.627525 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627408 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pf2hn\"" Jul 19 16:42:24.627744 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627724 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 19 16:42:24.627917 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627728 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:42:24.628035 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627963 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 19 16:42:24.628035 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.627997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 19 16:42:24.628262 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.628247 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7f7dg\"" Jul 19 16:42:24.628436 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.628420 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:42:24.628500 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.628421 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 19 16:42:24.629716 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.629698 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 19 16:42:24.629791 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.629730 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fgsq6\"" Jul 19 16:42:24.629937 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.629922 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 19 16:42:24.629991 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.629935 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 19 16:42:24.631667 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.631562 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:42:24.633071 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.633052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m"] Jul 19 16:42:24.634054 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.634027 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl"] Jul 19 16:42:24.636577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.636558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 19 16:42:24.639521 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.639503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n5h7w"] Jul 19 16:42:24.696319 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5p45\" (UniqueName: \"kubernetes.io/projected/bd9c4f23-1131-4994-bab4-b004e9b73b82-kube-api-access-b5p45\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.696419 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f99975-9b7b-430d-bc70-d430b47e89cc-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.696419 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6f99975-9b7b-430d-bc70-d430b47e89cc-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.696419 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smnlp\" (UniqueName: \"kubernetes.io/projected/c6f99975-9b7b-430d-bc70-d430b47e89cc-kube-api-access-smnlp\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.696577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd9c4f23-1131-4994-bab4-b004e9b73b82-trusted-ca\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.696577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg86f\" (UniqueName: \"kubernetes.io/projected/a3e176c3-0778-4772-8fe0-c5a1e5740b54-kube-api-access-qg86f\") pod \"volume-data-source-validator-78cf4c6f6-rv5rl\" (UID: \"a3e176c3-0778-4772-8fe0-c5a1e5740b54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" Jul 19 16:42:24.696577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd9c4f23-1131-4994-bab4-b004e9b73b82-serving-cert\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.696577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9f3053a5-218b-4fa5-a949-5aa9eda51e92-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.696708 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd9c4f23-1131-4994-bab4-b004e9b73b82-config\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.696708 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.696708 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.696645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qhjl\" (UniqueName: \"kubernetes.io/projected/9f3053a5-218b-4fa5-a949-5aa9eda51e92-kube-api-access-4qhjl\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.712840 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.712819 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2lm2q"] Jul 19 16:42:24.714567 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.714553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.717023 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.717005 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 19 16:42:24.717143 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.717014 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 19 16:42:24.717143 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.717041 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 19 16:42:24.717342 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.717326 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 19 16:42:24.717597 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.717545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5xptb\"" Jul 19 16:42:24.722736 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.722720 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 19 16:42:24.727007 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.726991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2lm2q"] Jul 19 16:42:24.797029 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1173fe4d-4615-4e77-b0e8-65616a480cfd-tmp\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.797142 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f99975-9b7b-430d-bc70-d430b47e89cc-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.797142 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6f99975-9b7b-430d-bc70-d430b47e89cc-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.797250 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smnlp\" (UniqueName: \"kubernetes.io/projected/c6f99975-9b7b-430d-bc70-d430b47e89cc-kube-api-access-smnlp\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.797250 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd9c4f23-1131-4994-bab4-b004e9b73b82-trusted-ca\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.797250 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1173fe4d-4615-4e77-b0e8-65616a480cfd-snapshots\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.797404 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg86f\" (UniqueName: \"kubernetes.io/projected/a3e176c3-0778-4772-8fe0-c5a1e5740b54-kube-api-access-qg86f\") pod \"volume-data-source-validator-78cf4c6f6-rv5rl\" (UID: \"a3e176c3-0778-4772-8fe0-c5a1e5740b54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" Jul 19 16:42:24.797474 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd9c4f23-1131-4994-bab4-b004e9b73b82-serving-cert\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.797516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1173fe4d-4615-4e77-b0e8-65616a480cfd-service-ca-bundle\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.797552 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9f3053a5-218b-4fa5-a949-5aa9eda51e92-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.797597 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd9c4f23-1131-4994-bab4-b004e9b73b82-config\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.797640 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.797691 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1173fe4d-4615-4e77-b0e8-65616a480cfd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.797691 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1173fe4d-4615-4e77-b0e8-65616a480cfd-serving-cert\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.797790 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:24.797717 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:24.797790 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qhjl\" (UniqueName: \"kubernetes.io/projected/9f3053a5-218b-4fa5-a949-5aa9eda51e92-kube-api-access-4qhjl\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.797790 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5p45\" (UniqueName: \"kubernetes.io/projected/bd9c4f23-1131-4994-bab4-b004e9b73b82-kube-api-access-b5p45\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.797790 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:24.797775 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls podName:9f3053a5-218b-4fa5-a949-5aa9eda51e92 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:25.297756588 +0000 UTC m=+260.951648891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c2zvg" (UID: "9f3053a5-218b-4fa5-a949-5aa9eda51e92") : secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:24.798015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.797823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5hr\" (UniqueName: \"kubernetes.io/projected/1173fe4d-4615-4e77-b0e8-65616a480cfd-kube-api-access-7x5hr\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.798168 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.798148 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd9c4f23-1131-4994-bab4-b004e9b73b82-trusted-ca\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.798265 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.798244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9f3053a5-218b-4fa5-a949-5aa9eda51e92-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.798331 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.798304 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd9c4f23-1131-4994-bab4-b004e9b73b82-config\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.798414 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.798400 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6f99975-9b7b-430d-bc70-d430b47e89cc-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.799336 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.799317 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6f99975-9b7b-430d-bc70-d430b47e89cc-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.799791 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.799775 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd9c4f23-1131-4994-bab4-b004e9b73b82-serving-cert\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.810232 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.810206 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg86f\" (UniqueName: \"kubernetes.io/projected/a3e176c3-0778-4772-8fe0-c5a1e5740b54-kube-api-access-qg86f\") pod \"volume-data-source-validator-78cf4c6f6-rv5rl\" (UID: \"a3e176c3-0778-4772-8fe0-c5a1e5740b54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" Jul 19 16:42:24.811341 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.811316 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qhjl\" (UniqueName: \"kubernetes.io/projected/9f3053a5-218b-4fa5-a949-5aa9eda51e92-kube-api-access-4qhjl\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:24.811433 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.811414 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smnlp\" (UniqueName: \"kubernetes.io/projected/c6f99975-9b7b-430d-bc70-d430b47e89cc-kube-api-access-smnlp\") pod \"kube-storage-version-migrator-operator-7658d9b749-v5b8m\" (UID: \"c6f99975-9b7b-430d-bc70-d430b47e89cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.811523 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.811508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5p45\" (UniqueName: \"kubernetes.io/projected/bd9c4f23-1131-4994-bab4-b004e9b73b82-kube-api-access-b5p45\") pod \"console-operator-565b7b569d-n5h7w\" (UID: \"bd9c4f23-1131-4994-bab4-b004e9b73b82\") " pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:24.898486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5hr\" (UniqueName: \"kubernetes.io/projected/1173fe4d-4615-4e77-b0e8-65616a480cfd-kube-api-access-7x5hr\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.898486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1173fe4d-4615-4e77-b0e8-65616a480cfd-tmp\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.898635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1173fe4d-4615-4e77-b0e8-65616a480cfd-snapshots\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.898635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1173fe4d-4615-4e77-b0e8-65616a480cfd-service-ca-bundle\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.898748 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1173fe4d-4615-4e77-b0e8-65616a480cfd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.898805 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1173fe4d-4615-4e77-b0e8-65616a480cfd-serving-cert\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.898866 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898815 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1173fe4d-4615-4e77-b0e8-65616a480cfd-tmp\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.899007 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.898990 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1173fe4d-4615-4e77-b0e8-65616a480cfd-service-ca-bundle\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.899066 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.899025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1173fe4d-4615-4e77-b0e8-65616a480cfd-snapshots\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.899469 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.899448 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1173fe4d-4615-4e77-b0e8-65616a480cfd-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.900593 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.900578 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1173fe4d-4615-4e77-b0e8-65616a480cfd-serving-cert\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.906091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.906070 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5hr\" (UniqueName: \"kubernetes.io/projected/1173fe4d-4615-4e77-b0e8-65616a480cfd-kube-api-access-7x5hr\") pod \"insights-operator-555d9d7885-2lm2q\" (UID: \"1173fe4d-4615-4e77-b0e8-65616a480cfd\") " pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:24.935090 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.935070 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" Jul 19 16:42:24.942482 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.942463 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" Jul 19 16:42:24.947120 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:24.947101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:25.022722 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.022692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" Jul 19 16:42:25.069921 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.069851 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m"] Jul 19 16:42:25.073448 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:25.073416 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f99975_9b7b_430d_bc70_d430b47e89cc.slice/crio-041e6d76e0cc25985cbfae195fa51d61413c9428275ba6968a1da99c70712932 WatchSource:0}: Error finding container 041e6d76e0cc25985cbfae195fa51d61413c9428275ba6968a1da99c70712932: Status 404 returned error can't find the container with id 041e6d76e0cc25985cbfae195fa51d61413c9428275ba6968a1da99c70712932 Jul 19 16:42:25.084572 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.084548 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl"] Jul 19 16:42:25.087354 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:25.087324 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e176c3_0778_4772_8fe0_c5a1e5740b54.slice/crio-7e9557ed2d56f0dfcf742256f12068eb6fb497eb1327bf231165eb18e50a8427 WatchSource:0}: Error finding container 7e9557ed2d56f0dfcf742256f12068eb6fb497eb1327bf231165eb18e50a8427: Status 404 returned error can't find the container with id 7e9557ed2d56f0dfcf742256f12068eb6fb497eb1327bf231165eb18e50a8427 Jul 19 16:42:25.110948 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.110922 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n5h7w"] Jul 19 16:42:25.113879 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:25.113858 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9c4f23_1131_4994_bab4_b004e9b73b82.slice/crio-b022f43ab1f01a263de469eed2fcceaf95de40232e82b68f03b3963f6e1c0053 WatchSource:0}: Error finding container b022f43ab1f01a263de469eed2fcceaf95de40232e82b68f03b3963f6e1c0053: Status 404 returned error can't find the container with id b022f43ab1f01a263de469eed2fcceaf95de40232e82b68f03b3963f6e1c0053 Jul 19 16:42:25.184370 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.184351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2lm2q"] Jul 19 16:42:25.186162 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:25.186139 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1173fe4d_4615_4e77_b0e8_65616a480cfd.slice/crio-10a14f96118c16a8ff0f7993b764004c7ceeb2325c472c9b7b90ce5bd6ad3452 WatchSource:0}: Error finding container 10a14f96118c16a8ff0f7993b764004c7ceeb2325c472c9b7b90ce5bd6ad3452: Status 404 returned error can't find the container with id 10a14f96118c16a8ff0f7993b764004c7ceeb2325c472c9b7b90ce5bd6ad3452 Jul 19 16:42:25.301744 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.301711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:25.301850 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:25.301838 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:25.301922 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:25.301915 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls podName:9f3053a5-218b-4fa5-a949-5aa9eda51e92 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:26.301899117 +0000 UTC m=+261.955791420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c2zvg" (UID: "9f3053a5-218b-4fa5-a949-5aa9eda51e92") : secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:25.563752 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.563728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" event={"ID":"bd9c4f23-1131-4994-bab4-b004e9b73b82","Type":"ContainerStarted","Data":"b022f43ab1f01a263de469eed2fcceaf95de40232e82b68f03b3963f6e1c0053"} Jul 19 16:42:25.564997 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.564964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" event={"ID":"a3e176c3-0778-4772-8fe0-c5a1e5740b54","Type":"ContainerStarted","Data":"7e9557ed2d56f0dfcf742256f12068eb6fb497eb1327bf231165eb18e50a8427"} Jul 19 16:42:25.566199 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.566164 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" event={"ID":"c6f99975-9b7b-430d-bc70-d430b47e89cc","Type":"ContainerStarted","Data":"041e6d76e0cc25985cbfae195fa51d61413c9428275ba6968a1da99c70712932"} Jul 19 16:42:25.567331 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:25.567308 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" event={"ID":"1173fe4d-4615-4e77-b0e8-65616a480cfd","Type":"ContainerStarted","Data":"10a14f96118c16a8ff0f7993b764004c7ceeb2325c472c9b7b90ce5bd6ad3452"} Jul 19 16:42:26.309994 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:26.309966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:26.310396 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:26.310149 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:26.310396 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:26.310206 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls podName:9f3053a5-218b-4fa5-a949-5aa9eda51e92 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:28.310188716 +0000 UTC m=+263.964081023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c2zvg" (UID: "9f3053a5-218b-4fa5-a949-5aa9eda51e92") : secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:26.571952 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:26.571869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" event={"ID":"a3e176c3-0778-4772-8fe0-c5a1e5740b54","Type":"ContainerStarted","Data":"b0d77bbdfa45aba5d58bd9c38f854873388d28b0496925776cace5a897acecac"} Jul 19 16:42:26.587295 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:26.587241 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rv5rl" podStartSLOduration=1.497267862 podStartE2EDuration="2.587220166s" totalImagesPullingTime="1.089952304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:26.586585877 +0000 UTC m=+262.240478215" watchObservedRunningTime="2026-07-19 16:42:26.587220166 +0000 UTC m=+262.241112461" Jul 19 16:42:28.324833 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.324805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:28.325202 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:28.324960 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:28.325202 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:28.325031 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls podName:9f3053a5-218b-4fa5-a949-5aa9eda51e92 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:32.325010974 +0000 UTC m=+267.978903267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c2zvg" (UID: "9f3053a5-218b-4fa5-a949-5aa9eda51e92") : secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:28.579992 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.579939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/0.log" Jul 19 16:42:28.579992 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.579973 2563 generic.go:356] "Generic (PLEG): container finished" podID="bd9c4f23-1131-4994-bab4-b004e9b73b82" containerID="efe89d379da6667ec92665ae8ca43ddd510f64527d48eb25ddc26b7178e43985" exitCode=255 Jul 19 16:42:28.580141 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.580036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" event={"ID":"bd9c4f23-1131-4994-bab4-b004e9b73b82","Type":"ContainerDied","Data":"efe89d379da6667ec92665ae8ca43ddd510f64527d48eb25ddc26b7178e43985"} Jul 19 16:42:28.580256 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.580240 2563 scope.go:117] "RemoveContainer" containerID="efe89d379da6667ec92665ae8ca43ddd510f64527d48eb25ddc26b7178e43985" Jul 19 16:42:28.581575 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.581545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" event={"ID":"c6f99975-9b7b-430d-bc70-d430b47e89cc","Type":"ContainerStarted","Data":"beae430e87df90901dba9c899ea05338786a757ea52728667bc9d8cc874aa2de"} Jul 19 16:42:28.582801 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.582781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" event={"ID":"1173fe4d-4615-4e77-b0e8-65616a480cfd","Type":"ContainerStarted","Data":"6dc358e901ff7902f93e053c50861d3ffe43d7d256c503e4087a6fc27a6fe1e1"} Jul 19 16:42:28.611139 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:28.611098 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" podStartSLOduration=1.679218697 podStartE2EDuration="4.611086371s" totalImagesPullingTime="2.931867674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:28.610755576 +0000 UTC m=+264.264647889" watchObservedRunningTime="2026-07-19 16:42:28.611086371 +0000 UTC m=+264.264978683" Jul 19 16:42:29.210151 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.210090 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" podStartSLOduration=2.388289657 podStartE2EDuration="5.210068669s" totalImagesPullingTime="2.821779012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:28.626357994 +0000 UTC m=+264.280250306" watchObservedRunningTime="2026-07-19 16:42:29.210068669 +0000 UTC m=+264.863960981" Jul 19 16:42:29.210703 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.210685 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68"] Jul 19 16:42:29.213628 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.213608 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" Jul 19 16:42:29.215971 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.215951 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 19 16:42:29.216093 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.216015 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k2z47\"" Jul 19 16:42:29.216862 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.216849 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 19 16:42:29.224129 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.224107 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68"] Jul 19 16:42:29.331715 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.331691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8s5q\" (UniqueName: \"kubernetes.io/projected/b473e724-73a8-45ae-b36d-e0bdb2957e71-kube-api-access-f8s5q\") pod \"migrator-7cc9c7ffd7-jws68\" (UID: \"b473e724-73a8-45ae-b36d-e0bdb2957e71\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" Jul 19 16:42:29.432865 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.432844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8s5q\" (UniqueName: \"kubernetes.io/projected/b473e724-73a8-45ae-b36d-e0bdb2957e71-kube-api-access-f8s5q\") pod \"migrator-7cc9c7ffd7-jws68\" (UID: \"b473e724-73a8-45ae-b36d-e0bdb2957e71\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" Jul 19 16:42:29.441804 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.441784 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8s5q\" (UniqueName: \"kubernetes.io/projected/b473e724-73a8-45ae-b36d-e0bdb2957e71-kube-api-access-f8s5q\") pod \"migrator-7cc9c7ffd7-jws68\" (UID: \"b473e724-73a8-45ae-b36d-e0bdb2957e71\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" Jul 19 16:42:29.522815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.522797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.589469 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.589968 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/0.log" Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.590007 2563 generic.go:356] "Generic (PLEG): container finished" podID="bd9c4f23-1131-4994-bab4-b004e9b73b82" containerID="b412681dd1eac3530971b20b520cd5458c41b8f2503a9523508a48e9f2571b3c" exitCode=255 Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.590851 2563 scope.go:117] "RemoveContainer" containerID="b412681dd1eac3530971b20b520cd5458c41b8f2503a9523508a48e9f2571b3c" Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:29.591030 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n5h7w_openshift-console-operator(bd9c4f23-1131-4994-bab4-b004e9b73b82)\"" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" podUID="bd9c4f23-1131-4994-bab4-b004e9b73b82" Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.591245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" event={"ID":"bd9c4f23-1131-4994-bab4-b004e9b73b82","Type":"ContainerDied","Data":"b412681dd1eac3530971b20b520cd5458c41b8f2503a9523508a48e9f2571b3c"} Jul 19 16:42:29.592340 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.591305 2563 scope.go:117] "RemoveContainer" containerID="efe89d379da6667ec92665ae8ca43ddd510f64527d48eb25ddc26b7178e43985" Jul 19 16:42:29.605212 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.605169 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4gzlz"] Jul 19 16:42:29.610959 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.610158 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.613917 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.613778 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 19 16:42:29.613917 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.613868 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z6jkb\"" Jul 19 16:42:29.614066 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.614037 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 19 16:42:29.616702 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.616639 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4gzlz"] Jul 19 16:42:29.666106 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.666080 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68"] Jul 19 16:42:29.669573 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:29.669550 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb473e724_73a8_45ae_b36d_e0bdb2957e71.slice/crio-7c5d8ac379239855e6b631729e722bc0566d12ce0ef791fa374057e32185f820 WatchSource:0}: Error finding container 7c5d8ac379239855e6b631729e722bc0566d12ce0ef791fa374057e32185f820: Status 404 returned error can't find the container with id 7c5d8ac379239855e6b631729e722bc0566d12ce0ef791fa374057e32185f820 Jul 19 16:42:29.737594 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.737573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4479-1c8f-45e5-a460-69b150b36cd6-crio-socket\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.737689 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.737609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.737689 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.737626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.737771 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.737706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4479-1c8f-45e5-a460-69b150b36cd6-data-volume\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.737771 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.737746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw7zn\" (UniqueName: \"kubernetes.io/projected/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-api-access-nw7zn\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838580 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4479-1c8f-45e5-a460-69b150b36cd6-data-volume\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838662 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw7zn\" (UniqueName: \"kubernetes.io/projected/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-api-access-nw7zn\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838746 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4479-1c8f-45e5-a460-69b150b36cd6-crio-socket\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838807 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838862 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838862 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838838 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4479-1c8f-45e5-a460-69b150b36cd6-data-volume\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.838862 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.838843 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4479-1c8f-45e5-a460-69b150b36cd6-crio-socket\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:29.839032 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:29.838895 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 16:42:29.839032 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:29.838931 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 16:42:29.839032 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:29.838949 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:30.33893388 +0000 UTC m=+265.992826171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : secret "insights-runtime-extractor-tls" not found Jul 19 16:42:29.839032 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:29.838987 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:30.338971229 +0000 UTC m=+265.992863543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : configmap "kube-rbac-proxy" not found Jul 19 16:42:29.846798 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:29.846754 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw7zn\" (UniqueName: \"kubernetes.io/projected/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-api-access-nw7zn\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:30.343624 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.343590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:30.344127 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.343632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:30.344127 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:30.343735 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 16:42:30.344127 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:30.343747 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 16:42:30.344127 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:30.343794 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:31.343776805 +0000 UTC m=+266.997669098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : configmap "kube-rbac-proxy" not found Jul 19 16:42:30.344127 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:30.343812 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:31.34380246 +0000 UTC m=+266.997694752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : secret "insights-runtime-extractor-tls" not found Jul 19 16:42:30.594442 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.594368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" event={"ID":"b473e724-73a8-45ae-b36d-e0bdb2957e71","Type":"ContainerStarted","Data":"7c5d8ac379239855e6b631729e722bc0566d12ce0ef791fa374057e32185f820"} Jul 19 16:42:30.595788 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.595765 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:42:30.596095 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.596082 2563 scope.go:117] "RemoveContainer" containerID="b412681dd1eac3530971b20b520cd5458c41b8f2503a9523508a48e9f2571b3c" Jul 19 16:42:30.596229 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:30.596212 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n5h7w_openshift-console-operator(bd9c4f23-1131-4994-bab4-b004e9b73b82)\"" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" podUID="bd9c4f23-1131-4994-bab4-b004e9b73b82" Jul 19 16:42:30.927331 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.927303 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gg7jr"] Jul 19 16:42:30.931239 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.931219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:30.933962 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.933937 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 19 16:42:30.934098 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.934069 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 19 16:42:30.934158 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.934124 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 19 16:42:30.934158 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.934145 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 19 16:42:30.934257 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.934244 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fzm5l\"" Jul 19 16:42:30.940455 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:30.940435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gg7jr"] Jul 19 16:42:31.048440 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.048415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f914cc4b-f742-41aa-a2a3-69438cf1925f-signing-key\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.048548 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.048446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f914cc4b-f742-41aa-a2a3-69438cf1925f-signing-cabundle\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.048625 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.048609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kf5j\" (UniqueName: \"kubernetes.io/projected/f914cc4b-f742-41aa-a2a3-69438cf1925f-kube-api-access-4kf5j\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.149543 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.149479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kf5j\" (UniqueName: \"kubernetes.io/projected/f914cc4b-f742-41aa-a2a3-69438cf1925f-kube-api-access-4kf5j\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.149635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.149555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f914cc4b-f742-41aa-a2a3-69438cf1925f-signing-key\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.149635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.149581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f914cc4b-f742-41aa-a2a3-69438cf1925f-signing-cabundle\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.150200 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.150175 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f914cc4b-f742-41aa-a2a3-69438cf1925f-signing-cabundle\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.151578 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.151559 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f914cc4b-f742-41aa-a2a3-69438cf1925f-signing-key\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.158060 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.158041 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kf5j\" (UniqueName: \"kubernetes.io/projected/f914cc4b-f742-41aa-a2a3-69438cf1925f-kube-api-access-4kf5j\") pod \"service-ca-58598695f7-gg7jr\" (UID: \"f914cc4b-f742-41aa-a2a3-69438cf1925f\") " pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.241532 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.241502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gg7jr" Jul 19 16:42:31.351348 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.351321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:31.351641 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.351441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:31.351641 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:31.351443 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 16:42:31.351641 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:31.351505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:33.351489264 +0000 UTC m=+269.005381555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : configmap "kube-rbac-proxy" not found Jul 19 16:42:31.351641 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:31.351532 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 16:42:31.351641 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:31.351578 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:33.351564755 +0000 UTC m=+269.005457057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : secret "insights-runtime-extractor-tls" not found Jul 19 16:42:31.356737 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.356717 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gg7jr"] Jul 19 16:42:31.359166 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:31.359148 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf914cc4b_f742_41aa_a2a3_69438cf1925f.slice/crio-6226c5c2d29e024c452737b75d35b96758d3fe6375332de98eb4d10b5613028b WatchSource:0}: Error finding container 6226c5c2d29e024c452737b75d35b96758d3fe6375332de98eb4d10b5613028b: Status 404 returned error can't find the container with id 6226c5c2d29e024c452737b75d35b96758d3fe6375332de98eb4d10b5613028b Jul 19 16:42:31.599858 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.599828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" event={"ID":"b473e724-73a8-45ae-b36d-e0bdb2957e71","Type":"ContainerStarted","Data":"2c44b4cdd387ebcb552271c2ff22b1970adad34c5cdbce559ed04f3afbabd520"} Jul 19 16:42:31.599962 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.599896 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" event={"ID":"b473e724-73a8-45ae-b36d-e0bdb2957e71","Type":"ContainerStarted","Data":"7d4dc6f878a3a556f15d08c90a4444f487bf92fc08f7ff6115e9377cc6143585"} Jul 19 16:42:31.600849 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.600832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gg7jr" event={"ID":"f914cc4b-f742-41aa-a2a3-69438cf1925f","Type":"ContainerStarted","Data":"6226c5c2d29e024c452737b75d35b96758d3fe6375332de98eb4d10b5613028b"} Jul 19 16:42:31.618535 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:31.618479 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jws68" podStartSLOduration=1.444559806 podStartE2EDuration="2.618462135s" totalImagesPullingTime="1.173902329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:31.617432901 +0000 UTC m=+267.271325217" watchObservedRunningTime="2026-07-19 16:42:31.618462135 +0000 UTC m=+267.272354451" Jul 19 16:42:32.359704 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:32.359664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:32.360103 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:32.359787 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:32.360103 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:32.359846 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls podName:9f3053a5-218b-4fa5-a949-5aa9eda51e92 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:40.359828098 +0000 UTC m=+276.013720389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c2zvg" (UID: "9f3053a5-218b-4fa5-a949-5aa9eda51e92") : secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:32.603809 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:32.603786 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-flxbd_124516d4-5d51-483b-b292-de29432d7797/dns-node-resolver/0.log" Jul 19 16:42:33.369095 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:33.369069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:33.369439 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:33.369101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:33.369439 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:33.369193 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 16:42:33.369439 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:33.369227 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 16:42:33.369439 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:33.369238 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:37.3692251 +0000 UTC m=+273.023117395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : configmap "kube-rbac-proxy" not found Jul 19 16:42:33.369439 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:33.369296 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:37.369279684 +0000 UTC m=+273.023171978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : secret "insights-runtime-extractor-tls" not found Jul 19 16:42:33.603614 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:33.603590 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qd6rh_00631596-a145-4788-9027-5d7e8aa14929/node-ca/0.log" Jul 19 16:42:33.609267 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:33.609241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gg7jr" event={"ID":"f914cc4b-f742-41aa-a2a3-69438cf1925f","Type":"ContainerStarted","Data":"b5f55947f0d3cc165bf664c981e868db6726b7d6345fa7e5e0f46246a05e0f1c"} Jul 19 16:42:33.625172 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:33.625106 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-gg7jr" podStartSLOduration=2.005891395 podStartE2EDuration="3.625091204s" totalImagesPullingTime="1.619199809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:33.624453467 +0000 UTC m=+269.278345840" watchObservedRunningTime="2026-07-19 16:42:33.625091204 +0000 UTC m=+269.278983547" Jul 19 16:42:34.204084 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:34.204054 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxms8_ce83ca2b-2ea7-44f9-b123-04f1699eb702/serve-healthcheck-canary/0.log" Jul 19 16:42:34.603993 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:34.603969 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jws68_b473e724-73a8-45ae-b36d-e0bdb2957e71/migrator/0.log" Jul 19 16:42:34.807139 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:34.807097 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jws68_b473e724-73a8-45ae-b36d-e0bdb2957e71/graceful-termination/0.log" Jul 19 16:42:34.947990 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:34.947926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:34.947990 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:34.947980 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:34.948356 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:34.948343 2563 scope.go:117] "RemoveContainer" containerID="b412681dd1eac3530971b20b520cd5458c41b8f2503a9523508a48e9f2571b3c" Jul 19 16:42:34.948527 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:34.948507 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n5h7w_openshift-console-operator(bd9c4f23-1131-4994-bab4-b004e9b73b82)\"" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" podUID="bd9c4f23-1131-4994-bab4-b004e9b73b82" Jul 19 16:42:35.005078 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:35.005056 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-v5b8m_c6f99975-9b7b-430d-bc70-d430b47e89cc/kube-storage-version-migrator-operator/0.log" Jul 19 16:42:37.400746 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:37.400710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:37.400746 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:37.400746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:37.401135 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:37.400854 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 16:42:37.401135 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:37.400894 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 16:42:37.401135 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:37.400946 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:45.400929138 +0000 UTC m=+281.054821430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : configmap "kube-rbac-proxy" not found Jul 19 16:42:37.401135 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:37.400962 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls podName:c78c4479-1c8f-45e5-a460-69b150b36cd6 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:45.400953984 +0000 UTC m=+281.054846278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gzlz" (UID: "c78c4479-1c8f-45e5-a460-69b150b36cd6") : secret "insights-runtime-extractor-tls" not found Jul 19 16:42:40.420854 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:40.420820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:40.421218 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:40.420988 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:40.421218 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:40.421069 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls podName:9f3053a5-218b-4fa5-a949-5aa9eda51e92 nodeName:}" failed. No retries permitted until 2026-07-19 16:42:56.421049015 +0000 UTC m=+292.074941327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c2zvg" (UID: "9f3053a5-218b-4fa5-a949-5aa9eda51e92") : secret "cluster-monitoring-operator-tls" not found Jul 19 16:42:45.355748 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:45.355707 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" podUID="64e05a95-a2ae-4ab0-a779-908e2f3b96f5" Jul 19 16:42:45.355748 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:45.355721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c998886bb-brtw9" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" Jul 19 16:42:45.356146 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:45.355749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nr4dt" podUID="6231b743-d5e6-45d5-bff0-c7cf930c7b78" Jul 19 16:42:45.456861 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.456837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:45.456985 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.456865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:45.457300 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.457286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4479-1c8f-45e5-a460-69b150b36cd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:45.458976 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.458961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4479-1c8f-45e5-a460-69b150b36cd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gzlz\" (UID: \"c78c4479-1c8f-45e5-a460-69b150b36cd6\") " pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:45.522541 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.522522 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4gzlz" Jul 19 16:42:45.637806 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.637784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4gzlz"] Jul 19 16:42:45.639981 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:45.639946 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78c4479_1c8f_45e5_a460_69b150b36cd6.slice/crio-7987fe91d9203f2f049accada24252503bf03e5bfdaf182f247472c84205b366 WatchSource:0}: Error finding container 7987fe91d9203f2f049accada24252503bf03e5bfdaf182f247472c84205b366: Status 404 returned error can't find the container with id 7987fe91d9203f2f049accada24252503bf03e5bfdaf182f247472c84205b366 Jul 19 16:42:45.644240 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.644220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:42:45.644342 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.644282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gzlz" event={"ID":"c78c4479-1c8f-45e5-a460-69b150b36cd6","Type":"ContainerStarted","Data":"7987fe91d9203f2f049accada24252503bf03e5bfdaf182f247472c84205b366"} Jul 19 16:42:45.644342 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.644327 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nr4dt" Jul 19 16:42:45.644442 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:45.644327 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:42:47.826314 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:47.826291 2563 scope.go:117] "RemoveContainer" containerID="b412681dd1eac3530971b20b520cd5458c41b8f2503a9523508a48e9f2571b3c" Jul 19 16:42:48.588902 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.588845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:42:48.589082 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.588933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:42:48.589082 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.588972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:42:48.591644 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.591616 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6231b743-d5e6-45d5-bff0-c7cf930c7b78-metrics-tls\") pod \"dns-default-nr4dt\" (UID: \"6231b743-d5e6-45d5-bff0-c7cf930c7b78\") " pod="openshift-dns/dns-default-nr4dt" Jul 19 16:42:48.591762 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.591680 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"image-registry-c998886bb-brtw9\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:42:48.591762 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.591696 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64e05a95-a2ae-4ab0-a779-908e2f3b96f5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-shdt6\" (UID: \"64e05a95-a2ae-4ab0-a779-908e2f3b96f5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:42:48.648852 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.648825 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mqwm4\"" Jul 19 16:42:48.648852 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.648834 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qblxf\"" Jul 19 16:42:48.649054 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.648925 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pk4kh\"" Jul 19 16:42:48.655792 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.655774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" Jul 19 16:42:48.655920 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.655794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nr4dt" Jul 19 16:42:48.655920 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:48.655774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:42:50.513830 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.513806 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nr4dt"] Jul 19 16:42:50.516797 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:50.516769 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6231b743_d5e6_45d5_bff0_c7cf930c7b78.slice/crio-35a0682d9b3901dbdf6eac2f18faec28f136a24d6f7c9f5563b1e627493f5a9a WatchSource:0}: Error finding container 35a0682d9b3901dbdf6eac2f18faec28f136a24d6f7c9f5563b1e627493f5a9a: Status 404 returned error can't find the container with id 35a0682d9b3901dbdf6eac2f18faec28f136a24d6f7c9f5563b1e627493f5a9a Jul 19 16:42:50.662160 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.662109 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:42:50.662261 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.662228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" event={"ID":"bd9c4f23-1131-4994-bab4-b004e9b73b82","Type":"ContainerStarted","Data":"587348f623391b6303e012616a20af40d503ce55d94f834c27699ff92e916922"} Jul 19 16:42:50.662558 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.662505 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:50.663850 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.663823 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gzlz" event={"ID":"c78c4479-1c8f-45e5-a460-69b150b36cd6","Type":"ContainerStarted","Data":"d22c15301c4860e993e3bc5e0982c9884d6e0d9a34b6b3683768a66cb7f25331"} Jul 19 16:42:50.664916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.664878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nr4dt" event={"ID":"6231b743-d5e6-45d5-bff0-c7cf930c7b78","Type":"ContainerStarted","Data":"35a0682d9b3901dbdf6eac2f18faec28f136a24d6f7c9f5563b1e627493f5a9a"} Jul 19 16:42:50.678535 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.678499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" podStartSLOduration=23.781805217 podStartE2EDuration="26.678487275s" totalImagesPullingTime="2.896682058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:50.677477007 +0000 UTC m=+286.331369318" watchObservedRunningTime="2026-07-19 16:42:50.678487275 +0000 UTC m=+286.332379586" Jul 19 16:42:50.730649 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.730620 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6"] Jul 19 16:42:50.733039 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:50.733016 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e05a95_a2ae_4ab0_a779_908e2f3b96f5.slice/crio-7af8519facee69ad7cd2d19528a2e8d846b8b32314696dc25e9aa2f6ad04d66f WatchSource:0}: Error finding container 7af8519facee69ad7cd2d19528a2e8d846b8b32314696dc25e9aa2f6ad04d66f: Status 404 returned error can't find the container with id 7af8519facee69ad7cd2d19528a2e8d846b8b32314696dc25e9aa2f6ad04d66f Jul 19 16:42:50.735523 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.735477 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c998886bb-brtw9"] Jul 19 16:42:50.737922 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:50.737874 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4dbf62_62fe_4af9_9845_aabedfef8399.slice/crio-de7aba742389eaa3d5a69571938030c388058d743a65ddc47682f8578bf9ff31 WatchSource:0}: Error finding container de7aba742389eaa3d5a69571938030c388058d743a65ddc47682f8578bf9ff31: Status 404 returned error can't find the container with id de7aba742389eaa3d5a69571938030c388058d743a65ddc47682f8578bf9ff31 Jul 19 16:42:50.919624 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:50.919554 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-n5h7w" Jul 19 16:42:51.097210 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.097171 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-8t6hl"] Jul 19 16:42:51.100714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.100695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:42:51.104802 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.103713 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 19 16:42:51.104802 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.104640 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-44bhw\"" Jul 19 16:42:51.106512 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.106319 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 19 16:42:51.109595 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.109541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-8t6hl"] Jul 19 16:42:51.210627 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.210469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82l87\" (UniqueName: \"kubernetes.io/projected/8dacc8c4-6437-45c7-a03d-f6d3d8cde123-kube-api-access-82l87\") pod \"downloads-5bc67dcd46-8t6hl\" (UID: \"8dacc8c4-6437-45c7-a03d-f6d3d8cde123\") " pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:42:51.311867 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.311826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82l87\" (UniqueName: \"kubernetes.io/projected/8dacc8c4-6437-45c7-a03d-f6d3d8cde123-kube-api-access-82l87\") pod \"downloads-5bc67dcd46-8t6hl\" (UID: \"8dacc8c4-6437-45c7-a03d-f6d3d8cde123\") " pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:42:51.321044 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.320992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82l87\" (UniqueName: \"kubernetes.io/projected/8dacc8c4-6437-45c7-a03d-f6d3d8cde123-kube-api-access-82l87\") pod \"downloads-5bc67dcd46-8t6hl\" (UID: \"8dacc8c4-6437-45c7-a03d-f6d3d8cde123\") " pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:42:51.415776 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.415738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:42:51.602448 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.602415 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-8t6hl"] Jul 19 16:42:51.606539 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:51.606503 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dacc8c4_6437_45c7_a03d_f6d3d8cde123.slice/crio-f8501b8dcb05906d54370bfefc17aa2a93ef12ef3791ee8fe99629fb75071312 WatchSource:0}: Error finding container f8501b8dcb05906d54370bfefc17aa2a93ef12ef3791ee8fe99629fb75071312: Status 404 returned error can't find the container with id f8501b8dcb05906d54370bfefc17aa2a93ef12ef3791ee8fe99629fb75071312 Jul 19 16:42:51.671672 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.671596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-8t6hl" event={"ID":"8dacc8c4-6437-45c7-a03d-f6d3d8cde123","Type":"ContainerStarted","Data":"f8501b8dcb05906d54370bfefc17aa2a93ef12ef3791ee8fe99629fb75071312"} Jul 19 16:42:51.674438 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.674351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" event={"ID":"64e05a95-a2ae-4ab0-a779-908e2f3b96f5","Type":"ContainerStarted","Data":"7af8519facee69ad7cd2d19528a2e8d846b8b32314696dc25e9aa2f6ad04d66f"} Jul 19 16:42:51.678072 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.677950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c998886bb-brtw9" event={"ID":"eb4dbf62-62fe-4af9-9845-aabedfef8399","Type":"ContainerStarted","Data":"3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d"} Jul 19 16:42:51.678072 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.677991 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c998886bb-brtw9" event={"ID":"eb4dbf62-62fe-4af9-9845-aabedfef8399","Type":"ContainerStarted","Data":"de7aba742389eaa3d5a69571938030c388058d743a65ddc47682f8578bf9ff31"} Jul 19 16:42:51.678072 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.678042 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:42:51.698395 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:51.696937 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c998886bb-brtw9" podStartSLOduration=286.696922275 podStartE2EDuration="4m46.696922275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:51.696752161 +0000 UTC m=+287.350644499" watchObservedRunningTime="2026-07-19 16:42:51.696922275 +0000 UTC m=+287.350814586" Jul 19 16:42:52.683456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:52.683349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" event={"ID":"64e05a95-a2ae-4ab0-a779-908e2f3b96f5","Type":"ContainerStarted","Data":"e3e3a45ea200bb13518b29ec008101620f487a57d058c023b415855b894e7bc6"} Jul 19 16:42:52.700302 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:52.700191 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-shdt6" podStartSLOduration=265.29164353 podStartE2EDuration="4m26.700174493s" totalImagesPullingTime="1.408530963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:52.698407879 +0000 UTC m=+288.352300216" watchObservedRunningTime="2026-07-19 16:42:52.700174493 +0000 UTC m=+288.354066806" Jul 19 16:42:55.698945 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:55.698908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gzlz" event={"ID":"c78c4479-1c8f-45e5-a460-69b150b36cd6","Type":"ContainerStarted","Data":"cddd85af372ba3eedc2735b62edac55e4e4bcdeaae9b715a1843cf4baaacf2f2"} Jul 19 16:42:55.701695 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:55.701368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nr4dt" event={"ID":"6231b743-d5e6-45d5-bff0-c7cf930c7b78","Type":"ContainerStarted","Data":"e0a6e703f44f7ba82ac531c17af9941172592e43615afbdde7fb02d974f6dd62"} Jul 19 16:42:55.701695 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:55.701420 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nr4dt" event={"ID":"6231b743-d5e6-45d5-bff0-c7cf930c7b78","Type":"ContainerStarted","Data":"70f9cd880e75a1513663b67ae41aa2f52de78953938a9221c02c86c561c6e8be"} Jul 19 16:42:55.701695 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:55.701459 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nr4dt" Jul 19 16:42:55.718074 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:55.717767 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nr4dt" podStartSLOduration=253.254293645 podStartE2EDuration="4m17.71774597s" totalImagesPullingTime="4.463452325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:55.716673532 +0000 UTC m=+291.370565846" watchObservedRunningTime="2026-07-19 16:42:55.71774597 +0000 UTC m=+291.371638283" Jul 19 16:42:56.457950 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:56.457911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:56.461335 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:56.461305 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f3053a5-218b-4fa5-a949-5aa9eda51e92-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c2zvg\" (UID: \"9f3053a5-218b-4fa5-a949-5aa9eda51e92\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:56.725777 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:56.725678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" Jul 19 16:42:56.872236 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:56.872207 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg"] Jul 19 16:42:56.876023 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:42:56.875994 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3053a5_218b_4fa5_a949_5aa9eda51e92.slice/crio-aa51c0eaf56a86a2b1a56cea2bc0c592cda4560d953b7ee09ad09a25cc4aa828 WatchSource:0}: Error finding container aa51c0eaf56a86a2b1a56cea2bc0c592cda4560d953b7ee09ad09a25cc4aa828: Status 404 returned error can't find the container with id aa51c0eaf56a86a2b1a56cea2bc0c592cda4560d953b7ee09ad09a25cc4aa828 Jul 19 16:42:57.710658 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:57.710596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" event={"ID":"9f3053a5-218b-4fa5-a949-5aa9eda51e92","Type":"ContainerStarted","Data":"aa51c0eaf56a86a2b1a56cea2bc0c592cda4560d953b7ee09ad09a25cc4aa828"} Jul 19 16:42:58.827562 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:42:58.827523 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x6wk4" podUID="7137a64a-214b-414e-8b44-ac2dd29b37ed" Jul 19 16:42:59.721297 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:59.721224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gzlz" event={"ID":"c78c4479-1c8f-45e5-a460-69b150b36cd6","Type":"ContainerStarted","Data":"b3b9617beb2d22b03e569303d4c7b1db623d7b4baab50c5e2f57f8660f0a391c"} Jul 19 16:42:59.739948 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:42:59.739874 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4gzlz" podStartSLOduration=17.601487543 podStartE2EDuration="30.739853871s" totalImagesPullingTime="13.138366328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 16:42:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:42:59.737897591 +0000 UTC m=+295.391789901" watchObservedRunningTime="2026-07-19 16:42:59.739853871 +0000 UTC m=+295.393746183" Jul 19 16:43:00.728019 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.727928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" event={"ID":"9f3053a5-218b-4fa5-a949-5aa9eda51e92","Type":"ContainerStarted","Data":"f87c662cc2b889d05ee3fb153a8fcde5202715eff0e1a5749d65f7ebd2691c46"} Jul 19 16:43:00.746910 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.746854 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c2zvg" podStartSLOduration=33.275739385 podStartE2EDuration="36.746837042s" totalImagesPullingTime="3.471097657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:00.745778583 +0000 UTC m=+296.399670895" watchObservedRunningTime="2026-07-19 16:43:00.746837042 +0000 UTC m=+296.400729353" Jul 19 16:43:00.842785 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.842756 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx"] Jul 19 16:43:00.846041 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.846017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:00.848542 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.848522 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 19 16:43:00.848670 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.848583 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vtcml\"" Jul 19 16:43:00.855680 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.855649 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx"] Jul 19 16:43:00.996762 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:00.996684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61f569e5-51eb-44a8-a87a-fda4082184da-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2hzzx\" (UID: \"61f569e5-51eb-44a8-a87a-fda4082184da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:01.097239 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.097204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61f569e5-51eb-44a8-a87a-fda4082184da-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2hzzx\" (UID: \"61f569e5-51eb-44a8-a87a-fda4082184da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:01.097413 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:01.097334 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 19 16:43:01.097413 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:01.097393 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f569e5-51eb-44a8-a87a-fda4082184da-tls-certificates podName:61f569e5-51eb-44a8-a87a-fda4082184da nodeName:}" failed. No retries permitted until 2026-07-19 16:43:01.597374915 +0000 UTC m=+297.251267224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/61f569e5-51eb-44a8-a87a-fda4082184da-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-2hzzx" (UID: "61f569e5-51eb-44a8-a87a-fda4082184da") : secret "prometheus-operator-admission-webhook-tls" not found Jul 19 16:43:01.602127 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.602096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61f569e5-51eb-44a8-a87a-fda4082184da-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2hzzx\" (UID: \"61f569e5-51eb-44a8-a87a-fda4082184da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:01.604370 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.604341 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61f569e5-51eb-44a8-a87a-fda4082184da-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2hzzx\" (UID: \"61f569e5-51eb-44a8-a87a-fda4082184da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:01.757724 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.757677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:01.805442 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.805408 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b6b6648-96dpt"] Jul 19 16:43:01.830903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.830854 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b6b6648-96dpt"] Jul 19 16:43:01.831054 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.830984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:01.833698 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.833669 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 19 16:43:01.833820 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.833797 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 19 16:43:01.833917 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.833898 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 19 16:43:01.833989 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.833929 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 19 16:43:01.834681 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.834657 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 19 16:43:01.835070 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:01.835047 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l4jtz\"" Jul 19 16:43:02.005811 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.005729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-oauth-serving-cert\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.005811 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.005778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-serving-cert\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.006031 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.005819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhkx\" (UniqueName: \"kubernetes.io/projected/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-kube-api-access-xvhkx\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.006031 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.005845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-service-ca\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.006031 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.005873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-oauth-config\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.006031 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.005988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-config\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.106936 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.106899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhkx\" (UniqueName: \"kubernetes.io/projected/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-kube-api-access-xvhkx\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107128 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.106951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-service-ca\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107128 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.106979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-oauth-config\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107128 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.107042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-config\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107128 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.107096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-oauth-serving-cert\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107128 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.107119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-serving-cert\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107834 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.107806 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-service-ca\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107988 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.107842 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-config\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.107988 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.107949 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-oauth-serving-cert\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.109717 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.109697 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-serving-cert\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.109896 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.109863 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-oauth-config\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.114349 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.114324 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhkx\" (UniqueName: \"kubernetes.io/projected/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-kube-api-access-xvhkx\") pod \"console-85b6b6648-96dpt\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:02.142184 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:02.142158 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:05.708248 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:05.708221 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nr4dt" Jul 19 16:43:08.475436 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.475414 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:43:08.476549 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.476530 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:43:08.486131 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.486114 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:43:08.486439 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.486381 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:43:08.488758 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.488734 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 19 16:43:08.583188 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.583165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b6b6648-96dpt"] Jul 19 16:43:08.595208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.595186 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx"] Jul 19 16:43:08.660965 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.660938 2563 patch_prober.go:28] interesting pod/image-registry-c998886bb-brtw9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 19 16:43:08.661049 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.660986 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c998886bb-brtw9" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 19 16:43:08.764171 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:08.764116 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c26f4e6_d3ae_4134_a9e0_c9d904c875bc.slice/crio-bab959bb79c7482fccd6ddd51afe98b0dc6100e616e527da141f8d204d8bb2d9 WatchSource:0}: Error finding container bab959bb79c7482fccd6ddd51afe98b0dc6100e616e527da141f8d204d8bb2d9: Status 404 returned error can't find the container with id bab959bb79c7482fccd6ddd51afe98b0dc6100e616e527da141f8d204d8bb2d9 Jul 19 16:43:08.764951 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:08.764928 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f569e5_51eb_44a8_a87a_fda4082184da.slice/crio-c69df4b5dd62ee9e97950b378f98c62a6cc0576e45a2904902c6a8ccb57d3a4f WatchSource:0}: Error finding container c69df4b5dd62ee9e97950b378f98c62a6cc0576e45a2904902c6a8ccb57d3a4f: Status 404 returned error can't find the container with id c69df4b5dd62ee9e97950b378f98c62a6cc0576e45a2904902c6a8ccb57d3a4f Jul 19 16:43:08.797780 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:08.797763 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 16:43:09.766151 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:09.766100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" event={"ID":"61f569e5-51eb-44a8-a87a-fda4082184da","Type":"ContainerStarted","Data":"c69df4b5dd62ee9e97950b378f98c62a6cc0576e45a2904902c6a8ccb57d3a4f"} Jul 19 16:43:09.770157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:09.770065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-8t6hl" event={"ID":"8dacc8c4-6437-45c7-a03d-f6d3d8cde123","Type":"ContainerStarted","Data":"bfa7b3ae53feb9f3db8b8342317b7df9e15f87722d2599567e6945f688298996"} Jul 19 16:43:09.770157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:09.770124 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:43:09.773382 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:09.773354 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b6b6648-96dpt" event={"ID":"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc","Type":"ContainerStarted","Data":"bab959bb79c7482fccd6ddd51afe98b0dc6100e616e527da141f8d204d8bb2d9"} Jul 19 16:43:09.781607 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:09.781567 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-8t6hl" Jul 19 16:43:09.806288 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:09.806225 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-8t6hl" podStartSLOduration=1.5734149130000001 podStartE2EDuration="18.806207552s" totalImagesPullingTime="17.232792639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:09.790049033 +0000 UTC m=+305.443941339" watchObservedRunningTime="2026-07-19 16:43:09.806207552 +0000 UTC m=+305.460099865" Jul 19 16:43:10.781144 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:10.780912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" event={"ID":"61f569e5-51eb-44a8-a87a-fda4082184da","Type":"ContainerStarted","Data":"692063107fd6e9157b16d6fe03d6fffc40760ccccc333d2774a9aba59c1c69ee"} Jul 19 16:43:10.796574 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:10.796491 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" podStartSLOduration=9.275436288 podStartE2EDuration="10.796471823s" totalImagesPullingTime="1.521035535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:10.795855548 +0000 UTC m=+306.449747860" watchObservedRunningTime="2026-07-19 16:43:10.796471823 +0000 UTC m=+306.450364136" Jul 19 16:43:11.786443 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:11.786006 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:11.791015 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:11.790914 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2hzzx" Jul 19 16:43:12.600524 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:12.600491 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c998886bb-brtw9"] Jul 19 16:43:12.605371 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:12.605345 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:43:12.826116 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:12.826082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:43:13.795194 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:13.795152 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b6b6648-96dpt" event={"ID":"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc","Type":"ContainerStarted","Data":"c63f6d641f5e0a932f4a25255195b60ae78603babc659e417e215c899410fca2"} Jul 19 16:43:13.814630 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:13.814584 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b6b6648-96dpt" podStartSLOduration=8.708953169 podStartE2EDuration="12.814569776s" totalImagesPullingTime="4.105616607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:13.81305027 +0000 UTC m=+309.466942595" watchObservedRunningTime="2026-07-19 16:43:13.814569776 +0000 UTC m=+309.468462087" Jul 19 16:43:17.256651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.256618 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5"] Jul 19 16:43:17.373252 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.373217 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5"] Jul 19 16:43:17.373398 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.373348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.373398 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.373381 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rgtz2"] Jul 19 16:43:17.376725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.376275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-72998\"" Jul 19 16:43:17.376725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.376504 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 19 16:43:17.376725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.376575 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 19 16:43:17.377016 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.376772 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 19 16:43:17.394501 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.394476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.397634 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.397614 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 19 16:43:17.397953 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.397617 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5kc4x\"" Jul 19 16:43:17.398206 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.397658 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 19 16:43:17.398330 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.397753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 19 16:43:17.433206 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-metrics-client-ca\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.433399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-root\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.433567 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.433720 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfsqq\" (UniqueName: \"kubernetes.io/projected/34fd31a6-c6fc-4c06-a803-15308dde199d-kube-api-access-kfsqq\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.433799 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.433799 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.433954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47x4\" (UniqueName: \"kubernetes.io/projected/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-kube-api-access-b47x4\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.433954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-textfile\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.433954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fd31a6-c6fc-4c06-a803-15308dde199d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.433954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.434149 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-sys\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.434149 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.433990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-tls\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.434149 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.434021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-wtmp\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.535173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-textfile\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.535364 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fd31a6-c6fc-4c06-a803-15308dde199d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.535486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.535612 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-sys\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.535715 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535683 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-textfile\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.535833 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-tls\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.536014 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.535977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-wtmp\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.536157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-metrics-client-ca\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.536302 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-root\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.536444 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.536576 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfsqq\" (UniqueName: \"kubernetes.io/projected/34fd31a6-c6fc-4c06-a803-15308dde199d-kube-api-access-kfsqq\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.536717 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.536853 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.536988 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47x4\" (UniqueName: \"kubernetes.io/projected/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-kube-api-access-b47x4\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.537126 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536903 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-root\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.537298 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:17.535788 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 19 16:43:17.537461 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:17.537440 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-tls podName:4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19 nodeName:}" failed. No retries permitted until 2026-07-19 16:43:18.037420934 +0000 UTC m=+313.691313248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-tls") pod "node-exporter-rgtz2" (UID: "4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19") : secret "node-exporter-tls" not found Jul 19 16:43:17.537561 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.537477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-metrics-client-ca\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.537835 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536855 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-sys\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.537942 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.536485 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34fd31a6-c6fc-4c06-a803-15308dde199d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.538008 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:17.537942 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 19 16:43:17.538008 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:17.537998 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-tls podName:34fd31a6-c6fc-4c06-a803-15308dde199d nodeName:}" failed. No retries permitted until 2026-07-19 16:43:18.037981143 +0000 UTC m=+313.691873447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-fm7n5" (UID: "34fd31a6-c6fc-4c06-a803-15308dde199d") : secret "openshift-state-metrics-tls" not found Jul 19 16:43:17.538261 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.537011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-wtmp\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.538623 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.538605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.544104 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.541096 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:17.544104 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.543860 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.549251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.548001 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47x4\" (UniqueName: \"kubernetes.io/projected/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-kube-api-access-b47x4\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:17.551207 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:17.551167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfsqq\" (UniqueName: \"kubernetes.io/projected/34fd31a6-c6fc-4c06-a803-15308dde199d-kube-api-access-kfsqq\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:18.041237 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.041204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-tls\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:18.041434 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.041257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:18.043495 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.043471 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19-node-exporter-tls\") pod \"node-exporter-rgtz2\" (UID: \"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19\") " pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:18.043589 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.043473 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34fd31a6-c6fc-4c06-a803-15308dde199d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fm7n5\" (UID: \"34fd31a6-c6fc-4c06-a803-15308dde199d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:18.285793 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.285761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" Jul 19 16:43:18.303975 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.303918 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:43:18.306041 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.306016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgtz2" Jul 19 16:43:18.334076 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.334051 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:43:18.334213 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.334178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.336876 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.336855 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 19 16:43:18.337208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.337001 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w79lk\"" Jul 19 16:43:18.337208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.336900 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 19 16:43:18.337208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.336953 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 19 16:43:18.337208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.336967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 19 16:43:18.337208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.337167 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 19 16:43:18.337626 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.337002 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 19 16:43:18.337626 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.337252 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 19 16:43:18.337626 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.336877 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 19 16:43:18.337626 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.337353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 19 16:43:18.345052 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:18.345013 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6ab4a9_451c_4a1b_9bc9_8fad3e5aad19.slice/crio-5bceb4bf408a60f64775f252cd7a13c5a77bc304d21d85985bc00739027e25c6 WatchSource:0}: Error finding container 5bceb4bf408a60f64775f252cd7a13c5a77bc304d21d85985bc00739027e25c6: Status 404 returned error can't find the container with id 5bceb4bf408a60f64775f252cd7a13c5a77bc304d21d85985bc00739027e25c6 Jul 19 16:43:18.443148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.442981 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5"] Jul 19 16:43:18.444203 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444317 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444374 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444374 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-config-out\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444582 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdh4m\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-kube-api-access-zdh4m\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444582 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444582 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-web-config\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.444725 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.444705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.445479 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:18.445458 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fd31a6_c6fc_4c06_a803_15308dde199d.slice/crio-10585ff6117ec696b521de755a76318a5f5820beaec5f17c87043080e41a01ec WatchSource:0}: Error finding container 10585ff6117ec696b521de755a76318a5f5820beaec5f17c87043080e41a01ec: Status 404 returned error can't find the container with id 10585ff6117ec696b521de755a76318a5f5820beaec5f17c87043080e41a01ec Jul 19 16:43:18.545492 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-web-config\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.545624 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.545624 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.545781 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.545781 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.545781 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-config-out\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdh4m\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-kube-api-access-zdh4m\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.546013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.545997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.547163 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.547125 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.547430 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:18.547410 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 19 16:43:18.548003 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:18.547566 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls podName:eb53823d-cc13-421c-b452-e2fbee64d815 nodeName:}" failed. No retries permitted until 2026-07-19 16:43:19.047546866 +0000 UTC m=+314.701439165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815") : secret "alertmanager-main-tls" not found Jul 19 16:43:18.548003 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.547783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.548003 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.547927 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.549388 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.549331 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-web-config\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.550201 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.550174 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.550600 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.550564 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.551022 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.551002 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.551196 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.551172 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-config-out\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.551376 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.551356 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.552023 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.551742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.552687 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.552652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.556295 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.556223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdh4m\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-kube-api-access-zdh4m\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:18.818149 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.818073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" event={"ID":"34fd31a6-c6fc-4c06-a803-15308dde199d","Type":"ContainerStarted","Data":"4c23350881888e7802ea79220c22fe340b9a96fa5e052cd2778d2e3e3b96d414"} Jul 19 16:43:18.818149 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.818147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" event={"ID":"34fd31a6-c6fc-4c06-a803-15308dde199d","Type":"ContainerStarted","Data":"556f7e886e47effe99808422dee6124f23128ef3c477dc4495338a40b277b5b6"} Jul 19 16:43:18.818347 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.818176 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" event={"ID":"34fd31a6-c6fc-4c06-a803-15308dde199d","Type":"ContainerStarted","Data":"10585ff6117ec696b521de755a76318a5f5820beaec5f17c87043080e41a01ec"} Jul 19 16:43:18.819549 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:18.819522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgtz2" event={"ID":"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19","Type":"ContainerStarted","Data":"5bceb4bf408a60f64775f252cd7a13c5a77bc304d21d85985bc00739027e25c6"} Jul 19 16:43:19.050018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:19.049984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:19.052336 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:19.052314 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:19.247179 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:19.247107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:43:19.399734 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:19.399708 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:43:19.400534 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:19.400511 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb53823d_cc13_421c_b452_e2fbee64d815.slice/crio-a366b82ede1dc958ce168db9cd37a17401b3f4b229552cd99a808f86b79972de WatchSource:0}: Error finding container a366b82ede1dc958ce168db9cd37a17401b3f4b229552cd99a808f86b79972de: Status 404 returned error can't find the container with id a366b82ede1dc958ce168db9cd37a17401b3f4b229552cd99a808f86b79972de Jul 19 16:43:19.826303 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:19.826271 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"a366b82ede1dc958ce168db9cd37a17401b3f4b229552cd99a808f86b79972de"} Jul 19 16:43:20.669584 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:20.669460 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b6b6648-96dpt"] Jul 19 16:43:20.832348 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:20.832306 2563 generic.go:356] "Generic (PLEG): container finished" podID="4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19" containerID="c149c26b46ce07be85955c0bf1def0f5ae1c38aef285efbb2e96773ca30bd24a" exitCode=0 Jul 19 16:43:20.832649 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:20.832624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgtz2" event={"ID":"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19","Type":"ContainerDied","Data":"c149c26b46ce07be85955c0bf1def0f5ae1c38aef285efbb2e96773ca30bd24a"} Jul 19 16:43:21.839486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.839457 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6" exitCode=0 Jul 19 16:43:21.839948 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.839551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6"} Jul 19 16:43:21.841723 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.841698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" event={"ID":"34fd31a6-c6fc-4c06-a803-15308dde199d","Type":"ContainerStarted","Data":"49974631aa9ec01d37abb9660266d0c49698f9caebc138e378c0a9e61200cf3d"} Jul 19 16:43:21.843752 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.843735 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgtz2" event={"ID":"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19","Type":"ContainerStarted","Data":"9027a26dd977ad739d8107bd1919c9f3cfe4218288a510354eb92e73d5e11046"} Jul 19 16:43:21.843830 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.843771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgtz2" event={"ID":"4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19","Type":"ContainerStarted","Data":"fd5e0a40f041ca691680be4bb9ccd8b4e348c457c913a0a0fe0cae6f811656b0"} Jul 19 16:43:21.879611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.879575 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rgtz2" podStartSLOduration=3.447188676 podStartE2EDuration="4.879563491s" totalImagesPullingTime="1.35874098s" totalInitContainerRuntime="73.633835ms" isStatefulPod=true podCreationTimestamp="2026-07-19 16:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:21.878997602 +0000 UTC m=+317.532889946" watchObservedRunningTime="2026-07-19 16:43:21.879563491 +0000 UTC m=+317.533455802" Jul 19 16:43:21.894813 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:21.894777 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fm7n5" podStartSLOduration=2.444277874 podStartE2EDuration="4.894765493s" totalImagesPullingTime="2.450487619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:21.894379238 +0000 UTC m=+317.548271532" watchObservedRunningTime="2026-07-19 16:43:21.894765493 +0000 UTC m=+317.548657805" Jul 19 16:43:22.040910 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.040868 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2"] Jul 19 16:43:22.075730 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.075707 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2"] Jul 19 16:43:22.075904 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.075801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.078355 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.078334 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 19 16:43:22.078576 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.078562 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b5jrt\"" Jul 19 16:43:22.143042 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.143020 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:22.190280 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.190259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5vpz\" (UniqueName: \"kubernetes.io/projected/abd8e0b1-615c-46d6-810d-e53f9f9cab72-kube-api-access-l5vpz\") pod \"monitoring-plugin-7b7b7bc8bf-gttd2\" (UID: \"abd8e0b1-615c-46d6-810d-e53f9f9cab72\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.190349 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.190288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/abd8e0b1-615c-46d6-810d-e53f9f9cab72-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gttd2\" (UID: \"abd8e0b1-615c-46d6-810d-e53f9f9cab72\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.291287 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.291258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5vpz\" (UniqueName: \"kubernetes.io/projected/abd8e0b1-615c-46d6-810d-e53f9f9cab72-kube-api-access-l5vpz\") pod \"monitoring-plugin-7b7b7bc8bf-gttd2\" (UID: \"abd8e0b1-615c-46d6-810d-e53f9f9cab72\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.291399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.291301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/abd8e0b1-615c-46d6-810d-e53f9f9cab72-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gttd2\" (UID: \"abd8e0b1-615c-46d6-810d-e53f9f9cab72\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.293506 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.293485 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/abd8e0b1-615c-46d6-810d-e53f9f9cab72-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gttd2\" (UID: \"abd8e0b1-615c-46d6-810d-e53f9f9cab72\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.299110 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.299081 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5vpz\" (UniqueName: \"kubernetes.io/projected/abd8e0b1-615c-46d6-810d-e53f9f9cab72-kube-api-access-l5vpz\") pod \"monitoring-plugin-7b7b7bc8bf-gttd2\" (UID: \"abd8e0b1-615c-46d6-810d-e53f9f9cab72\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.386047 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.385972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:22.536019 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.535997 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2"] Jul 19 16:43:22.537715 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:22.537696 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd8e0b1_615c_46d6_810d_e53f9f9cab72.slice/crio-4e022c383341e19de532d8deea03a975d5961bc0a4c45b7c3cd2d1acb7ceb556 WatchSource:0}: Error finding container 4e022c383341e19de532d8deea03a975d5961bc0a4c45b7c3cd2d1acb7ceb556: Status 404 returned error can't find the container with id 4e022c383341e19de532d8deea03a975d5961bc0a4c45b7c3cd2d1acb7ceb556 Jul 19 16:43:22.849114 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:22.849074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" event={"ID":"abd8e0b1-615c-46d6-810d-e53f9f9cab72","Type":"ContainerStarted","Data":"4e022c383341e19de532d8deea03a975d5961bc0a4c45b7c3cd2d1acb7ceb556"} Jul 19 16:43:23.124911 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.124824 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dfbc789c4-mwlsg"] Jul 19 16:43:23.147763 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.147735 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dfbc789c4-mwlsg"] Jul 19 16:43:23.147941 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.147841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.157746 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.157679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 19 16:43:23.198840 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.198810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-oauth-serving-cert\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.198981 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.198854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-service-ca\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.198981 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.198907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-serving-cert\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.198981 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.198966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-console-config\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.199132 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.199003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/e544f411-46a5-40d9-b630-10bf42930a94-kube-api-access-vcwnj\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.199132 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.199035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-trusted-ca-bundle\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.199132 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.199081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-oauth-config\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300115 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-serving-cert\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-console-config\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/e544f411-46a5-40d9-b630-10bf42930a94-kube-api-access-vcwnj\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-trusted-ca-bundle\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-oauth-config\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-oauth-serving-cert\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.300498 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.300267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-service-ca\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.301042 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.301016 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-service-ca\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.301131 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.301073 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-console-config\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.301131 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.301109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-oauth-serving-cert\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.301202 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.301176 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-trusted-ca-bundle\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.302675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.302651 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-serving-cert\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.302762 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.302653 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-oauth-config\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.307522 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.307503 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/e544f411-46a5-40d9-b630-10bf42930a94-kube-api-access-vcwnj\") pod \"console-dfbc789c4-mwlsg\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.460602 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.460508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:23.886832 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:23.886809 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dfbc789c4-mwlsg"] Jul 19 16:43:23.888732 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:43:23.888707 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode544f411_46a5_40d9_b630_10bf42930a94.slice/crio-ba9314cc2acf53c4cb8b299e7a9f2d6e386efd82d2be5df8dcc48243506d457d WatchSource:0}: Error finding container ba9314cc2acf53c4cb8b299e7a9f2d6e386efd82d2be5df8dcc48243506d457d: Status 404 returned error can't find the container with id ba9314cc2acf53c4cb8b299e7a9f2d6e386efd82d2be5df8dcc48243506d457d Jul 19 16:43:24.859704 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:24.859647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191"} Jul 19 16:43:24.859795 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:24.859708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4"} Jul 19 16:43:24.861037 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:24.861010 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfbc789c4-mwlsg" event={"ID":"e544f411-46a5-40d9-b630-10bf42930a94","Type":"ContainerStarted","Data":"ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4"} Jul 19 16:43:24.861127 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:24.861050 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfbc789c4-mwlsg" event={"ID":"e544f411-46a5-40d9-b630-10bf42930a94","Type":"ContainerStarted","Data":"ba9314cc2acf53c4cb8b299e7a9f2d6e386efd82d2be5df8dcc48243506d457d"} Jul 19 16:43:24.877471 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:24.877432 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dfbc789c4-mwlsg" podStartSLOduration=1.877418078 podStartE2EDuration="1.877418078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:24.875788604 +0000 UTC m=+320.529680917" watchObservedRunningTime="2026-07-19 16:43:24.877418078 +0000 UTC m=+320.531310389" Jul 19 16:43:25.866267 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.866225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" event={"ID":"abd8e0b1-615c-46d6-810d-e53f9f9cab72","Type":"ContainerStarted","Data":"254aa27417776804b2010ef21ba2c58456fd0cb848c4e0e7e954af7562ad9551"} Jul 19 16:43:25.866695 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.866290 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:25.869446 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.869419 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6"} Jul 19 16:43:25.869562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.869481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db"} Jul 19 16:43:25.869562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.869524 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b"} Jul 19 16:43:25.871706 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.871686 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" Jul 19 16:43:25.880427 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:25.880393 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gttd2" podStartSLOduration=1.423964244 podStartE2EDuration="3.880381907s" totalImagesPullingTime="2.456417663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:25.879753022 +0000 UTC m=+321.533645366" watchObservedRunningTime="2026-07-19 16:43:25.880381907 +0000 UTC m=+321.534274217" Jul 19 16:43:26.875457 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:26.875428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerStarted","Data":"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784"} Jul 19 16:43:26.902214 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:26.902171 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.309802178 podStartE2EDuration="8.902157176s" totalImagesPullingTime="5.567080036s" totalInitContainerRuntime="25.274962ms" isStatefulPod=false podCreationTimestamp="2026-07-19 16:43:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:43:26.899720312 +0000 UTC m=+322.553612635" watchObservedRunningTime="2026-07-19 16:43:26.902157176 +0000 UTC m=+322.556049488" Jul 19 16:43:33.461395 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:33.461364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:33.461853 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:33.461416 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:33.466039 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:33.466021 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:33.907134 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:33.907109 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:43:37.622990 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.622955 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c998886bb-brtw9" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" containerName="registry" containerID="cri-o://3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d" gracePeriod=30 Jul 19 16:43:37.854398 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.854367 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:43:37.920771 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.920716 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb4dbf62-62fe-4af9-9845-aabedfef8399" containerID="3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d" exitCode=0 Jul 19 16:43:37.920771 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.920755 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c998886bb-brtw9" Jul 19 16:43:37.920920 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.920798 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c998886bb-brtw9" event={"ID":"eb4dbf62-62fe-4af9-9845-aabedfef8399","Type":"ContainerDied","Data":"3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d"} Jul 19 16:43:37.920920 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.920844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c998886bb-brtw9" event={"ID":"eb4dbf62-62fe-4af9-9845-aabedfef8399","Type":"ContainerDied","Data":"de7aba742389eaa3d5a69571938030c388058d743a65ddc47682f8578bf9ff31"} Jul 19 16:43:37.920920 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.920866 2563 scope.go:117] "RemoveContainer" containerID="3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d" Jul 19 16:43:37.928396 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.928380 2563 scope.go:117] "RemoveContainer" containerID="3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d" Jul 19 16:43:37.928653 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:43:37.928634 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d\": container with ID starting with 3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d not found: ID does not exist" containerID="3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d" Jul 19 16:43:37.928713 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:37.928663 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d"} err="failed to get container status \"3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d\": rpc error: code = NotFound desc = could not find container \"3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d\": container with ID starting with 3b97397d590ae812b5bee9fe3f086701dd69f7aaea909d08a1febbca7df1821d not found: ID does not exist" Jul 19 16:43:38.011731 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.011702 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-image-registry-private-configuration\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.011810 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.011740 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt8j4\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-kube-api-access-zt8j4\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.011810 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.011758 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-installation-pull-secrets\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.011922 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.011901 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-certificates\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.011983 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.011946 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-trusted-ca\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.012033 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012009 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.012194 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012175 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb4dbf62-62fe-4af9-9845-aabedfef8399-ca-trust-extracted\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.012265 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012209 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-bound-sa-token\") pod \"eb4dbf62-62fe-4af9-9845-aabedfef8399\" (UID: \"eb4dbf62-62fe-4af9-9845-aabedfef8399\") " Jul 19 16:43:38.012317 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012276 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:43:38.012615 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012373 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:43:38.012615 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012573 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-certificates\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.012615 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.012593 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb4dbf62-62fe-4af9-9845-aabedfef8399-trusted-ca\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.014309 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.014266 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:43:38.014415 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.014376 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:43:38.014415 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.014402 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:43:38.014526 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.014380 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-kube-api-access-zt8j4" (OuterVolumeSpecName: "kube-api-access-zt8j4") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "kube-api-access-zt8j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:43:38.014757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.014730 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:43:38.020359 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.020338 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb4dbf62-62fe-4af9-9845-aabedfef8399-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eb4dbf62-62fe-4af9-9845-aabedfef8399" (UID: "eb4dbf62-62fe-4af9-9845-aabedfef8399"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:43:38.113543 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.113521 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-registry-tls\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.113543 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.113542 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb4dbf62-62fe-4af9-9845-aabedfef8399-ca-trust-extracted\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.113648 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.113552 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-bound-sa-token\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.113648 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.113561 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-image-registry-private-configuration\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.113648 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.113569 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt8j4\" (UniqueName: \"kubernetes.io/projected/eb4dbf62-62fe-4af9-9845-aabedfef8399-kube-api-access-zt8j4\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.113648 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.113578 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb4dbf62-62fe-4af9-9845-aabedfef8399-installation-pull-secrets\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:38.241019 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.240996 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c998886bb-brtw9"] Jul 19 16:43:38.244409 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.244392 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c998886bb-brtw9"] Jul 19 16:43:38.835770 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:38.835745 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" path="/var/lib/kubelet/pods/eb4dbf62-62fe-4af9-9845-aabedfef8399/volumes" Jul 19 16:43:45.694857 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:45.694820 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85b6b6648-96dpt" podUID="9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" containerName="console" containerID="cri-o://c63f6d641f5e0a932f4a25255195b60ae78603babc659e417e215c899410fca2" gracePeriod=15 Jul 19 16:43:45.950312 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:45.950250 2563 generic.go:356] "Generic (PLEG): container finished" podID="9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" containerID="c63f6d641f5e0a932f4a25255195b60ae78603babc659e417e215c899410fca2" exitCode=0 Jul 19 16:43:45.950442 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:45.950317 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b6b6648-96dpt" event={"ID":"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc","Type":"ContainerDied","Data":"c63f6d641f5e0a932f4a25255195b60ae78603babc659e417e215c899410fca2"} Jul 19 16:43:45.950442 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:45.950365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b6b6648-96dpt" event={"ID":"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc","Type":"ContainerDied","Data":"bab959bb79c7482fccd6ddd51afe98b0dc6100e616e527da141f8d204d8bb2d9"} Jul 19 16:43:45.950442 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:45.950381 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bab959bb79c7482fccd6ddd51afe98b0dc6100e616e527da141f8d204d8bb2d9" Jul 19 16:43:45.967979 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:45.967960 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:46.074626 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.074603 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-config\") pod \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " Jul 19 16:43:46.074724 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.074662 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-serving-cert\") pod \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " Jul 19 16:43:46.074724 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.074692 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-oauth-config\") pod \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " Jul 19 16:43:46.074724 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.074720 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvhkx\" (UniqueName: \"kubernetes.io/projected/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-kube-api-access-xvhkx\") pod \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " Jul 19 16:43:46.074825 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.074742 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-oauth-serving-cert\") pod \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " Jul 19 16:43:46.074825 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.074759 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-service-ca\") pod \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\" (UID: \"9c26f4e6-d3ae-4134-a9e0-c9d904c875bc\") " Jul 19 16:43:46.075121 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.075092 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-config" (OuterVolumeSpecName: "console-config") pod "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" (UID: "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:43:46.075216 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.075160 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" (UID: "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:43:46.075267 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.075210 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" (UID: "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:43:46.076816 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.076796 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" (UID: "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:43:46.076876 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.076829 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" (UID: "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:43:46.076931 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.076874 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-kube-api-access-xvhkx" (OuterVolumeSpecName: "kube-api-access-xvhkx") pod "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" (UID: "9c26f4e6-d3ae-4134-a9e0-c9d904c875bc"). InnerVolumeSpecName "kube-api-access-xvhkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:43:46.175449 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.175425 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-oauth-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:46.175449 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.175447 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvhkx\" (UniqueName: \"kubernetes.io/projected/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-kube-api-access-xvhkx\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:46.175562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.175457 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-oauth-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:46.175562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.175467 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-service-ca\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:46.175562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.175475 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:46.175562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.175483 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc-console-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:43:46.953510 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.953488 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b6b6648-96dpt" Jul 19 16:43:46.968706 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.968684 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b6b6648-96dpt"] Jul 19 16:43:46.974322 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:46.974301 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85b6b6648-96dpt"] Jul 19 16:43:48.831054 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:48.831028 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" path="/var/lib/kubelet/pods/9c26f4e6-d3ae-4134-a9e0-c9d904c875bc/volumes" Jul 19 16:43:58.996041 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:58.995986 2563 generic.go:356] "Generic (PLEG): container finished" podID="c6f99975-9b7b-430d-bc70-d430b47e89cc" containerID="beae430e87df90901dba9c899ea05338786a757ea52728667bc9d8cc874aa2de" exitCode=0 Jul 19 16:43:58.996429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:58.996065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" event={"ID":"c6f99975-9b7b-430d-bc70-d430b47e89cc","Type":"ContainerDied","Data":"beae430e87df90901dba9c899ea05338786a757ea52728667bc9d8cc874aa2de"} Jul 19 16:43:58.996429 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:43:58.996367 2563 scope.go:117] "RemoveContainer" containerID="beae430e87df90901dba9c899ea05338786a757ea52728667bc9d8cc874aa2de" Jul 19 16:44:00.001546 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:00.001512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v5b8m" event={"ID":"c6f99975-9b7b-430d-bc70-d430b47e89cc","Type":"ContainerStarted","Data":"7c14e49d9766f03466622a543a9dca34aa1d2867e1570c05e7a84cc9e93ec94e"} Jul 19 16:44:00.002970 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:00.002952 2563 generic.go:356] "Generic (PLEG): container finished" podID="1173fe4d-4615-4e77-b0e8-65616a480cfd" containerID="6dc358e901ff7902f93e053c50861d3ffe43d7d256c503e4087a6fc27a6fe1e1" exitCode=0 Jul 19 16:44:00.003051 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:00.002996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" event={"ID":"1173fe4d-4615-4e77-b0e8-65616a480cfd","Type":"ContainerDied","Data":"6dc358e901ff7902f93e053c50861d3ffe43d7d256c503e4087a6fc27a6fe1e1"} Jul 19 16:44:00.003202 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:00.003191 2563 scope.go:117] "RemoveContainer" containerID="6dc358e901ff7902f93e053c50861d3ffe43d7d256c503e4087a6fc27a6fe1e1" Jul 19 16:44:01.009226 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:01.009193 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2lm2q" event={"ID":"1173fe4d-4615-4e77-b0e8-65616a480cfd","Type":"ContainerStarted","Data":"5dbe033b2cb60f38091bc07654b0521dff8b13a4dfae2f253c4e173dd2083339"} Jul 19 16:44:17.790064 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:17.790021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:44:17.792168 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:17.792149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7137a64a-214b-414e-8b44-ac2dd29b37ed-metrics-certs\") pod \"network-metrics-daemon-x6wk4\" (UID: \"7137a64a-214b-414e-8b44-ac2dd29b37ed\") " pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:44:17.929355 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:17.929335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhnw\"" Jul 19 16:44:17.937243 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:17.937219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6wk4" Jul 19 16:44:18.056651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:18.056572 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x6wk4"] Jul 19 16:44:18.059090 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:44:18.059058 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7137a64a_214b_414e_8b44_ac2dd29b37ed.slice/crio-570f1394ca88b33450548514d9b5e0a73f5e6e6d7a928e402fe40b8fdd49543f WatchSource:0}: Error finding container 570f1394ca88b33450548514d9b5e0a73f5e6e6d7a928e402fe40b8fdd49543f: Status 404 returned error can't find the container with id 570f1394ca88b33450548514d9b5e0a73f5e6e6d7a928e402fe40b8fdd49543f Jul 19 16:44:18.069477 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:18.069453 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x6wk4" event={"ID":"7137a64a-214b-414e-8b44-ac2dd29b37ed","Type":"ContainerStarted","Data":"570f1394ca88b33450548514d9b5e0a73f5e6e6d7a928e402fe40b8fdd49543f"} Jul 19 16:44:20.078769 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:20.078732 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x6wk4" event={"ID":"7137a64a-214b-414e-8b44-ac2dd29b37ed","Type":"ContainerStarted","Data":"0d7424dbab62219eba8562c6b075bc4826419114f56e141e9226865221024e6e"} Jul 19 16:44:20.079592 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:20.078812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x6wk4" event={"ID":"7137a64a-214b-414e-8b44-ac2dd29b37ed","Type":"ContainerStarted","Data":"c0f984705f56982e9da047d55ff0fef63435be5fb68411e7ec11e0a651b48527"} Jul 19 16:44:20.094747 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:20.094699 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x6wk4" podStartSLOduration=375.109955414 podStartE2EDuration="6m16.094686189s" totalImagesPullingTime="984.730775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:44:20.093664841 +0000 UTC m=+375.747557154" watchObservedRunningTime="2026-07-19 16:44:20.094686189 +0000 UTC m=+375.748578500" Jul 19 16:44:37.498385 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498352 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:44:37.498810 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498711 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="alertmanager" containerID="cri-o://ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4" gracePeriod=120 Jul 19 16:44:37.498810 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498769 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-metric" containerID="cri-o://339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6" gracePeriod=120 Jul 19 16:44:37.498964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498824 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy" containerID="cri-o://6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db" gracePeriod=120 Jul 19 16:44:37.498964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498848 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="config-reloader" containerID="cri-o://9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191" gracePeriod=120 Jul 19 16:44:37.498964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498830 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-web" containerID="cri-o://2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b" gracePeriod=120 Jul 19 16:44:37.498964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:37.498793 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="prom-label-proxy" containerID="cri-o://807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784" gracePeriod=120 Jul 19 16:44:38.147157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147127 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784" exitCode=0 Jul 19 16:44:38.147157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147153 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db" exitCode=0 Jul 19 16:44:38.147157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147159 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191" exitCode=0 Jul 19 16:44:38.147333 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147165 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4" exitCode=0 Jul 19 16:44:38.147333 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147197 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784"} Jul 19 16:44:38.147333 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db"} Jul 19 16:44:38.147333 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191"} Jul 19 16:44:38.147333 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.147308 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4"} Jul 19 16:44:38.755728 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.755707 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:38.836175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836116 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-web\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836151 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdh4m\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-kube-api-access-zdh4m\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836170 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-metrics-client-ca\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836192 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836212 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-metric\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836255 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-config-out\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836271 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-trusted-ca-bundle\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836288 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-tls-assets\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836308 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-cluster-tls-config\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836342 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836394 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836374 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-web-config\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836735 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836405 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-config-volume\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.836735 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.836434 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-main-db\") pod \"eb53823d-cc13-421c-b452-e2fbee64d815\" (UID: \"eb53823d-cc13-421c-b452-e2fbee64d815\") " Jul 19 16:44:38.837169 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.837082 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:44:38.837400 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.837371 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:44:38.837494 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.837467 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:44:38.838851 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.838815 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-kube-api-access-zdh4m" (OuterVolumeSpecName: "kube-api-access-zdh4m") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "kube-api-access-zdh4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:44:38.839251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.839212 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.839346 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.839300 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-config-out" (OuterVolumeSpecName: "config-out") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:44:38.839555 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.839532 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.840170 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.840136 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.840252 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.840179 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-config-volume" (OuterVolumeSpecName: "config-volume") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.841009 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.840983 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:44:38.841098 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.841062 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.843319 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.843296 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.849609 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.849589 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-web-config" (OuterVolumeSpecName: "web-config") pod "eb53823d-cc13-421c-b452-e2fbee64d815" (UID: "eb53823d-cc13-421c-b452-e2fbee64d815"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:44:38.937076 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937053 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937076 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937072 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdh4m\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-kube-api-access-zdh4m\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937082 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-metrics-client-ca\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937090 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937099 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937108 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-config-out\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937115 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937123 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb53823d-cc13-421c-b452-e2fbee64d815-tls-assets\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937131 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-cluster-tls-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937139 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-secret-alertmanager-main-tls\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937148 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-web-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937161 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb53823d-cc13-421c-b452-e2fbee64d815-config-volume\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:38.937208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:38.937172 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb53823d-cc13-421c-b452-e2fbee64d815-alertmanager-main-db\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:44:39.153321 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153271 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6" exitCode=0 Jul 19 16:44:39.153321 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153296 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb53823d-cc13-421c-b452-e2fbee64d815" containerID="2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b" exitCode=0 Jul 19 16:44:39.153444 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6"} Jul 19 16:44:39.153444 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153353 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.153444 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b"} Jul 19 16:44:39.153571 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb53823d-cc13-421c-b452-e2fbee64d815","Type":"ContainerDied","Data":"a366b82ede1dc958ce168db9cd37a17401b3f4b229552cd99a808f86b79972de"} Jul 19 16:44:39.153571 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.153487 2563 scope.go:117] "RemoveContainer" containerID="807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784" Jul 19 16:44:39.160757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.160708 2563 scope.go:117] "RemoveContainer" containerID="339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6" Jul 19 16:44:39.167401 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.167384 2563 scope.go:117] "RemoveContainer" containerID="6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db" Jul 19 16:44:39.174095 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.174075 2563 scope.go:117] "RemoveContainer" containerID="2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b" Jul 19 16:44:39.174711 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.174689 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:44:39.180405 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.180383 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:44:39.181557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.181544 2563 scope.go:117] "RemoveContainer" containerID="9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191" Jul 19 16:44:39.187738 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.187713 2563 scope.go:117] "RemoveContainer" containerID="ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4" Jul 19 16:44:39.194178 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.194157 2563 scope.go:117] "RemoveContainer" containerID="365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6" Jul 19 16:44:39.200326 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.200310 2563 scope.go:117] "RemoveContainer" containerID="807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784" Jul 19 16:44:39.200563 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.200544 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784\": container with ID starting with 807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784 not found: ID does not exist" containerID="807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784" Jul 19 16:44:39.200628 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.200573 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784"} err="failed to get container status \"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784\": rpc error: code = NotFound desc = could not find container \"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784\": container with ID starting with 807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784 not found: ID does not exist" Jul 19 16:44:39.200628 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.200594 2563 scope.go:117] "RemoveContainer" containerID="339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6" Jul 19 16:44:39.200915 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.200893 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6\": container with ID starting with 339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6 not found: ID does not exist" containerID="339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6" Jul 19 16:44:39.201021 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.200923 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6"} err="failed to get container status \"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6\": rpc error: code = NotFound desc = could not find container \"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6\": container with ID starting with 339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6 not found: ID does not exist" Jul 19 16:44:39.201021 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.200943 2563 scope.go:117] "RemoveContainer" containerID="6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db" Jul 19 16:44:39.201264 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.201237 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db\": container with ID starting with 6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db not found: ID does not exist" containerID="6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db" Jul 19 16:44:39.201347 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.201283 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db"} err="failed to get container status \"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db\": rpc error: code = NotFound desc = could not find container \"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db\": container with ID starting with 6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db not found: ID does not exist" Jul 19 16:44:39.201347 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.201304 2563 scope.go:117] "RemoveContainer" containerID="2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b" Jul 19 16:44:39.201642 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.201572 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b\": container with ID starting with 2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b not found: ID does not exist" containerID="2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b" Jul 19 16:44:39.201642 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.201598 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b"} err="failed to get container status \"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b\": rpc error: code = NotFound desc = could not find container \"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b\": container with ID starting with 2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b not found: ID does not exist" Jul 19 16:44:39.201642 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.201621 2563 scope.go:117] "RemoveContainer" containerID="9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191" Jul 19 16:44:39.201910 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.201876 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191\": container with ID starting with 9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191 not found: ID does not exist" containerID="9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191" Jul 19 16:44:39.201948 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.201917 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191"} err="failed to get container status \"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191\": rpc error: code = NotFound desc = could not find container \"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191\": container with ID starting with 9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191 not found: ID does not exist" Jul 19 16:44:39.201948 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.201938 2563 scope.go:117] "RemoveContainer" containerID="ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4" Jul 19 16:44:39.202156 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.202140 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4\": container with ID starting with ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4 not found: ID does not exist" containerID="ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4" Jul 19 16:44:39.202207 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202158 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4"} err="failed to get container status \"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4\": rpc error: code = NotFound desc = could not find container \"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4\": container with ID starting with ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4 not found: ID does not exist" Jul 19 16:44:39.202207 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202171 2563 scope.go:117] "RemoveContainer" containerID="365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6" Jul 19 16:44:39.202427 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:44:39.202409 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6\": container with ID starting with 365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6 not found: ID does not exist" containerID="365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6" Jul 19 16:44:39.202491 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202433 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6"} err="failed to get container status \"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6\": rpc error: code = NotFound desc = could not find container \"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6\": container with ID starting with 365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6 not found: ID does not exist" Jul 19 16:44:39.202491 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202454 2563 scope.go:117] "RemoveContainer" containerID="807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784" Jul 19 16:44:39.202678 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202661 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:44:39.202735 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202671 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784"} err="failed to get container status \"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784\": rpc error: code = NotFound desc = could not find container \"807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784\": container with ID starting with 807558b0e9698acbae28d60a941a1ff578415a3f3ec93d58d251a48149cb9784 not found: ID does not exist" Jul 19 16:44:39.202735 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202689 2563 scope.go:117] "RemoveContainer" containerID="339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6" Jul 19 16:44:39.202938 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202915 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6"} err="failed to get container status \"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6\": rpc error: code = NotFound desc = could not find container \"339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6\": container with ID starting with 339f80081ac90d18001304fd58542ed95de6bf83e6e6dbd55fe551615ed08dd6 not found: ID does not exist" Jul 19 16:44:39.202987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202937 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="alertmanager" Jul 19 16:44:39.202987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202949 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="alertmanager" Jul 19 16:44:39.202987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202957 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="prom-label-proxy" Jul 19 16:44:39.202987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202963 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="prom-label-proxy" Jul 19 16:44:39.202987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202975 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy" Jul 19 16:44:39.202987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202981 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202991 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-metric" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202996 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-metric" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203003 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="init-config-reloader" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203009 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="init-config-reloader" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203014 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="config-reloader" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203020 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="config-reloader" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203024 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" containerName="registry" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203029 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" containerName="registry" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203034 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" containerName="console" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203039 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" containerName="console" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203048 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-web" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203054 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-web" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.202940 2563 scope.go:117] "RemoveContainer" containerID="6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203098 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-web" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203105 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="config-reloader" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203111 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy-metric" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203117 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c26f4e6-d3ae-4134-a9e0-c9d904c875bc" containerName="console" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203123 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb4dbf62-62fe-4af9-9845-aabedfef8399" containerName="registry" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203129 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="prom-label-proxy" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203136 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="alertmanager" Jul 19 16:44:39.203175 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203141 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" containerName="kube-rbac-proxy" Jul 19 16:44:39.203822 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203238 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db"} err="failed to get container status \"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db\": rpc error: code = NotFound desc = could not find container \"6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db\": container with ID starting with 6b3606c655d30edf7c43f39f1854d91415cd4f302df3ad1a3b658bea0a0dc0db not found: ID does not exist" Jul 19 16:44:39.203822 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203258 2563 scope.go:117] "RemoveContainer" containerID="2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b" Jul 19 16:44:39.203822 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203466 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b"} err="failed to get container status \"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b\": rpc error: code = NotFound desc = could not find container \"2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b\": container with ID starting with 2e377110e3ea4260f6eb2fac9ecb9a529cd544c11e4f8784474d9c04c899488b not found: ID does not exist" Jul 19 16:44:39.203822 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203478 2563 scope.go:117] "RemoveContainer" containerID="9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191" Jul 19 16:44:39.203822 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203692 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191"} err="failed to get container status \"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191\": rpc error: code = NotFound desc = could not find container \"9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191\": container with ID starting with 9205d19ce3d7daed676f40c60dcf35ab3a33335edb86d87833d2743cfc46a191 not found: ID does not exist" Jul 19 16:44:39.204058 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.203860 2563 scope.go:117] "RemoveContainer" containerID="ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4" Jul 19 16:44:39.208399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.208375 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.209395 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.209367 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4"} err="failed to get container status \"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4\": rpc error: code = NotFound desc = could not find container \"ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4\": container with ID starting with ba4febddbb7bcbf8d5228fa6ae55d1464e511708651e65160663e6e3393e40d4 not found: ID does not exist" Jul 19 16:44:39.209491 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.209409 2563 scope.go:117] "RemoveContainer" containerID="365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6" Jul 19 16:44:39.210085 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.210062 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6"} err="failed to get container status \"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6\": rpc error: code = NotFound desc = could not find container \"365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6\": container with ID starting with 365e2db97277b9b2e1fbac20aebc92e13138e3c3546b0e29e567e474019083d6 not found: ID does not exist" Jul 19 16:44:39.211185 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211158 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 19 16:44:39.211275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211241 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 19 16:44:39.211275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211245 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 19 16:44:39.211646 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211621 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 19 16:44:39.211781 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211743 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 19 16:44:39.211912 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211754 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 19 16:44:39.211912 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.211821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 19 16:44:39.212217 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.212201 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 19 16:44:39.212294 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.212252 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w79lk\"" Jul 19 16:44:39.216980 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.216964 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 19 16:44:39.220080 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.220062 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:44:39.240557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30f647eb-179d-4689-b3ab-95c94cc9d227-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f647eb-179d-4689-b3ab-95c94cc9d227-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f647eb-179d-4689-b3ab-95c94cc9d227-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-config-volume\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240787 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f647eb-179d-4689-b3ab-95c94cc9d227-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240787 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-web-config\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240787 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240787 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240787 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240995 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240995 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f647eb-179d-4689-b3ab-95c94cc9d227-config-out\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.240995 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.240828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkxf7\" (UniqueName: \"kubernetes.io/projected/30f647eb-179d-4689-b3ab-95c94cc9d227-kube-api-access-rkxf7\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341709 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341709 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f647eb-179d-4689-b3ab-95c94cc9d227-config-out\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341709 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkxf7\" (UniqueName: \"kubernetes.io/projected/30f647eb-179d-4689-b3ab-95c94cc9d227-kube-api-access-rkxf7\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341811 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30f647eb-179d-4689-b3ab-95c94cc9d227-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341811 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f647eb-179d-4689-b3ab-95c94cc9d227-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.341811 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.341775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f647eb-179d-4689-b3ab-95c94cc9d227-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342081 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-config-volume\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f647eb-179d-4689-b3ab-95c94cc9d227-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30f647eb-179d-4689-b3ab-95c94cc9d227-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342298 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-web-config\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342298 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.342298 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.342214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.343046 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.343020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f647eb-179d-4689-b3ab-95c94cc9d227-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.343138 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.343072 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f647eb-179d-4689-b3ab-95c94cc9d227-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.344315 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.344291 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f647eb-179d-4689-b3ab-95c94cc9d227-config-out\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.344731 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.344708 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.344877 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.344859 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.345092 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.345064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-web-config\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.345184 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.345094 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.345184 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.345167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-config-volume\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.345295 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.345190 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f647eb-179d-4689-b3ab-95c94cc9d227-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.345408 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.345391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.346174 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.346157 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30f647eb-179d-4689-b3ab-95c94cc9d227-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.349680 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.349665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkxf7\" (UniqueName: \"kubernetes.io/projected/30f647eb-179d-4689-b3ab-95c94cc9d227-kube-api-access-rkxf7\") pod \"alertmanager-main-0\" (UID: \"30f647eb-179d-4689-b3ab-95c94cc9d227\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.519528 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.519479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 16:44:39.646378 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:39.646353 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 16:44:39.648751 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:44:39.648722 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f647eb_179d_4689_b3ab_95c94cc9d227.slice/crio-556a9754e3af5596af8ac8ecdc10737b589454a53e7f33e0a02e93586d8a97a2 WatchSource:0}: Error finding container 556a9754e3af5596af8ac8ecdc10737b589454a53e7f33e0a02e93586d8a97a2: Status 404 returned error can't find the container with id 556a9754e3af5596af8ac8ecdc10737b589454a53e7f33e0a02e93586d8a97a2 Jul 19 16:44:40.159043 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:40.159015 2563 generic.go:356] "Generic (PLEG): container finished" podID="30f647eb-179d-4689-b3ab-95c94cc9d227" containerID="5d06138ae153c75836c3f6bba95bab140b6c871d7e73c53d03d06a3c13f06caa" exitCode=0 Jul 19 16:44:40.159368 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:40.159062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerDied","Data":"5d06138ae153c75836c3f6bba95bab140b6c871d7e73c53d03d06a3c13f06caa"} Jul 19 16:44:40.159368 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:40.159112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"556a9754e3af5596af8ac8ecdc10737b589454a53e7f33e0a02e93586d8a97a2"} Jul 19 16:44:40.830964 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:40.830939 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb53823d-cc13-421c-b452-e2fbee64d815" path="/var/lib/kubelet/pods/eb53823d-cc13-421c-b452-e2fbee64d815/volumes" Jul 19 16:44:41.166950 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.166892 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"6a667350ca1ab0f6e2381fb2ae5cef124d14a30a0685b477a43ee829acafd7a3"} Jul 19 16:44:41.166950 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.166948 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"81776fb546f6e99e5d228e3a92e3c31fe4e21a733c0805e043fd87990891f728"} Jul 19 16:44:41.167362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.166974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"081ccfca463360d5f4512e4d4b259575ff64b23ef0f4116406c9c13007327412"} Jul 19 16:44:41.167362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.167000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"91c0fef61d772a157f72e1d10bf2ccb8f15d7c9b54d7aead563cd0d6753e773d"} Jul 19 16:44:41.167362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.167021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"6a16d29cf8521b9280f15d48782abd1fff1a0c0f98b3db5e5884b264c9f80480"} Jul 19 16:44:41.167362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.167042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30f647eb-179d-4689-b3ab-95c94cc9d227","Type":"ContainerStarted","Data":"e96c937b4a01b064cdefb0f035a442da69f5f08ff3fb9a863b4fd2b0eda7a223"} Jul 19 16:44:41.193562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.193511 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.178641741 podStartE2EDuration="2.193495056s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.853315ms" isStatefulPod=false podCreationTimestamp="2026-07-19 16:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:44:41.191609512 +0000 UTC m=+396.845501824" watchObservedRunningTime="2026-07-19 16:44:41.193495056 +0000 UTC m=+396.847387368" Jul 19 16:44:41.524721 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.524658 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88"] Jul 19 16:44:41.527405 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.527385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.529757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.529733 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 19 16:44:41.529757 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.529753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 19 16:44:41.530009 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.529822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cdk64\"" Jul 19 16:44:41.530197 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.530167 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 19 16:44:41.530197 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.530187 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 19 16:44:41.530325 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.530167 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 19 16:44:41.539509 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.539123 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 19 16:44:41.542610 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.542588 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88"] Jul 19 16:44:41.557554 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-telemeter-client-tls\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557636 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-serving-certs-ca-bundle\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557636 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557636 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557628 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84lrn\" (UniqueName: \"kubernetes.io/projected/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-kube-api-access-84lrn\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557793 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557793 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-metrics-client-ca\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557793 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-secret-telemeter-client\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.557793 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.557770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-federate-client-tls\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.658786 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-secret-telemeter-client\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.658871 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-federate-client-tls\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.658871 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-telemeter-client-tls\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.658871 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-serving-certs-ca-bundle\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.659146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.659146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84lrn\" (UniqueName: \"kubernetes.io/projected/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-kube-api-access-84lrn\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.659146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.659146 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.658999 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-metrics-client-ca\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.659661 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.659635 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-serving-certs-ca-bundle\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.659734 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.659662 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-metrics-client-ca\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.660130 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.660107 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.661236 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.661216 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.661454 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.661434 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-federate-client-tls\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.661642 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.661628 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-telemeter-client-tls\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.661761 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.661743 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-secret-telemeter-client\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.666220 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.666200 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84lrn\" (UniqueName: \"kubernetes.io/projected/78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e-kube-api-access-84lrn\") pod \"telemeter-client-55b5ff4c6d-vsb88\" (UID: \"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e\") " pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.841892 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.841869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" Jul 19 16:44:41.967186 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:41.967159 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88"] Jul 19 16:44:41.970963 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:44:41.970931 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78005c5b_76ce_4252_9a6d_dd1a3bf3fe6e.slice/crio-19cb1dbd5ae217bf93917bcad59fdfbe31f31eeecdcd5ce4c67aeb5f487e5177 WatchSource:0}: Error finding container 19cb1dbd5ae217bf93917bcad59fdfbe31f31eeecdcd5ce4c67aeb5f487e5177: Status 404 returned error can't find the container with id 19cb1dbd5ae217bf93917bcad59fdfbe31f31eeecdcd5ce4c67aeb5f487e5177 Jul 19 16:44:42.173209 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:42.173139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" event={"ID":"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e","Type":"ContainerStarted","Data":"19cb1dbd5ae217bf93917bcad59fdfbe31f31eeecdcd5ce4c67aeb5f487e5177"} Jul 19 16:44:44.184562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.184491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" event={"ID":"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e","Type":"ContainerStarted","Data":"f05623b180d5652254999b19e2b02c5ac879416aa8e86f8873f0fbc73aac0778"} Jul 19 16:44:44.184562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.184546 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" event={"ID":"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e","Type":"ContainerStarted","Data":"e09aba8d99d2d8bacedf52ba4028e686f64b885a3e31458d0df72f4a1e5a4a15"} Jul 19 16:44:44.185024 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.184578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" event={"ID":"78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e","Type":"ContainerStarted","Data":"01ceb49372dca7aabb98ef5e82d23ee4606e9b224ce09e4dd67895ee03eaaafe"} Jul 19 16:44:44.208189 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.208145 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55b5ff4c6d-vsb88" podStartSLOduration=1.321963008 podStartE2EDuration="3.208129713s" totalImagesPullingTime="1.886166705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:44:44.206148223 +0000 UTC m=+399.860040536" watchObservedRunningTime="2026-07-19 16:44:44.208129713 +0000 UTC m=+399.862022024" Jul 19 16:44:44.924607 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.924572 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7c899dc5-fbj4j"] Jul 19 16:44:44.927109 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.927090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.937320 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.937296 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7c899dc5-fbj4j"] Jul 19 16:44:44.984190 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-config\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.984307 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-oauth-serving-cert\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.984307 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-trusted-ca-bundle\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.984307 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-service-ca\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.984307 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-serving-cert\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.984307 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g772q\" (UniqueName: \"kubernetes.io/projected/b82e6d29-8323-4246-8578-e4d2cbb72d9b-kube-api-access-g772q\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:44.984477 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:44.984321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-oauth-config\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085563 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-oauth-config\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085668 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-config\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085668 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-oauth-serving-cert\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085668 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-trusted-ca-bundle\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085668 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-service-ca\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085856 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-serving-cert\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.085856 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.085700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g772q\" (UniqueName: \"kubernetes.io/projected/b82e6d29-8323-4246-8578-e4d2cbb72d9b-kube-api-access-g772q\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.086506 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.086480 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-service-ca\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.086616 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.086510 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-config\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.086616 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.086572 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-oauth-serving-cert\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.086731 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.086629 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-trusted-ca-bundle\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.087979 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.087954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-serving-cert\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.088084 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.088066 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-oauth-config\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.094029 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.094008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g772q\" (UniqueName: \"kubernetes.io/projected/b82e6d29-8323-4246-8578-e4d2cbb72d9b-kube-api-access-g772q\") pod \"console-d7c899dc5-fbj4j\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.237526 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.237474 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:45.357629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:45.357597 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7c899dc5-fbj4j"] Jul 19 16:44:45.360843 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:44:45.360818 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82e6d29_8323_4246_8578_e4d2cbb72d9b.slice/crio-14a538cf0b41d0bb622a276543ad0ec429fa56804de24b9ddf43ca43cb36eba2 WatchSource:0}: Error finding container 14a538cf0b41d0bb622a276543ad0ec429fa56804de24b9ddf43ca43cb36eba2: Status 404 returned error can't find the container with id 14a538cf0b41d0bb622a276543ad0ec429fa56804de24b9ddf43ca43cb36eba2 Jul 19 16:44:46.196099 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:46.196068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c899dc5-fbj4j" event={"ID":"b82e6d29-8323-4246-8578-e4d2cbb72d9b","Type":"ContainerStarted","Data":"369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b"} Jul 19 16:44:46.196285 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:46.196115 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c899dc5-fbj4j" event={"ID":"b82e6d29-8323-4246-8578-e4d2cbb72d9b","Type":"ContainerStarted","Data":"14a538cf0b41d0bb622a276543ad0ec429fa56804de24b9ddf43ca43cb36eba2"} Jul 19 16:44:46.213770 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:46.213724 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7c899dc5-fbj4j" podStartSLOduration=2.21370891 podStartE2EDuration="2.21370891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:44:46.212361992 +0000 UTC m=+401.866254303" watchObservedRunningTime="2026-07-19 16:44:46.21370891 +0000 UTC m=+401.867601221" Jul 19 16:44:55.238004 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:55.237976 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:55.238517 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:55.238028 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:55.242406 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:55.242375 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:56.240494 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:56.240466 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:44:56.284872 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:44:56.284841 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dfbc789c4-mwlsg"] Jul 19 16:45:21.310962 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.310908 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dfbc789c4-mwlsg" podUID="e544f411-46a5-40d9-b630-10bf42930a94" containerName="console" containerID="cri-o://ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4" gracePeriod=15 Jul 19 16:45:21.550458 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.550434 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:45:21.655221 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655168 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-service-ca\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655221 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655215 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/e544f411-46a5-40d9-b630-10bf42930a94-kube-api-access-vcwnj\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655360 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655254 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-trusted-ca-bundle\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655360 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655284 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-console-config\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655360 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655312 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-serving-cert\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655360 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655338 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-oauth-serving-cert\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655363 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-oauth-config\") pod \"e544f411-46a5-40d9-b630-10bf42930a94\" (UID: \"e544f411-46a5-40d9-b630-10bf42930a94\") " Jul 19 16:45:21.655644 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655498 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-service-ca" (OuterVolumeSpecName: "service-ca") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:45:21.655748 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655683 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-console-config" (OuterVolumeSpecName: "console-config") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:45:21.655748 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655695 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:45:21.655748 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.655729 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:45:21.657303 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.657280 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e544f411-46a5-40d9-b630-10bf42930a94-kube-api-access-vcwnj" (OuterVolumeSpecName: "kube-api-access-vcwnj") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "kube-api-access-vcwnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:45:21.657379 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.657325 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:45:21.657446 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.657426 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e544f411-46a5-40d9-b630-10bf42930a94" (UID: "e544f411-46a5-40d9-b630-10bf42930a94"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:45:21.756562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756542 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-oauth-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:21.756562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756561 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-service-ca\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:21.756672 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756571 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcwnj\" (UniqueName: \"kubernetes.io/projected/e544f411-46a5-40d9-b630-10bf42930a94-kube-api-access-vcwnj\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:21.756672 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756579 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-trusted-ca-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:21.756672 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756587 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-console-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:21.756672 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756597 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e544f411-46a5-40d9-b630-10bf42930a94-console-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:21.756672 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:21.756605 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e544f411-46a5-40d9-b630-10bf42930a94-oauth-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:45:22.345345 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.345317 2563 generic.go:356] "Generic (PLEG): container finished" podID="e544f411-46a5-40d9-b630-10bf42930a94" containerID="ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4" exitCode=0 Jul 19 16:45:22.345675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.345364 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfbc789c4-mwlsg" Jul 19 16:45:22.345675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.345410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfbc789c4-mwlsg" event={"ID":"e544f411-46a5-40d9-b630-10bf42930a94","Type":"ContainerDied","Data":"ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4"} Jul 19 16:45:22.345675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.345457 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfbc789c4-mwlsg" event={"ID":"e544f411-46a5-40d9-b630-10bf42930a94","Type":"ContainerDied","Data":"ba9314cc2acf53c4cb8b299e7a9f2d6e386efd82d2be5df8dcc48243506d457d"} Jul 19 16:45:22.345675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.345479 2563 scope.go:117] "RemoveContainer" containerID="ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4" Jul 19 16:45:22.353525 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.353510 2563 scope.go:117] "RemoveContainer" containerID="ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4" Jul 19 16:45:22.353765 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:45:22.353750 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4\": container with ID starting with ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4 not found: ID does not exist" containerID="ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4" Jul 19 16:45:22.353812 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.353772 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4"} err="failed to get container status \"ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4\": rpc error: code = NotFound desc = could not find container \"ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4\": container with ID starting with ef3ada2af9d3c664901d44c7ae0da45c4639af2fca074495417c79bc301169a4 not found: ID does not exist" Jul 19 16:45:22.364949 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.364922 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dfbc789c4-mwlsg"] Jul 19 16:45:22.366600 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.366576 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dfbc789c4-mwlsg"] Jul 19 16:45:22.831660 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:22.831634 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e544f411-46a5-40d9-b630-10bf42930a94" path="/var/lib/kubelet/pods/e544f411-46a5-40d9-b630-10bf42930a94/volumes" Jul 19 16:45:53.809613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.809581 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cf86c7d8-lk58r"] Jul 19 16:45:53.810079 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.809902 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e544f411-46a5-40d9-b630-10bf42930a94" containerName="console" Jul 19 16:45:53.810079 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.809915 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e544f411-46a5-40d9-b630-10bf42930a94" containerName="console" Jul 19 16:45:53.810079 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.809992 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e544f411-46a5-40d9-b630-10bf42930a94" containerName="console" Jul 19 16:45:53.813259 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.813229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.824440 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.824417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf86c7d8-lk58r"] Jul 19 16:45:53.876433 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-oauth-serving-cert\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.876532 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-serving-cert\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.876532 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdn7f\" (UniqueName: \"kubernetes.io/projected/f76a104c-355b-450a-88c1-bf102fbf2828-kube-api-access-wdn7f\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.876619 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-console-config\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.876655 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-trusted-ca-bundle\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.876689 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-oauth-config\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.876689 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.876678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-service-ca\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977131 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-oauth-serving-cert\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977224 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-serving-cert\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977224 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdn7f\" (UniqueName: \"kubernetes.io/projected/f76a104c-355b-450a-88c1-bf102fbf2828-kube-api-access-wdn7f\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977224 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-console-config\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977224 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-trusted-ca-bundle\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977224 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-oauth-config\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977474 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-service-ca\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977812 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-oauth-serving-cert\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.977951 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977930 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-console-config\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.978024 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.977956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-service-ca\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.978323 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.978300 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-trusted-ca-bundle\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.979547 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.979523 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-oauth-config\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.979631 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.979554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-serving-cert\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:53.985360 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:53.985331 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdn7f\" (UniqueName: \"kubernetes.io/projected/f76a104c-355b-450a-88c1-bf102fbf2828-kube-api-access-wdn7f\") pod \"console-79cf86c7d8-lk58r\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:54.123675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:54.123619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:45:54.245845 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:54.245795 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf86c7d8-lk58r"] Jul 19 16:45:54.248038 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:45:54.248007 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76a104c_355b_450a_88c1_bf102fbf2828.slice/crio-b9afe535ddbb23efe193cfe9accf2b3556bbe63293e9776c64cff9682f81883e WatchSource:0}: Error finding container b9afe535ddbb23efe193cfe9accf2b3556bbe63293e9776c64cff9682f81883e: Status 404 returned error can't find the container with id b9afe535ddbb23efe193cfe9accf2b3556bbe63293e9776c64cff9682f81883e Jul 19 16:45:54.478381 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:54.478309 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf86c7d8-lk58r" event={"ID":"f76a104c-355b-450a-88c1-bf102fbf2828","Type":"ContainerStarted","Data":"ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a"} Jul 19 16:45:54.478381 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:54.478356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf86c7d8-lk58r" event={"ID":"f76a104c-355b-450a-88c1-bf102fbf2828","Type":"ContainerStarted","Data":"b9afe535ddbb23efe193cfe9accf2b3556bbe63293e9776c64cff9682f81883e"} Jul 19 16:45:54.495018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:45:54.494968 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79cf86c7d8-lk58r" podStartSLOduration=1.49494921 podStartE2EDuration="1.49494921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:45:54.494619557 +0000 UTC m=+470.148511884" watchObservedRunningTime="2026-07-19 16:45:54.49494921 +0000 UTC m=+470.148841523" Jul 19 16:46:04.124327 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:04.124288 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:46:04.124741 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:04.124344 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:46:04.128843 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:04.128822 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:46:04.528290 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:04.528223 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:46:04.572163 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:04.572135 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7c899dc5-fbj4j"] Jul 19 16:46:29.598536 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.598500 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d7c899dc5-fbj4j" podUID="b82e6d29-8323-4246-8578-e4d2cbb72d9b" containerName="console" containerID="cri-o://369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b" gracePeriod=15 Jul 19 16:46:29.837894 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.837861 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:46:29.929180 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929122 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-oauth-serving-cert\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929180 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929174 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-serving-cert\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929404 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929223 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-trusted-ca-bundle\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929404 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929246 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g772q\" (UniqueName: \"kubernetes.io/projected/b82e6d29-8323-4246-8578-e4d2cbb72d9b-kube-api-access-g772q\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929404 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929272 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-oauth-config\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929404 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929302 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-config\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929404 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929332 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-service-ca\") pod \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\" (UID: \"b82e6d29-8323-4246-8578-e4d2cbb72d9b\") " Jul 19 16:46:29.929656 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929549 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:46:29.929713 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929694 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:46:29.929765 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929737 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:46:29.929817 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929697 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-config" (OuterVolumeSpecName: "console-config") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:46:29.929867 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929844 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-oauth-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:29.929867 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929861 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-trusted-ca-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:29.929990 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929875 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:29.929990 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.929912 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b82e6d29-8323-4246-8578-e4d2cbb72d9b-service-ca\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:29.936308 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.931818 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:46:29.936308 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.931854 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:46:29.936471 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:29.936365 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82e6d29-8323-4246-8578-e4d2cbb72d9b-kube-api-access-g772q" (OuterVolumeSpecName: "kube-api-access-g772q") pod "b82e6d29-8323-4246-8578-e4d2cbb72d9b" (UID: "b82e6d29-8323-4246-8578-e4d2cbb72d9b"). InnerVolumeSpecName "kube-api-access-g772q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:46:30.030284 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.030255 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g772q\" (UniqueName: \"kubernetes.io/projected/b82e6d29-8323-4246-8578-e4d2cbb72d9b-kube-api-access-g772q\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:30.030284 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.030282 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-oauth-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:30.030284 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.030291 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b82e6d29-8323-4246-8578-e4d2cbb72d9b-console-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:46:30.628637 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.628611 2563 generic.go:356] "Generic (PLEG): container finished" podID="b82e6d29-8323-4246-8578-e4d2cbb72d9b" containerID="369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b" exitCode=0 Jul 19 16:46:30.629018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.628644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c899dc5-fbj4j" event={"ID":"b82e6d29-8323-4246-8578-e4d2cbb72d9b","Type":"ContainerDied","Data":"369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b"} Jul 19 16:46:30.629018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.628667 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c899dc5-fbj4j" Jul 19 16:46:30.629018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.628702 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c899dc5-fbj4j" event={"ID":"b82e6d29-8323-4246-8578-e4d2cbb72d9b","Type":"ContainerDied","Data":"14a538cf0b41d0bb622a276543ad0ec429fa56804de24b9ddf43ca43cb36eba2"} Jul 19 16:46:30.629018 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.628720 2563 scope.go:117] "RemoveContainer" containerID="369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b" Jul 19 16:46:30.637306 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.637292 2563 scope.go:117] "RemoveContainer" containerID="369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b" Jul 19 16:46:30.637537 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:46:30.637517 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b\": container with ID starting with 369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b not found: ID does not exist" containerID="369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b" Jul 19 16:46:30.637595 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.637548 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b"} err="failed to get container status \"369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b\": rpc error: code = NotFound desc = could not find container \"369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b\": container with ID starting with 369a239c3be51d301e7b49ae81955503839a155024919206678d9680a050f09b not found: ID does not exist" Jul 19 16:46:30.647922 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.647898 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7c899dc5-fbj4j"] Jul 19 16:46:30.651592 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.651574 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d7c899dc5-fbj4j"] Jul 19 16:46:30.831972 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:30.831952 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82e6d29-8323-4246-8578-e4d2cbb72d9b" path="/var/lib/kubelet/pods/b82e6d29-8323-4246-8578-e4d2cbb72d9b/volumes" Jul 19 16:46:53.953544 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.953512 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h"] Jul 19 16:46:53.953916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.953810 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82e6d29-8323-4246-8578-e4d2cbb72d9b" containerName="console" Jul 19 16:46:53.953916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.953821 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82e6d29-8323-4246-8578-e4d2cbb72d9b" containerName="console" Jul 19 16:46:53.953916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.953896 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82e6d29-8323-4246-8578-e4d2cbb72d9b" containerName="console" Jul 19 16:46:53.958111 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.958096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:53.960485 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.960468 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnbdt\"" Jul 19 16:46:53.960578 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.960470 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 19 16:46:53.961266 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.961252 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 19 16:46:53.964389 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:53.964366 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h"] Jul 19 16:46:54.086308 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.086285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnvdq\" (UniqueName: \"kubernetes.io/projected/e28b460f-301e-410a-ad48-fdbb9df2f6c9-kube-api-access-pnvdq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.086424 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.086325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.086424 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.086352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.186727 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.186701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnvdq\" (UniqueName: \"kubernetes.io/projected/e28b460f-301e-410a-ad48-fdbb9df2f6c9-kube-api-access-pnvdq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.186837 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.186740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.186837 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.186764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.187117 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.187099 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.187156 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.187130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.194982 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.194963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnvdq\" (UniqueName: \"kubernetes.io/projected/e28b460f-301e-410a-ad48-fdbb9df2f6c9-kube-api-access-pnvdq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.268049 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.268006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:46:54.387259 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.387231 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h"] Jul 19 16:46:54.390281 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:46:54.390253 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28b460f_301e_410a_ad48_fdbb9df2f6c9.slice/crio-5bca786eac657d6bd580fcc2300da98b918f6b6cd244b0a9352344c889072580 WatchSource:0}: Error finding container 5bca786eac657d6bd580fcc2300da98b918f6b6cd244b0a9352344c889072580: Status 404 returned error can't find the container with id 5bca786eac657d6bd580fcc2300da98b918f6b6cd244b0a9352344c889072580 Jul 19 16:46:54.727201 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:46:54.727173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" event={"ID":"e28b460f-301e-410a-ad48-fdbb9df2f6c9","Type":"ContainerStarted","Data":"5bca786eac657d6bd580fcc2300da98b918f6b6cd244b0a9352344c889072580"} Jul 19 16:47:01.761282 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:01.761244 2563 generic.go:356] "Generic (PLEG): container finished" podID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerID="dd3df59fcfd7c95c40b5ba0cefaa0e8a917d26fe5b84f4134944190f742291d0" exitCode=0 Jul 19 16:47:01.761791 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:01.761290 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" event={"ID":"e28b460f-301e-410a-ad48-fdbb9df2f6c9","Type":"ContainerDied","Data":"dd3df59fcfd7c95c40b5ba0cefaa0e8a917d26fe5b84f4134944190f742291d0"} Jul 19 16:47:04.779386 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:04.779352 2563 generic.go:356] "Generic (PLEG): container finished" podID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerID="26e84a65bfaa283f022a3b7d51b3445264a85b75dba061f56245c9914cf069a1" exitCode=0 Jul 19 16:47:04.779713 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:04.779421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" event={"ID":"e28b460f-301e-410a-ad48-fdbb9df2f6c9","Type":"ContainerDied","Data":"26e84a65bfaa283f022a3b7d51b3445264a85b75dba061f56245c9914cf069a1"} Jul 19 16:47:11.815916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:11.815867 2563 generic.go:356] "Generic (PLEG): container finished" podID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerID="c4792c7473ead57c259aa075ce5bd7d951798eebd7aa026af9127b486db6945a" exitCode=0 Jul 19 16:47:11.816211 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:11.815911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" event={"ID":"e28b460f-301e-410a-ad48-fdbb9df2f6c9","Type":"ContainerDied","Data":"c4792c7473ead57c259aa075ce5bd7d951798eebd7aa026af9127b486db6945a"} Jul 19 16:47:12.941162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:12.941139 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:47:13.036610 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.035973 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-bundle\") pod \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " Jul 19 16:47:13.036610 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.036053 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnvdq\" (UniqueName: \"kubernetes.io/projected/e28b460f-301e-410a-ad48-fdbb9df2f6c9-kube-api-access-pnvdq\") pod \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " Jul 19 16:47:13.036610 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.036089 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-util\") pod \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\" (UID: \"e28b460f-301e-410a-ad48-fdbb9df2f6c9\") " Jul 19 16:47:13.041823 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.041791 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-bundle" (OuterVolumeSpecName: "bundle") pod "e28b460f-301e-410a-ad48-fdbb9df2f6c9" (UID: "e28b460f-301e-410a-ad48-fdbb9df2f6c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:47:13.042728 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.042702 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-util" (OuterVolumeSpecName: "util") pod "e28b460f-301e-410a-ad48-fdbb9df2f6c9" (UID: "e28b460f-301e-410a-ad48-fdbb9df2f6c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:47:13.043147 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.043115 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28b460f-301e-410a-ad48-fdbb9df2f6c9-kube-api-access-pnvdq" (OuterVolumeSpecName: "kube-api-access-pnvdq") pod "e28b460f-301e-410a-ad48-fdbb9df2f6c9" (UID: "e28b460f-301e-410a-ad48-fdbb9df2f6c9"). InnerVolumeSpecName "kube-api-access-pnvdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:47:13.137627 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.137578 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnvdq\" (UniqueName: \"kubernetes.io/projected/e28b460f-301e-410a-ad48-fdbb9df2f6c9-kube-api-access-pnvdq\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:13.137627 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.137598 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:13.137627 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.137607 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28b460f-301e-410a-ad48-fdbb9df2f6c9-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:13.825996 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.825966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" event={"ID":"e28b460f-301e-410a-ad48-fdbb9df2f6c9","Type":"ContainerDied","Data":"5bca786eac657d6bd580fcc2300da98b918f6b6cd244b0a9352344c889072580"} Jul 19 16:47:13.826112 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.826003 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bca786eac657d6bd580fcc2300da98b918f6b6cd244b0a9352344c889072580" Jul 19 16:47:13.826112 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:13.826053 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405xq5h" Jul 19 16:47:16.772467 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772436 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9"] Jul 19 16:47:16.772815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772723 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="extract" Jul 19 16:47:16.772815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772733 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="extract" Jul 19 16:47:16.772815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772743 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="pull" Jul 19 16:47:16.772815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772748 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="pull" Jul 19 16:47:16.772815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772757 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="util" Jul 19 16:47:16.772815 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772762 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="util" Jul 19 16:47:16.773019 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.772826 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28b460f-301e-410a-ad48-fdbb9df2f6c9" containerName="extract" Jul 19 16:47:16.801744 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.801723 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9"] Jul 19 16:47:16.801872 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.801800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:16.805694 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.805667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 19 16:47:16.805694 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.805667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:47:16.805869 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.805711 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tw7kj\"" Jul 19 16:47:16.964852 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.964828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b78547-2a8e-4e82-b7e0-5b90c4ebed47-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z88s9\" (UID: \"61b78547-2a8e-4e82-b7e0-5b90c4ebed47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:16.965010 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:16.964871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47ltz\" (UniqueName: \"kubernetes.io/projected/61b78547-2a8e-4e82-b7e0-5b90c4ebed47-kube-api-access-47ltz\") pod \"cert-manager-operator-controller-manager-55c444bf86-z88s9\" (UID: \"61b78547-2a8e-4e82-b7e0-5b90c4ebed47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:17.065199 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.065172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b78547-2a8e-4e82-b7e0-5b90c4ebed47-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z88s9\" (UID: \"61b78547-2a8e-4e82-b7e0-5b90c4ebed47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:17.065316 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.065235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47ltz\" (UniqueName: \"kubernetes.io/projected/61b78547-2a8e-4e82-b7e0-5b90c4ebed47-kube-api-access-47ltz\") pod \"cert-manager-operator-controller-manager-55c444bf86-z88s9\" (UID: \"61b78547-2a8e-4e82-b7e0-5b90c4ebed47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:17.065519 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.065499 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b78547-2a8e-4e82-b7e0-5b90c4ebed47-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z88s9\" (UID: \"61b78547-2a8e-4e82-b7e0-5b90c4ebed47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:17.073557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.073530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47ltz\" (UniqueName: \"kubernetes.io/projected/61b78547-2a8e-4e82-b7e0-5b90c4ebed47-kube-api-access-47ltz\") pod \"cert-manager-operator-controller-manager-55c444bf86-z88s9\" (UID: \"61b78547-2a8e-4e82-b7e0-5b90c4ebed47\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:17.109904 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.109873 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" Jul 19 16:47:17.238597 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.238575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9"] Jul 19 16:47:17.240686 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:47:17.240660 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b78547_2a8e_4e82_b7e0_5b90c4ebed47.slice/crio-c2c0cdcbf4b4c57f97eb790c6bad9bd1839e5303a2fd464a90b76978fcf4484a WatchSource:0}: Error finding container c2c0cdcbf4b4c57f97eb790c6bad9bd1839e5303a2fd464a90b76978fcf4484a: Status 404 returned error can't find the container with id c2c0cdcbf4b4c57f97eb790c6bad9bd1839e5303a2fd464a90b76978fcf4484a Jul 19 16:47:17.848990 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:17.848962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" event={"ID":"61b78547-2a8e-4e82-b7e0-5b90c4ebed47","Type":"ContainerStarted","Data":"c2c0cdcbf4b4c57f97eb790c6bad9bd1839e5303a2fd464a90b76978fcf4484a"} Jul 19 16:47:18.856589 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:18.856545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" event={"ID":"61b78547-2a8e-4e82-b7e0-5b90c4ebed47","Type":"ContainerStarted","Data":"91fd714126f119dc20cc7278167eb92e083891fdd9805752abb28e6420d3d8b5"} Jul 19 16:47:18.883829 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:18.883774 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z88s9" podStartSLOduration=1.354660591 podStartE2EDuration="2.883756332s" totalImagesPullingTime="1.529095741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:47:18.882993547 +0000 UTC m=+554.536885906" watchObservedRunningTime="2026-07-19 16:47:18.883756332 +0000 UTC m=+554.537648645" Jul 19 16:47:20.086282 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.086251 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl"] Jul 19 16:47:20.088540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.088524 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.090991 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.090972 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 19 16:47:20.091103 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.090972 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnbdt\"" Jul 19 16:47:20.091103 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.090972 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 19 16:47:20.097599 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.097568 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl"] Jul 19 16:47:20.193067 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.193042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.193178 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.193083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.193178 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.193104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l759s\" (UniqueName: \"kubernetes.io/projected/52c92fc4-5f07-4cfd-8dce-784614507d06-kube-api-access-l759s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.293925 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.293896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.294033 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.293950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.294033 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.293982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l759s\" (UniqueName: \"kubernetes.io/projected/52c92fc4-5f07-4cfd-8dce-784614507d06-kube-api-access-l759s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.294231 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.294213 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.294299 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.294266 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.302244 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.302221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l759s\" (UniqueName: \"kubernetes.io/projected/52c92fc4-5f07-4cfd-8dce-784614507d06-kube-api-access-l759s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.397140 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.397085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:20.526674 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.526650 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl"] Jul 19 16:47:20.529155 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:47:20.529132 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c92fc4_5f07_4cfd_8dce_784614507d06.slice/crio-0aec13bd114f00e033a0c7512037141cfad77cfafdfd5ce081fdfdf7d6ecc74d WatchSource:0}: Error finding container 0aec13bd114f00e033a0c7512037141cfad77cfafdfd5ce081fdfdf7d6ecc74d: Status 404 returned error can't find the container with id 0aec13bd114f00e033a0c7512037141cfad77cfafdfd5ce081fdfdf7d6ecc74d Jul 19 16:47:20.576665 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.576644 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-274cg"] Jul 19 16:47:20.578721 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.578670 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.581149 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.581127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5vg9z\"" Jul 19 16:47:20.581252 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.581127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 19 16:47:20.581252 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.581127 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 19 16:47:20.587546 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.587525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-274cg"] Jul 19 16:47:20.596849 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.596807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mlt\" (UniqueName: \"kubernetes.io/projected/502e9723-e670-4f54-b7e3-aa934b586d68-kube-api-access-z8mlt\") pod \"cert-manager-webhook-6486ffd997-274cg\" (UID: \"502e9723-e670-4f54-b7e3-aa934b586d68\") " pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.596974 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.596899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/502e9723-e670-4f54-b7e3-aa934b586d68-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-274cg\" (UID: \"502e9723-e670-4f54-b7e3-aa934b586d68\") " pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.698129 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.698074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mlt\" (UniqueName: \"kubernetes.io/projected/502e9723-e670-4f54-b7e3-aa934b586d68-kube-api-access-z8mlt\") pod \"cert-manager-webhook-6486ffd997-274cg\" (UID: \"502e9723-e670-4f54-b7e3-aa934b586d68\") " pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.698129 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.698116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/502e9723-e670-4f54-b7e3-aa934b586d68-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-274cg\" (UID: \"502e9723-e670-4f54-b7e3-aa934b586d68\") " pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.706116 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.706094 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/502e9723-e670-4f54-b7e3-aa934b586d68-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-274cg\" (UID: \"502e9723-e670-4f54-b7e3-aa934b586d68\") " pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.706721 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.706698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mlt\" (UniqueName: \"kubernetes.io/projected/502e9723-e670-4f54-b7e3-aa934b586d68-kube-api-access-z8mlt\") pod \"cert-manager-webhook-6486ffd997-274cg\" (UID: \"502e9723-e670-4f54-b7e3-aa934b586d68\") " pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:20.866497 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.866471 2563 generic.go:356] "Generic (PLEG): container finished" podID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerID="3aeb7c57367f9253410ac78c1360f7a4b35b609c3e27199351d4277b9875c3f1" exitCode=0 Jul 19 16:47:20.866571 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.866540 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" event={"ID":"52c92fc4-5f07-4cfd-8dce-784614507d06","Type":"ContainerDied","Data":"3aeb7c57367f9253410ac78c1360f7a4b35b609c3e27199351d4277b9875c3f1"} Jul 19 16:47:20.866615 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.866580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" event={"ID":"52c92fc4-5f07-4cfd-8dce-784614507d06","Type":"ContainerStarted","Data":"0aec13bd114f00e033a0c7512037141cfad77cfafdfd5ce081fdfdf7d6ecc74d"} Jul 19 16:47:20.896528 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:20.896505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:21.013316 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:21.013288 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-274cg"] Jul 19 16:47:21.016046 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:47:21.016022 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod502e9723_e670_4f54_b7e3_aa934b586d68.slice/crio-4789c56e6e12b48419664869603f0c2df884a012aa6eb75f9319ab262d47d6b5 WatchSource:0}: Error finding container 4789c56e6e12b48419664869603f0c2df884a012aa6eb75f9319ab262d47d6b5: Status 404 returned error can't find the container with id 4789c56e6e12b48419664869603f0c2df884a012aa6eb75f9319ab262d47d6b5 Jul 19 16:47:21.873858 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:21.873817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" event={"ID":"502e9723-e670-4f54-b7e3-aa934b586d68","Type":"ContainerStarted","Data":"4789c56e6e12b48419664869603f0c2df884a012aa6eb75f9319ab262d47d6b5"} Jul 19 16:47:23.884449 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:23.884417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" event={"ID":"502e9723-e670-4f54-b7e3-aa934b586d68","Type":"ContainerStarted","Data":"85aefc4a49dcdf4955a9d97ba89bb0d4c60e1e6df5515c7f63a8d65157c0b23c"} Jul 19 16:47:23.884782 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:23.884567 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:23.900805 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:23.900762 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" podStartSLOduration=1.611151162 podStartE2EDuration="3.900750751s" totalImagesPullingTime="2.289599589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:47:23.899339742 +0000 UTC m=+559.553232083" watchObservedRunningTime="2026-07-19 16:47:23.900750751 +0000 UTC m=+559.554643062" Jul 19 16:47:28.763740 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.763707 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-llj62"] Jul 19 16:47:28.768159 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.768142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:28.771821 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.771799 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ccf85\"" Jul 19 16:47:28.779685 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.779664 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-llj62"] Jul 19 16:47:28.861958 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.861935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/608444aa-b3d5-4ff3-a173-cc1a01af268e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-llj62\" (UID: \"608444aa-b3d5-4ff3-a173-cc1a01af268e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:28.862056 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.861967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9strv\" (UniqueName: \"kubernetes.io/projected/608444aa-b3d5-4ff3-a173-cc1a01af268e-kube-api-access-9strv\") pod \"cert-manager-cainjector-559cdd8c87-llj62\" (UID: \"608444aa-b3d5-4ff3-a173-cc1a01af268e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:28.962599 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.962577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/608444aa-b3d5-4ff3-a173-cc1a01af268e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-llj62\" (UID: \"608444aa-b3d5-4ff3-a173-cc1a01af268e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:28.962691 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.962603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9strv\" (UniqueName: \"kubernetes.io/projected/608444aa-b3d5-4ff3-a173-cc1a01af268e-kube-api-access-9strv\") pod \"cert-manager-cainjector-559cdd8c87-llj62\" (UID: \"608444aa-b3d5-4ff3-a173-cc1a01af268e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:28.970938 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.970914 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/608444aa-b3d5-4ff3-a173-cc1a01af268e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-llj62\" (UID: \"608444aa-b3d5-4ff3-a173-cc1a01af268e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:28.971053 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:28.971037 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9strv\" (UniqueName: \"kubernetes.io/projected/608444aa-b3d5-4ff3-a173-cc1a01af268e-kube-api-access-9strv\") pod \"cert-manager-cainjector-559cdd8c87-llj62\" (UID: \"608444aa-b3d5-4ff3-a173-cc1a01af268e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:29.076602 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:29.076569 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" Jul 19 16:47:29.195617 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:29.195592 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-llj62"] Jul 19 16:47:29.197591 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:47:29.197566 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod608444aa_b3d5_4ff3_a173_cc1a01af268e.slice/crio-513601cff520c1f209418e3a55bc9b494884b7189788fd2e06c831393a710f72 WatchSource:0}: Error finding container 513601cff520c1f209418e3a55bc9b494884b7189788fd2e06c831393a710f72: Status 404 returned error can't find the container with id 513601cff520c1f209418e3a55bc9b494884b7189788fd2e06c831393a710f72 Jul 19 16:47:29.891452 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:29.891425 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-274cg" Jul 19 16:47:29.912073 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:29.912038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" event={"ID":"608444aa-b3d5-4ff3-a173-cc1a01af268e","Type":"ContainerStarted","Data":"9073f2efdc45ff1c847743d6b61e922539b33872379514466463d6111b1594d9"} Jul 19 16:47:29.912186 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:29.912083 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" event={"ID":"608444aa-b3d5-4ff3-a173-cc1a01af268e","Type":"ContainerStarted","Data":"513601cff520c1f209418e3a55bc9b494884b7189788fd2e06c831393a710f72"} Jul 19 16:47:29.927358 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:29.927311 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-llj62" podStartSLOduration=1.9272958569999998 podStartE2EDuration="1.927295857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:47:29.925923917 +0000 UTC m=+565.579816229" watchObservedRunningTime="2026-07-19 16:47:29.927295857 +0000 UTC m=+565.581188168" Jul 19 16:47:36.944008 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:36.943978 2563 generic.go:356] "Generic (PLEG): container finished" podID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerID="67a2639b0354f3f47b147eb959a95adc23cb327f1d01c67b0dc802f308a64dd1" exitCode=0 Jul 19 16:47:36.944355 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:36.944071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" event={"ID":"52c92fc4-5f07-4cfd-8dce-784614507d06","Type":"ContainerDied","Data":"67a2639b0354f3f47b147eb959a95adc23cb327f1d01c67b0dc802f308a64dd1"} Jul 19 16:47:37.950774 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:37.950743 2563 generic.go:356] "Generic (PLEG): container finished" podID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerID="0dba7b7372c28696a94bfbd5ab88507143c7614561634b145905eb9de2bc219a" exitCode=0 Jul 19 16:47:37.951134 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:37.950824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" event={"ID":"52c92fc4-5f07-4cfd-8dce-784614507d06","Type":"ContainerDied","Data":"0dba7b7372c28696a94bfbd5ab88507143c7614561634b145905eb9de2bc219a"} Jul 19 16:47:39.080192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.080171 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:39.136062 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.136036 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l759s\" (UniqueName: \"kubernetes.io/projected/52c92fc4-5f07-4cfd-8dce-784614507d06-kube-api-access-l759s\") pod \"52c92fc4-5f07-4cfd-8dce-784614507d06\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " Jul 19 16:47:39.136186 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.136101 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-bundle\") pod \"52c92fc4-5f07-4cfd-8dce-784614507d06\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " Jul 19 16:47:39.136186 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.136169 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-util\") pod \"52c92fc4-5f07-4cfd-8dce-784614507d06\" (UID: \"52c92fc4-5f07-4cfd-8dce-784614507d06\") " Jul 19 16:47:39.136486 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.136466 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-bundle" (OuterVolumeSpecName: "bundle") pod "52c92fc4-5f07-4cfd-8dce-784614507d06" (UID: "52c92fc4-5f07-4cfd-8dce-784614507d06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:47:39.137940 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.137917 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c92fc4-5f07-4cfd-8dce-784614507d06-kube-api-access-l759s" (OuterVolumeSpecName: "kube-api-access-l759s") pod "52c92fc4-5f07-4cfd-8dce-784614507d06" (UID: "52c92fc4-5f07-4cfd-8dce-784614507d06"). InnerVolumeSpecName "kube-api-access-l759s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:47:39.142635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.142610 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-util" (OuterVolumeSpecName: "util") pod "52c92fc4-5f07-4cfd-8dce-784614507d06" (UID: "52c92fc4-5f07-4cfd-8dce-784614507d06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:47:39.236992 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.236948 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:39.236992 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.236965 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52c92fc4-5f07-4cfd-8dce-784614507d06-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:39.236992 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.236973 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l759s\" (UniqueName: \"kubernetes.io/projected/52c92fc4-5f07-4cfd-8dce-784614507d06-kube-api-access-l759s\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:39.960621 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.960596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" event={"ID":"52c92fc4-5f07-4cfd-8dce-784614507d06","Type":"ContainerDied","Data":"0aec13bd114f00e033a0c7512037141cfad77cfafdfd5ce081fdfdf7d6ecc74d"} Jul 19 16:47:39.960621 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.960612 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9wqtl" Jul 19 16:47:39.960761 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:39.960635 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aec13bd114f00e033a0c7512037141cfad77cfafdfd5ce081fdfdf7d6ecc74d" Jul 19 16:47:50.191661 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191627 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2"] Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191946 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="extract" Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191957 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="extract" Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191967 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="pull" Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191972 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="pull" Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191980 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="util" Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.191985 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="util" Jul 19 16:47:50.192052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.192034 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c92fc4-5f07-4cfd-8dce-784614507d06" containerName="extract" Jul 19 16:47:50.194468 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.194451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.196782 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.196764 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnbdt\"" Jul 19 16:47:50.196916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.196783 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 19 16:47:50.196916 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.196819 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 19 16:47:50.202239 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.202220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2"] Jul 19 16:47:50.312215 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.312188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brp8f\" (UniqueName: \"kubernetes.io/projected/27806166-879f-4df3-b196-cd59e4c2a4de-kube-api-access-brp8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.312305 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.312218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.312382 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.312320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.412747 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.412722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.412832 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.412760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brp8f\" (UniqueName: \"kubernetes.io/projected/27806166-879f-4df3-b196-cd59e4c2a4de-kube-api-access-brp8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.412832 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.412778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.413064 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.413047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.413127 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.413112 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.420635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.420618 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brp8f\" (UniqueName: \"kubernetes.io/projected/27806166-879f-4df3-b196-cd59e4c2a4de-kube-api-access-brp8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.504477 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.504429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:50.627595 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:50.627574 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2"] Jul 19 16:47:50.629586 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:47:50.629561 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27806166_879f_4df3_b196_cd59e4c2a4de.slice/crio-10767fc446e4e35ed745536fe5d3bde14c09c999e653c275c8d90a06d0e52cad WatchSource:0}: Error finding container 10767fc446e4e35ed745536fe5d3bde14c09c999e653c275c8d90a06d0e52cad: Status 404 returned error can't find the container with id 10767fc446e4e35ed745536fe5d3bde14c09c999e653c275c8d90a06d0e52cad Jul 19 16:47:51.007503 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:51.007474 2563 generic.go:356] "Generic (PLEG): container finished" podID="27806166-879f-4df3-b196-cd59e4c2a4de" containerID="18ec8d4ee15ff066fce59b0a984d22d271751bd35b9e55ac4ed51a658a0f2c5a" exitCode=0 Jul 19 16:47:51.007611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:51.007551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" event={"ID":"27806166-879f-4df3-b196-cd59e4c2a4de","Type":"ContainerDied","Data":"18ec8d4ee15ff066fce59b0a984d22d271751bd35b9e55ac4ed51a658a0f2c5a"} Jul 19 16:47:51.007611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:51.007597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" event={"ID":"27806166-879f-4df3-b196-cd59e4c2a4de","Type":"ContainerStarted","Data":"10767fc446e4e35ed745536fe5d3bde14c09c999e653c275c8d90a06d0e52cad"} Jul 19 16:47:52.013843 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:52.013778 2563 generic.go:356] "Generic (PLEG): container finished" podID="27806166-879f-4df3-b196-cd59e4c2a4de" containerID="4ce91d6e32579fbabb6acf4320010924b2ddb29831275af9e8988541354c3d7b" exitCode=0 Jul 19 16:47:52.014161 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:52.013856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" event={"ID":"27806166-879f-4df3-b196-cd59e4c2a4de","Type":"ContainerDied","Data":"4ce91d6e32579fbabb6acf4320010924b2ddb29831275af9e8988541354c3d7b"} Jul 19 16:47:53.020211 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:53.020186 2563 generic.go:356] "Generic (PLEG): container finished" podID="27806166-879f-4df3-b196-cd59e4c2a4de" containerID="20e91d43fbc7874ed4303439e24b17ae21998924028eaf5b1f7cd82c82095b10" exitCode=0 Jul 19 16:47:53.020527 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:53.020233 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" event={"ID":"27806166-879f-4df3-b196-cd59e4c2a4de","Type":"ContainerDied","Data":"20e91d43fbc7874ed4303439e24b17ae21998924028eaf5b1f7cd82c82095b10"} Jul 19 16:47:54.153470 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.153449 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:54.243843 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.243816 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brp8f\" (UniqueName: \"kubernetes.io/projected/27806166-879f-4df3-b196-cd59e4c2a4de-kube-api-access-brp8f\") pod \"27806166-879f-4df3-b196-cd59e4c2a4de\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " Jul 19 16:47:54.243987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.243856 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-bundle\") pod \"27806166-879f-4df3-b196-cd59e4c2a4de\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " Jul 19 16:47:54.243987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.243908 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-util\") pod \"27806166-879f-4df3-b196-cd59e4c2a4de\" (UID: \"27806166-879f-4df3-b196-cd59e4c2a4de\") " Jul 19 16:47:54.244523 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.244496 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-bundle" (OuterVolumeSpecName: "bundle") pod "27806166-879f-4df3-b196-cd59e4c2a4de" (UID: "27806166-879f-4df3-b196-cd59e4c2a4de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:47:54.245797 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.245773 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27806166-879f-4df3-b196-cd59e4c2a4de-kube-api-access-brp8f" (OuterVolumeSpecName: "kube-api-access-brp8f") pod "27806166-879f-4df3-b196-cd59e4c2a4de" (UID: "27806166-879f-4df3-b196-cd59e4c2a4de"). InnerVolumeSpecName "kube-api-access-brp8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:47:54.249345 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.249315 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-util" (OuterVolumeSpecName: "util") pod "27806166-879f-4df3-b196-cd59e4c2a4de" (UID: "27806166-879f-4df3-b196-cd59e4c2a4de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:47:54.344337 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.344316 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:54.344337 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.344335 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brp8f\" (UniqueName: \"kubernetes.io/projected/27806166-879f-4df3-b196-cd59e4c2a4de-kube-api-access-brp8f\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:54.344455 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:54.344346 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27806166-879f-4df3-b196-cd59e4c2a4de-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:47:55.031401 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:55.031371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" event={"ID":"27806166-879f-4df3-b196-cd59e4c2a4de","Type":"ContainerDied","Data":"10767fc446e4e35ed745536fe5d3bde14c09c999e653c275c8d90a06d0e52cad"} Jul 19 16:47:55.031401 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:55.031395 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvj2t2" Jul 19 16:47:55.031578 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:47:55.031415 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10767fc446e4e35ed745536fe5d3bde14c09c999e653c275c8d90a06d0e52cad" Jul 19 16:48:00.137026 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.136989 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6"] Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137300 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="util" Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137310 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="util" Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137322 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="extract" Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137328 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="extract" Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137340 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="pull" Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137345 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="pull" Jul 19 16:48:00.137399 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.137397 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="27806166-879f-4df3-b196-cd59e4c2a4de" containerName="extract" Jul 19 16:48:00.140216 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.140199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.143976 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.143942 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 19 16:48:00.143976 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.143964 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 19 16:48:00.144174 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.144001 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q7m8d\"" Jul 19 16:48:00.144174 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.144104 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 19 16:48:00.144174 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.144147 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 19 16:48:00.144362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.144345 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 19 16:48:00.154935 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.154910 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6"] Jul 19 16:48:00.292084 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.292050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63495359-00cc-4d29-9d24-cc3b44cd0392-manager-config\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.292084 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.292085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63495359-00cc-4d29-9d24-cc3b44cd0392-cert\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.292275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.292132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6nr5\" (UniqueName: \"kubernetes.io/projected/63495359-00cc-4d29-9d24-cc3b44cd0392-kube-api-access-d6nr5\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.292275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.292174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63495359-00cc-4d29-9d24-cc3b44cd0392-metrics-cert\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.392764 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.392674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63495359-00cc-4d29-9d24-cc3b44cd0392-manager-config\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.392764 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.392723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63495359-00cc-4d29-9d24-cc3b44cd0392-cert\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.392764 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.392755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6nr5\" (UniqueName: \"kubernetes.io/projected/63495359-00cc-4d29-9d24-cc3b44cd0392-kube-api-access-d6nr5\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.393005 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.392789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63495359-00cc-4d29-9d24-cc3b44cd0392-metrics-cert\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.393489 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.393463 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63495359-00cc-4d29-9d24-cc3b44cd0392-manager-config\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.395400 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.395377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63495359-00cc-4d29-9d24-cc3b44cd0392-cert\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.395493 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.395375 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63495359-00cc-4d29-9d24-cc3b44cd0392-metrics-cert\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.403377 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.403354 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6nr5\" (UniqueName: \"kubernetes.io/projected/63495359-00cc-4d29-9d24-cc3b44cd0392-kube-api-access-d6nr5\") pod \"lws-controller-manager-5dffb557f4-v52m6\" (UID: \"63495359-00cc-4d29-9d24-cc3b44cd0392\") " pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.450006 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.449972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:00.582677 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:00.582650 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6"] Jul 19 16:48:00.584598 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:48:00.584559 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63495359_00cc_4d29_9d24_cc3b44cd0392.slice/crio-98aa9efb52765237a868de6b9e95988a327da544a7272e85b8500cdf872c56b3 WatchSource:0}: Error finding container 98aa9efb52765237a868de6b9e95988a327da544a7272e85b8500cdf872c56b3: Status 404 returned error can't find the container with id 98aa9efb52765237a868de6b9e95988a327da544a7272e85b8500cdf872c56b3 Jul 19 16:48:01.061070 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:01.061039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" event={"ID":"63495359-00cc-4d29-9d24-cc3b44cd0392","Type":"ContainerStarted","Data":"98aa9efb52765237a868de6b9e95988a327da544a7272e85b8500cdf872c56b3"} Jul 19 16:48:02.067846 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:02.067817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" event={"ID":"63495359-00cc-4d29-9d24-cc3b44cd0392","Type":"ContainerStarted","Data":"5349abd19171110ce9cb510a366e2e25ffba4adda07459f8f4a45e464f6fb9c5"} Jul 19 16:48:02.068277 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:02.067938 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:02.089396 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:02.089355 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" podStartSLOduration=0.689608982 podStartE2EDuration="2.089339887s" totalImagesPullingTime="1.399730905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:48:02.088697886 +0000 UTC m=+597.742590197" watchObservedRunningTime="2026-07-19 16:48:02.089339887 +0000 UTC m=+597.743232199" Jul 19 16:48:04.940358 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.940328 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl"] Jul 19 16:48:04.943945 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.943924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:04.946908 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.946870 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 19 16:48:04.947242 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.947216 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9w89c\"" Jul 19 16:48:04.947358 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.947310 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 19 16:48:04.947441 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.947410 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 19 16:48:04.947630 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.947614 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 19 16:48:04.962181 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:04.962160 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl"] Jul 19 16:48:05.027188 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.027162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.027289 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.027198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.027289 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.027230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q7p2\" (UniqueName: \"kubernetes.io/projected/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-kube-api-access-7q7p2\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.027289 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.027274 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-tmp\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.027403 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.027292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-manifests\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.127577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.127552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-tmp\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.127662 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.127584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-manifests\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.127662 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.127628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.127754 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.127739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.127821 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.127799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q7p2\" (UniqueName: \"kubernetes.io/projected/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-kube-api-access-7q7p2\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.127998 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.127978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-manifests\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.129714 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.129695 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-tmp\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.129954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.129939 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.130065 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.130048 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.136479 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.136456 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q7p2\" (UniqueName: \"kubernetes.io/projected/1d99e8d4-d493-46b0-bbf8-8c7336b2bb33-kube-api-access-7q7p2\") pod \"opendatahub-operator-controller-manager-5f7db45576-vvlgl\" (UID: \"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.254275 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.254229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:05.389297 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:05.389271 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl"] Jul 19 16:48:05.390942 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:48:05.390914 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d99e8d4_d493_46b0_bbf8_8c7336b2bb33.slice/crio-fba1f878bfd7bfb2d7aec35d9f4a035191289759a96124dff277358d3ab2ca90 WatchSource:0}: Error finding container fba1f878bfd7bfb2d7aec35d9f4a035191289759a96124dff277358d3ab2ca90: Status 404 returned error can't find the container with id fba1f878bfd7bfb2d7aec35d9f4a035191289759a96124dff277358d3ab2ca90 Jul 19 16:48:06.089187 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:06.089151 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" event={"ID":"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33","Type":"ContainerStarted","Data":"fba1f878bfd7bfb2d7aec35d9f4a035191289759a96124dff277358d3ab2ca90"} Jul 19 16:48:08.512188 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:08.512123 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:48:08.513016 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:08.512999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:48:08.520091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:08.520071 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:48:08.520578 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:08.520562 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:48:09.111173 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:09.111144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" event={"ID":"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33","Type":"ContainerStarted","Data":"8da90d2b42e32f34eb433c8633651c4878ade3e9113fefb04ff9340d3822f6e0"} Jul 19 16:48:10.117291 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:10.117262 2563 generic.go:356] "Generic (PLEG): container finished" podID="1d99e8d4-d493-46b0-bbf8-8c7336b2bb33" containerID="8da90d2b42e32f34eb433c8633651c4878ade3e9113fefb04ff9340d3822f6e0" exitCode=0 Jul 19 16:48:10.117635 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:10.117337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" event={"ID":"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33","Type":"ContainerDied","Data":"8da90d2b42e32f34eb433c8633651c4878ade3e9113fefb04ff9340d3822f6e0"} Jul 19 16:48:10.117703 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:10.117689 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 16:48:11.123723 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:11.123689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" event={"ID":"1d99e8d4-d493-46b0-bbf8-8c7336b2bb33","Type":"ContainerStarted","Data":"405d74155b54fa89a1b6938c692769aaa19f55117881c9b89c9a2023a282047f"} Jul 19 16:48:11.124126 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:11.123810 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:11.143159 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:11.143120 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" podStartSLOduration=2.933627155 podStartE2EDuration="7.143107086s" totalImagesPullingTime="3.162669924s" totalInitContainerRuntime="1.046810007s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:48:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:48:11.141790657 +0000 UTC m=+606.795682968" watchObservedRunningTime="2026-07-19 16:48:11.143107086 +0000 UTC m=+606.796999397" Jul 19 16:48:13.074019 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:13.073991 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dffb557f4-v52m6" Jul 19 16:48:22.130721 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:22.130691 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7db45576-vvlgl" Jul 19 16:48:24.369937 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.369907 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf6466d9-57hst"] Jul 19 16:48:24.378194 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.378172 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.380753 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.380727 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xhhgc\"" Jul 19 16:48:24.380936 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.380749 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 19 16:48:24.381036 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.380761 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 19 16:48:24.381105 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.380831 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 19 16:48:24.381607 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.381589 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 19 16:48:24.385279 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.385256 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf6466d9-57hst"] Jul 19 16:48:24.481341 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.481311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97bb0578-7483-4fae-86d1-bc06644f983b-tmp\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.481468 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.481354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bb0578-7483-4fae-86d1-bc06644f983b-tls-certs\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.481468 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.481376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j2bj\" (UniqueName: \"kubernetes.io/projected/97bb0578-7483-4fae-86d1-bc06644f983b-kube-api-access-8j2bj\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.581862 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.581823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97bb0578-7483-4fae-86d1-bc06644f983b-tmp\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.582030 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.581874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bb0578-7483-4fae-86d1-bc06644f983b-tls-certs\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.582030 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.581916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j2bj\" (UniqueName: \"kubernetes.io/projected/97bb0578-7483-4fae-86d1-bc06644f983b-kube-api-access-8j2bj\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.583997 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.583976 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97bb0578-7483-4fae-86d1-bc06644f983b-tmp\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.584193 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.584176 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bb0578-7483-4fae-86d1-bc06644f983b-tls-certs\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.589743 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.589724 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j2bj\" (UniqueName: \"kubernetes.io/projected/97bb0578-7483-4fae-86d1-bc06644f983b-kube-api-access-8j2bj\") pod \"kube-auth-proxy-cdf6466d9-57hst\" (UID: \"97bb0578-7483-4fae-86d1-bc06644f983b\") " pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.691027 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.690979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" Jul 19 16:48:24.853662 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:24.853633 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdf6466d9-57hst"] Jul 19 16:48:24.855375 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:48:24.855349 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bb0578_7483_4fae_86d1_bc06644f983b.slice/crio-b9c23212ddf7a3216c7b6e21f469adebda037a99e1ae683c74e416124a6e60a1 WatchSource:0}: Error finding container b9c23212ddf7a3216c7b6e21f469adebda037a99e1ae683c74e416124a6e60a1: Status 404 returned error can't find the container with id b9c23212ddf7a3216c7b6e21f469adebda037a99e1ae683c74e416124a6e60a1 Jul 19 16:48:25.200704 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:25.200669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" event={"ID":"97bb0578-7483-4fae-86d1-bc06644f983b","Type":"ContainerStarted","Data":"b9c23212ddf7a3216c7b6e21f469adebda037a99e1ae683c74e416124a6e60a1"} Jul 19 16:48:28.217434 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:28.217399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" event={"ID":"97bb0578-7483-4fae-86d1-bc06644f983b","Type":"ContainerStarted","Data":"6a1ce53907898d1cbb6bec4144236dac264baa329406f07027e8bb04ddd0008c"} Jul 19 16:48:28.233786 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:48:28.233740 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cdf6466d9-57hst" podStartSLOduration=1.7813077910000001 podStartE2EDuration="4.233727413s" totalImagesPullingTime="2.452419622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:48:28.231734944 +0000 UTC m=+623.885627275" watchObservedRunningTime="2026-07-19 16:48:28.233727413 +0000 UTC m=+623.887619724" Jul 19 16:49:41.172954 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.172918 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5"] Jul 19 16:49:41.178273 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.178245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.181297 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.181275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 19 16:49:41.181297 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.181294 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 19 16:49:41.182296 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.182257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkgtk\"" Jul 19 16:49:41.182744 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.182722 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5"] Jul 19 16:49:41.356089 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.356066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.356188 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.356116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.356230 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.356188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b846\" (UniqueName: \"kubernetes.io/projected/f6702ff2-7add-490d-b707-f7edae762c44-kube-api-access-5b846\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.456502 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.456442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.456502 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.456487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b846\" (UniqueName: \"kubernetes.io/projected/f6702ff2-7add-490d-b707-f7edae762c44-kube-api-access-5b846\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.456668 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.456513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.456805 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.456785 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.456855 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.456809 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.464324 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.464303 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b846\" (UniqueName: \"kubernetes.io/projected/f6702ff2-7add-490d-b707-f7edae762c44-kube-api-access-5b846\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.489157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.489133 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:41.615491 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.615462 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5"] Jul 19 16:49:41.618361 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:49:41.618334 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6702ff2_7add_490d_b707_f7edae762c44.slice/crio-fa8613e9b629dac77e69a3757f33608d3fd7e692db39c086f0e579a11a84c270 WatchSource:0}: Error finding container fa8613e9b629dac77e69a3757f33608d3fd7e692db39c086f0e579a11a84c270: Status 404 returned error can't find the container with id fa8613e9b629dac77e69a3757f33608d3fd7e692db39c086f0e579a11a84c270 Jul 19 16:49:41.975989 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.975935 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv"] Jul 19 16:49:41.979302 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.979284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:41.988055 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:41.988027 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv"] Jul 19 16:49:42.161812 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.161786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4wxp\" (UniqueName: \"kubernetes.io/projected/895057fd-c046-4eb8-b473-4022f72439e5-kube-api-access-n4wxp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.161945 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.161827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.161945 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.161854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.263045 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.262965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.263045 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.263022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4wxp\" (UniqueName: \"kubernetes.io/projected/895057fd-c046-4eb8-b473-4022f72439e5-kube-api-access-n4wxp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.263456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.263053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.263456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.263388 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.263456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.263387 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.270324 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.270305 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4wxp\" (UniqueName: \"kubernetes.io/projected/895057fd-c046-4eb8-b473-4022f72439e5-kube-api-access-n4wxp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.288112 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.288094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:42.378959 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.378934 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5"] Jul 19 16:49:42.383153 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.383129 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.392044 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.391793 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5"] Jul 19 16:49:42.420239 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.420143 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv"] Jul 19 16:49:42.422622 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:49:42.422598 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895057fd_c046_4eb8_b473_4022f72439e5.slice/crio-238b8efb1fb0221cc577261fa0028b2b0462b20094add41e3e35935390491fb8 WatchSource:0}: Error finding container 238b8efb1fb0221cc577261fa0028b2b0462b20094add41e3e35935390491fb8: Status 404 returned error can't find the container with id 238b8efb1fb0221cc577261fa0028b2b0462b20094add41e3e35935390491fb8 Jul 19 16:49:42.464675 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.464655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.464786 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.464718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.464786 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.464774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtw9\" (UniqueName: \"kubernetes.io/projected/a324e1ad-2620-427b-a764-44d9c994c0ff-kube-api-access-2rtw9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.565138 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.565117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.565266 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.565182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.565266 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.565225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtw9\" (UniqueName: \"kubernetes.io/projected/a324e1ad-2620-427b-a764-44d9c994c0ff-kube-api-access-2rtw9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.565499 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.565480 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.565563 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.565527 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.570344 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.570324 2563 generic.go:356] "Generic (PLEG): container finished" podID="f6702ff2-7add-490d-b707-f7edae762c44" containerID="345589fb0bd2c8a749de21117ea267ee071df4c862394a124edb1d47b51251d3" exitCode=0 Jul 19 16:49:42.570425 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.570403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" event={"ID":"f6702ff2-7add-490d-b707-f7edae762c44","Type":"ContainerDied","Data":"345589fb0bd2c8a749de21117ea267ee071df4c862394a124edb1d47b51251d3"} Jul 19 16:49:42.570482 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.570459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" event={"ID":"f6702ff2-7add-490d-b707-f7edae762c44","Type":"ContainerStarted","Data":"fa8613e9b629dac77e69a3757f33608d3fd7e692db39c086f0e579a11a84c270"} Jul 19 16:49:42.572138 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.572117 2563 generic.go:356] "Generic (PLEG): container finished" podID="895057fd-c046-4eb8-b473-4022f72439e5" containerID="7c4b80f249039d85e323916afb22417abc2bba0f91028d0e2da8f532466722c6" exitCode=0 Jul 19 16:49:42.572209 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.572148 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" event={"ID":"895057fd-c046-4eb8-b473-4022f72439e5","Type":"ContainerDied","Data":"7c4b80f249039d85e323916afb22417abc2bba0f91028d0e2da8f532466722c6"} Jul 19 16:49:42.572251 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.572209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" event={"ID":"895057fd-c046-4eb8-b473-4022f72439e5","Type":"ContainerStarted","Data":"238b8efb1fb0221cc577261fa0028b2b0462b20094add41e3e35935390491fb8"} Jul 19 16:49:42.573623 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.573601 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtw9\" (UniqueName: \"kubernetes.io/projected/a324e1ad-2620-427b-a764-44d9c994c0ff-kube-api-access-2rtw9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.694890 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.694868 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:42.777386 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.777355 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms"] Jul 19 16:49:42.781994 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.781972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.789237 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.789212 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms"] Jul 19 16:49:42.822717 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.822698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5"] Jul 19 16:49:42.824434 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:49:42.824411 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda324e1ad_2620_427b_a764_44d9c994c0ff.slice/crio-32c8fb55a42ae058e0d093f1b18f27cdc90ee93be66d5058dbbc06c75cb6c6e6 WatchSource:0}: Error finding container 32c8fb55a42ae058e0d093f1b18f27cdc90ee93be66d5058dbbc06c75cb6c6e6: Status 404 returned error can't find the container with id 32c8fb55a42ae058e0d093f1b18f27cdc90ee93be66d5058dbbc06c75cb6c6e6 Jul 19 16:49:42.867561 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.867537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhfz\" (UniqueName: \"kubernetes.io/projected/ec288acd-fd10-444b-9fd7-7ef65a39d60d-kube-api-access-hfhfz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.867658 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.867571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.867735 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.867714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.968148 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.968122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhfz\" (UniqueName: \"kubernetes.io/projected/ec288acd-fd10-444b-9fd7-7ef65a39d60d-kube-api-access-hfhfz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.968250 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.968157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.968250 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.968236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.968527 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.968511 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.968590 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.968572 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:42.984027 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:42.984008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhfz\" (UniqueName: \"kubernetes.io/projected/ec288acd-fd10-444b-9fd7-7ef65a39d60d-kube-api-access-hfhfz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:43.093186 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.093168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:43.228202 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.228177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms"] Jul 19 16:49:43.260784 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:49:43.260756 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec288acd_fd10_444b_9fd7_7ef65a39d60d.slice/crio-80ceaad22de17abd2d69fa687a40ae63b54d79c6742a6e0cf53f60513c1d91fa WatchSource:0}: Error finding container 80ceaad22de17abd2d69fa687a40ae63b54d79c6742a6e0cf53f60513c1d91fa: Status 404 returned error can't find the container with id 80ceaad22de17abd2d69fa687a40ae63b54d79c6742a6e0cf53f60513c1d91fa Jul 19 16:49:43.578835 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.578802 2563 generic.go:356] "Generic (PLEG): container finished" podID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerID="f0aaf870a0595d2f3bceaab8292cf64162ad99e1afef2142a183ddae5031c0b7" exitCode=0 Jul 19 16:49:43.579177 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.578901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" event={"ID":"ec288acd-fd10-444b-9fd7-7ef65a39d60d","Type":"ContainerDied","Data":"f0aaf870a0595d2f3bceaab8292cf64162ad99e1afef2142a183ddae5031c0b7"} Jul 19 16:49:43.579177 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.578978 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" event={"ID":"ec288acd-fd10-444b-9fd7-7ef65a39d60d","Type":"ContainerStarted","Data":"80ceaad22de17abd2d69fa687a40ae63b54d79c6742a6e0cf53f60513c1d91fa"} Jul 19 16:49:43.580780 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.580760 2563 generic.go:356] "Generic (PLEG): container finished" podID="f6702ff2-7add-490d-b707-f7edae762c44" containerID="a537befd30e781d4aa3e80a8e7619e9bec11bb4f1b676a9cb3eb12d0b963c2f5" exitCode=0 Jul 19 16:49:43.580876 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.580824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" event={"ID":"f6702ff2-7add-490d-b707-f7edae762c44","Type":"ContainerDied","Data":"a537befd30e781d4aa3e80a8e7619e9bec11bb4f1b676a9cb3eb12d0b963c2f5"} Jul 19 16:49:43.582477 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.582459 2563 generic.go:356] "Generic (PLEG): container finished" podID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerID="68cb47831f3b9a53dfbfaaa6230fa72847d7e8f8980456d619522a8e0f37445e" exitCode=0 Jul 19 16:49:43.582577 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.582553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" event={"ID":"a324e1ad-2620-427b-a764-44d9c994c0ff","Type":"ContainerDied","Data":"68cb47831f3b9a53dfbfaaa6230fa72847d7e8f8980456d619522a8e0f37445e"} Jul 19 16:49:43.582636 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.582596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" event={"ID":"a324e1ad-2620-427b-a764-44d9c994c0ff","Type":"ContainerStarted","Data":"32c8fb55a42ae058e0d093f1b18f27cdc90ee93be66d5058dbbc06c75cb6c6e6"} Jul 19 16:49:43.584556 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.584517 2563 generic.go:356] "Generic (PLEG): container finished" podID="895057fd-c046-4eb8-b473-4022f72439e5" containerID="7774f0c35562920fa370e04ed613d7d5f7bfd95f7419ae62871036fe4c396533" exitCode=0 Jul 19 16:49:43.584634 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:43.584578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" event={"ID":"895057fd-c046-4eb8-b473-4022f72439e5","Type":"ContainerDied","Data":"7774f0c35562920fa370e04ed613d7d5f7bfd95f7419ae62871036fe4c396533"} Jul 19 16:49:44.595011 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.594984 2563 generic.go:356] "Generic (PLEG): container finished" podID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerID="c0ac042b34c190e604b729e776bfc5439c5e6da7e3754bd7ee16ba379f7a49be" exitCode=0 Jul 19 16:49:44.595308 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.595018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" event={"ID":"ec288acd-fd10-444b-9fd7-7ef65a39d60d","Type":"ContainerDied","Data":"c0ac042b34c190e604b729e776bfc5439c5e6da7e3754bd7ee16ba379f7a49be"} Jul 19 16:49:44.597296 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.597274 2563 generic.go:356] "Generic (PLEG): container finished" podID="f6702ff2-7add-490d-b707-f7edae762c44" containerID="65b78a7458f8ce302f38cc22206e0526c6fabfdbe3a8c293879b0a21db906239" exitCode=0 Jul 19 16:49:44.597472 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.597360 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" event={"ID":"f6702ff2-7add-490d-b707-f7edae762c44","Type":"ContainerDied","Data":"65b78a7458f8ce302f38cc22206e0526c6fabfdbe3a8c293879b0a21db906239"} Jul 19 16:49:44.599111 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.599070 2563 generic.go:356] "Generic (PLEG): container finished" podID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerID="e43486b9899c1919d6f3f54a441480036224a3d5f50012e325b770e07de120db" exitCode=0 Jul 19 16:49:44.599182 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.599155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" event={"ID":"a324e1ad-2620-427b-a764-44d9c994c0ff","Type":"ContainerDied","Data":"e43486b9899c1919d6f3f54a441480036224a3d5f50012e325b770e07de120db"} Jul 19 16:49:44.601362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.601344 2563 generic.go:356] "Generic (PLEG): container finished" podID="895057fd-c046-4eb8-b473-4022f72439e5" containerID="e86c28de68ea0276e7a6ad60ca65dbc5dc004980fa178b61e9ca6d703a31578d" exitCode=0 Jul 19 16:49:44.601436 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:44.601376 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" event={"ID":"895057fd-c046-4eb8-b473-4022f72439e5","Type":"ContainerDied","Data":"e86c28de68ea0276e7a6ad60ca65dbc5dc004980fa178b61e9ca6d703a31578d"} Jul 19 16:49:45.608196 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.608162 2563 generic.go:356] "Generic (PLEG): container finished" podID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerID="b0f60f477aae423155a9905fbfa3e71ad6dcbc9df2a7d623c1b15609d3a9dca1" exitCode=0 Jul 19 16:49:45.608573 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.608248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" event={"ID":"a324e1ad-2620-427b-a764-44d9c994c0ff","Type":"ContainerDied","Data":"b0f60f477aae423155a9905fbfa3e71ad6dcbc9df2a7d623c1b15609d3a9dca1"} Jul 19 16:49:45.610352 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.610333 2563 generic.go:356] "Generic (PLEG): container finished" podID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerID="c7865d844b78cde5570900f3c63ee056bdc17f92a9e4072083d8a6da1c56f620" exitCode=0 Jul 19 16:49:45.610468 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.610394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" event={"ID":"ec288acd-fd10-444b-9fd7-7ef65a39d60d","Type":"ContainerDied","Data":"c7865d844b78cde5570900f3c63ee056bdc17f92a9e4072083d8a6da1c56f620"} Jul 19 16:49:45.742564 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.742541 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:45.757461 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.757439 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:45.785741 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.785715 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-util\") pod \"895057fd-c046-4eb8-b473-4022f72439e5\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " Jul 19 16:49:45.785827 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.785781 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-util\") pod \"f6702ff2-7add-490d-b707-f7edae762c44\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " Jul 19 16:49:45.785827 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.785815 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b846\" (UniqueName: \"kubernetes.io/projected/f6702ff2-7add-490d-b707-f7edae762c44-kube-api-access-5b846\") pod \"f6702ff2-7add-490d-b707-f7edae762c44\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " Jul 19 16:49:45.785978 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.785839 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4wxp\" (UniqueName: \"kubernetes.io/projected/895057fd-c046-4eb8-b473-4022f72439e5-kube-api-access-n4wxp\") pod \"895057fd-c046-4eb8-b473-4022f72439e5\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " Jul 19 16:49:45.785978 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.785870 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-bundle\") pod \"895057fd-c046-4eb8-b473-4022f72439e5\" (UID: \"895057fd-c046-4eb8-b473-4022f72439e5\") " Jul 19 16:49:45.785978 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.785933 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-bundle\") pod \"f6702ff2-7add-490d-b707-f7edae762c44\" (UID: \"f6702ff2-7add-490d-b707-f7edae762c44\") " Jul 19 16:49:45.786685 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.786653 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-bundle" (OuterVolumeSpecName: "bundle") pod "895057fd-c046-4eb8-b473-4022f72439e5" (UID: "895057fd-c046-4eb8-b473-4022f72439e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:45.786879 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.786739 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-bundle" (OuterVolumeSpecName: "bundle") pod "f6702ff2-7add-490d-b707-f7edae762c44" (UID: "f6702ff2-7add-490d-b707-f7edae762c44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:45.788141 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.788116 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895057fd-c046-4eb8-b473-4022f72439e5-kube-api-access-n4wxp" (OuterVolumeSpecName: "kube-api-access-n4wxp") pod "895057fd-c046-4eb8-b473-4022f72439e5" (UID: "895057fd-c046-4eb8-b473-4022f72439e5"). InnerVolumeSpecName "kube-api-access-n4wxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:49:45.788141 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.788109 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6702ff2-7add-490d-b707-f7edae762c44-kube-api-access-5b846" (OuterVolumeSpecName: "kube-api-access-5b846") pod "f6702ff2-7add-490d-b707-f7edae762c44" (UID: "f6702ff2-7add-490d-b707-f7edae762c44"). InnerVolumeSpecName "kube-api-access-5b846". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:49:45.791563 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.791540 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-util" (OuterVolumeSpecName: "util") pod "895057fd-c046-4eb8-b473-4022f72439e5" (UID: "895057fd-c046-4eb8-b473-4022f72439e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:45.792851 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.792825 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-util" (OuterVolumeSpecName: "util") pod "f6702ff2-7add-490d-b707-f7edae762c44" (UID: "f6702ff2-7add-490d-b707-f7edae762c44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:45.886767 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.886746 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:45.886767 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.886767 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b846\" (UniqueName: \"kubernetes.io/projected/f6702ff2-7add-490d-b707-f7edae762c44-kube-api-access-5b846\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:45.886903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.886777 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4wxp\" (UniqueName: \"kubernetes.io/projected/895057fd-c046-4eb8-b473-4022f72439e5-kube-api-access-n4wxp\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:45.886903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.886787 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:45.886903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.886794 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6702ff2-7add-490d-b707-f7edae762c44-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:45.886903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:45.886801 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/895057fd-c046-4eb8-b473-4022f72439e5-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.617134 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.617106 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" Jul 19 16:49:46.617528 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.617177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5" event={"ID":"f6702ff2-7add-490d-b707-f7edae762c44","Type":"ContainerDied","Data":"fa8613e9b629dac77e69a3757f33608d3fd7e692db39c086f0e579a11a84c270"} Jul 19 16:49:46.617528 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.617228 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa8613e9b629dac77e69a3757f33608d3fd7e692db39c086f0e579a11a84c270" Jul 19 16:49:46.618874 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.618846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" event={"ID":"895057fd-c046-4eb8-b473-4022f72439e5","Type":"ContainerDied","Data":"238b8efb1fb0221cc577261fa0028b2b0462b20094add41e3e35935390491fb8"} Jul 19 16:49:46.618874 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.618875 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv" Jul 19 16:49:46.619063 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.618906 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="238b8efb1fb0221cc577261fa0028b2b0462b20094add41e3e35935390491fb8" Jul 19 16:49:46.774738 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.774713 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:46.776656 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.776638 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:46.792682 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.792658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rtw9\" (UniqueName: \"kubernetes.io/projected/a324e1ad-2620-427b-a764-44d9c994c0ff-kube-api-access-2rtw9\") pod \"a324e1ad-2620-427b-a764-44d9c994c0ff\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " Jul 19 16:49:46.792773 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.792730 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-bundle\") pod \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " Jul 19 16:49:46.792852 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.792817 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-util\") pod \"a324e1ad-2620-427b-a764-44d9c994c0ff\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " Jul 19 16:49:46.792960 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.792943 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-util\") pod \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " Jul 19 16:49:46.793091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.793074 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfhfz\" (UniqueName: \"kubernetes.io/projected/ec288acd-fd10-444b-9fd7-7ef65a39d60d-kube-api-access-hfhfz\") pod \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\" (UID: \"ec288acd-fd10-444b-9fd7-7ef65a39d60d\") " Jul 19 16:49:46.793216 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.793203 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-bundle\") pod \"a324e1ad-2620-427b-a764-44d9c994c0ff\" (UID: \"a324e1ad-2620-427b-a764-44d9c994c0ff\") " Jul 19 16:49:46.793621 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.793547 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-bundle" (OuterVolumeSpecName: "bundle") pod "ec288acd-fd10-444b-9fd7-7ef65a39d60d" (UID: "ec288acd-fd10-444b-9fd7-7ef65a39d60d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:46.793782 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.793754 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-bundle" (OuterVolumeSpecName: "bundle") pod "a324e1ad-2620-427b-a764-44d9c994c0ff" (UID: "a324e1ad-2620-427b-a764-44d9c994c0ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:46.795271 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.795154 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a324e1ad-2620-427b-a764-44d9c994c0ff-kube-api-access-2rtw9" (OuterVolumeSpecName: "kube-api-access-2rtw9") pod "a324e1ad-2620-427b-a764-44d9c994c0ff" (UID: "a324e1ad-2620-427b-a764-44d9c994c0ff"). InnerVolumeSpecName "kube-api-access-2rtw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:49:46.796183 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.796155 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec288acd-fd10-444b-9fd7-7ef65a39d60d-kube-api-access-hfhfz" (OuterVolumeSpecName: "kube-api-access-hfhfz") pod "ec288acd-fd10-444b-9fd7-7ef65a39d60d" (UID: "ec288acd-fd10-444b-9fd7-7ef65a39d60d"). InnerVolumeSpecName "kube-api-access-hfhfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:49:46.800692 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.800666 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-util" (OuterVolumeSpecName: "util") pod "ec288acd-fd10-444b-9fd7-7ef65a39d60d" (UID: "ec288acd-fd10-444b-9fd7-7ef65a39d60d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:46.801490 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.801464 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-util" (OuterVolumeSpecName: "util") pod "a324e1ad-2620-427b-a764-44d9c994c0ff" (UID: "a324e1ad-2620-427b-a764-44d9c994c0ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 16:49:46.892151 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892101 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86567854cc-nccwk"] Jul 19 16:49:46.892445 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892423 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="pull" Jul 19 16:49:46.892445 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892437 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="pull" Jul 19 16:49:46.892445 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892445 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892451 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892458 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="pull" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892463 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="pull" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892477 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="pull" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892485 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="pull" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892495 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892501 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892509 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892514 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892523 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892531 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892542 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="pull" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892548 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="pull" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892554 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892561 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="extract" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892573 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892578 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892583 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892588 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892598 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="util" Jul 19 16:49:46.892613 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892605 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="util" Jul 19 16:49:46.893788 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892683 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6702ff2-7add-490d-b707-f7edae762c44" containerName="extract" Jul 19 16:49:46.893788 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892694 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec288acd-fd10-444b-9fd7-7ef65a39d60d" containerName="extract" Jul 19 16:49:46.893788 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892704 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a324e1ad-2620-427b-a764-44d9c994c0ff" containerName="extract" Jul 19 16:49:46.893788 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.892714 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="895057fd-c046-4eb8-b473-4022f72439e5" containerName="extract" Jul 19 16:49:46.894477 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.894453 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.894477 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.894478 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.894653 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.894486 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec288acd-fd10-444b-9fd7-7ef65a39d60d-util\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.894653 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.894493 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfhfz\" (UniqueName: \"kubernetes.io/projected/ec288acd-fd10-444b-9fd7-7ef65a39d60d-kube-api-access-hfhfz\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.894653 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.894503 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324e1ad-2620-427b-a764-44d9c994c0ff-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.894653 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.894515 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rtw9\" (UniqueName: \"kubernetes.io/projected/a324e1ad-2620-427b-a764-44d9c994c0ff-kube-api-access-2rtw9\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:49:46.896063 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.896040 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.907396 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.907376 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86567854cc-nccwk"] Jul 19 16:49:46.994857 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.994830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-oauth-serving-cert\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.994987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.994872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-trusted-ca-bundle\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.994987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.994955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-service-ca\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.994987 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.994976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-oauth-config\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.995097 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.995011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmsm9\" (UniqueName: \"kubernetes.io/projected/539d77b4-1e2a-41df-b26e-314a7e3a01cd-kube-api-access-vmsm9\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.995097 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.995047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-config\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:46.995097 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:46.995081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-serving-cert\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096109 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096090 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-service-ca\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096198 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-oauth-config\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096198 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmsm9\" (UniqueName: \"kubernetes.io/projected/539d77b4-1e2a-41df-b26e-314a7e3a01cd-kube-api-access-vmsm9\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096198 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-config\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096308 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-serving-cert\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096362 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-oauth-serving-cert\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096416 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-trusted-ca-bundle\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096786 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096741 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-config\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096810 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-service-ca\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.096968 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.096950 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-oauth-serving-cert\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.097162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.097145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/539d77b4-1e2a-41df-b26e-314a7e3a01cd-trusted-ca-bundle\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.098537 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.098517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-serving-cert\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.098585 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.098538 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/539d77b4-1e2a-41df-b26e-314a7e3a01cd-console-oauth-config\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.103421 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.103401 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmsm9\" (UniqueName: \"kubernetes.io/projected/539d77b4-1e2a-41df-b26e-314a7e3a01cd-kube-api-access-vmsm9\") pod \"console-86567854cc-nccwk\" (UID: \"539d77b4-1e2a-41df-b26e-314a7e3a01cd\") " pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.205183 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.205130 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:47.331903 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.331864 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86567854cc-nccwk"] Jul 19 16:49:47.333224 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:49:47.333200 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539d77b4_1e2a_41df_b26e_314a7e3a01cd.slice/crio-592bff0f5bb1067c4a91708c3d494df872eeb73dff2da822246c8ed80f36f962 WatchSource:0}: Error finding container 592bff0f5bb1067c4a91708c3d494df872eeb73dff2da822246c8ed80f36f962: Status 404 returned error can't find the container with id 592bff0f5bb1067c4a91708c3d494df872eeb73dff2da822246c8ed80f36f962 Jul 19 16:49:47.630568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.625355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" event={"ID":"a324e1ad-2620-427b-a764-44d9c994c0ff","Type":"ContainerDied","Data":"32c8fb55a42ae058e0d093f1b18f27cdc90ee93be66d5058dbbc06c75cb6c6e6"} Jul 19 16:49:47.630568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.625438 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5" Jul 19 16:49:47.630568 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.625445 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32c8fb55a42ae058e0d093f1b18f27cdc90ee93be66d5058dbbc06c75cb6c6e6" Jul 19 16:49:47.632761 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.632734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86567854cc-nccwk" event={"ID":"539d77b4-1e2a-41df-b26e-314a7e3a01cd","Type":"ContainerStarted","Data":"28c580532b7ea56b725c08d8b4a66fd44ff51a43479e9f8f1f96d99b5bfba527"} Jul 19 16:49:47.632909 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.632780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86567854cc-nccwk" event={"ID":"539d77b4-1e2a-41df-b26e-314a7e3a01cd","Type":"ContainerStarted","Data":"592bff0f5bb1067c4a91708c3d494df872eeb73dff2da822246c8ed80f36f962"} Jul 19 16:49:47.634520 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.634502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" event={"ID":"ec288acd-fd10-444b-9fd7-7ef65a39d60d","Type":"ContainerDied","Data":"80ceaad22de17abd2d69fa687a40ae63b54d79c6742a6e0cf53f60513c1d91fa"} Jul 19 16:49:47.634589 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.634531 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80ceaad22de17abd2d69fa687a40ae63b54d79c6742a6e0cf53f60513c1d91fa" Jul 19 16:49:47.634589 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.634546 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms" Jul 19 16:49:47.649538 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:47.649499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86567854cc-nccwk" podStartSLOduration=1.6494858209999999 podStartE2EDuration="1.649485821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:49:47.648523544 +0000 UTC m=+703.302415869" watchObservedRunningTime="2026-07-19 16:49:47.649485821 +0000 UTC m=+703.303378135" Jul 19 16:49:57.206127 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:57.206093 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:57.206533 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:57.206153 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:57.210252 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:57.210229 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:57.690157 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:57.690133 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86567854cc-nccwk" Jul 19 16:49:57.733162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:49:57.733132 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf86c7d8-lk58r"] Jul 19 16:50:04.808673 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:04.808643 2563 scope.go:117] "RemoveContainer" containerID="c63f6d641f5e0a932f4a25255195b60ae78603babc659e417e215c899410fca2" Jul 19 16:50:07.208117 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.208077 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kl425"] Jul 19 16:50:07.213372 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.213351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.218475 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.218454 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 19 16:50:07.218812 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.218793 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 19 16:50:07.218922 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.218844 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkgtk\"" Jul 19 16:50:07.218922 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.218848 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 19 16:50:07.218922 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.218903 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 19 16:50:07.230111 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.230088 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kl425"] Jul 19 16:50:07.348369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.348345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5ee9e34-c792-441b-ad31-ae46d318b88f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.348459 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.348389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqxwj\" (UniqueName: \"kubernetes.io/projected/f5ee9e34-c792-441b-ad31-ae46d318b88f-kube-api-access-kqxwj\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.348516 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.348459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5ee9e34-c792-441b-ad31-ae46d318b88f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.449485 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.449460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5ee9e34-c792-441b-ad31-ae46d318b88f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.449557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.449497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5ee9e34-c792-441b-ad31-ae46d318b88f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.449557 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.449546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqxwj\" (UniqueName: \"kubernetes.io/projected/f5ee9e34-c792-441b-ad31-ae46d318b88f-kube-api-access-kqxwj\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.450169 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.450149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f5ee9e34-c792-441b-ad31-ae46d318b88f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.451753 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.451737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5ee9e34-c792-441b-ad31-ae46d318b88f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.456579 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.456562 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqxwj\" (UniqueName: \"kubernetes.io/projected/f5ee9e34-c792-441b-ad31-ae46d318b88f-kube-api-access-kqxwj\") pod \"kuadrant-console-plugin-66b5774985-kl425\" (UID: \"f5ee9e34-c792-441b-ad31-ae46d318b88f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.524653 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.524607 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" Jul 19 16:50:07.655036 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.655011 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kl425"] Jul 19 16:50:07.656613 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:50:07.656583 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5ee9e34_c792_441b_ad31_ae46d318b88f.slice/crio-4d533c106ef3728d3ab835bbaa1ac69cc400167aba9593485a3ac942f7c3a8be WatchSource:0}: Error finding container 4d533c106ef3728d3ab835bbaa1ac69cc400167aba9593485a3ac942f7c3a8be: Status 404 returned error can't find the container with id 4d533c106ef3728d3ab835bbaa1ac69cc400167aba9593485a3ac942f7c3a8be Jul 19 16:50:07.736423 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:07.736397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" event={"ID":"f5ee9e34-c792-441b-ad31-ae46d318b88f","Type":"ContainerStarted","Data":"4d533c106ef3728d3ab835bbaa1ac69cc400167aba9593485a3ac942f7c3a8be"} Jul 19 16:50:22.762413 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:22.762378 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79cf86c7d8-lk58r" podUID="f76a104c-355b-450a-88c1-bf102fbf2828" containerName="console" containerID="cri-o://ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a" gracePeriod=15 Jul 19 16:50:24.525540 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:24.525500 2563 patch_prober.go:28] interesting pod/console-79cf86c7d8-lk58r container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused" start-of-body= Jul 19 16:50:24.526008 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:24.525569 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-79cf86c7d8-lk58r" podUID="f76a104c-355b-450a-88c1-bf102fbf2828" containerName="console" probeResult="failure" output="Get \"https://10.132.0.28:8443/health\": dial tcp 10.132.0.28:8443: connect: connection refused" Jul 19 16:50:28.007452 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.007433 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:50:28.060647 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060618 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-serving-cert\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.060783 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-oauth-serving-cert\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.060783 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060693 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-console-config\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.060918 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060799 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdn7f\" (UniqueName: \"kubernetes.io/projected/f76a104c-355b-450a-88c1-bf102fbf2828-kube-api-access-wdn7f\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.060918 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060832 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-oauth-config\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.060918 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060859 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-service-ca\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.060918 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060913 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-trusted-ca-bundle\") pod \"f76a104c-355b-450a-88c1-bf102fbf2828\" (UID: \"f76a104c-355b-450a-88c1-bf102fbf2828\") " Jul 19 16:50:28.061142 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.060979 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:50:28.061142 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.061052 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-console-config" (OuterVolumeSpecName: "console-config") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:50:28.061263 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.061243 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-service-ca" (OuterVolumeSpecName: "service-ca") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:50:28.061351 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.061334 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-oauth-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.061406 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.061358 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-console-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.061406 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.061373 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-service-ca\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.061406 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.061370 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 16:50:28.062755 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.062734 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:50:28.062836 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.062756 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 16:50:28.062836 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.062760 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76a104c-355b-450a-88c1-bf102fbf2828-kube-api-access-wdn7f" (OuterVolumeSpecName: "kube-api-access-wdn7f") pod "f76a104c-355b-450a-88c1-bf102fbf2828" (UID: "f76a104c-355b-450a-88c1-bf102fbf2828"). InnerVolumeSpecName "kube-api-access-wdn7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:50:28.161797 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.161751 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-serving-cert\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.161797 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.161770 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdn7f\" (UniqueName: \"kubernetes.io/projected/f76a104c-355b-450a-88c1-bf102fbf2828-kube-api-access-wdn7f\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.161797 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.161780 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f76a104c-355b-450a-88c1-bf102fbf2828-console-oauth-config\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.161797 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.161788 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f76a104c-355b-450a-88c1-bf102fbf2828-trusted-ca-bundle\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:50:28.862192 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.862162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" event={"ID":"f5ee9e34-c792-441b-ad31-ae46d318b88f","Type":"ContainerStarted","Data":"936e1c8dd137fb867922a2cccbd38bdf605acb77265c2ec5bb57e966daa0f4bf"} Jul 19 16:50:28.863389 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.863368 2563 generic.go:356] "Generic (PLEG): container finished" podID="f76a104c-355b-450a-88c1-bf102fbf2828" containerID="ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a" exitCode=0 Jul 19 16:50:28.863505 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.863401 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf86c7d8-lk58r" Jul 19 16:50:28.863505 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.863429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf86c7d8-lk58r" event={"ID":"f76a104c-355b-450a-88c1-bf102fbf2828","Type":"ContainerDied","Data":"ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a"} Jul 19 16:50:28.863505 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.863472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf86c7d8-lk58r" event={"ID":"f76a104c-355b-450a-88c1-bf102fbf2828","Type":"ContainerDied","Data":"b9afe535ddbb23efe193cfe9accf2b3556bbe63293e9776c64cff9682f81883e"} Jul 19 16:50:28.863505 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.863500 2563 scope.go:117] "RemoveContainer" containerID="ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a" Jul 19 16:50:28.878874 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.878823 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kl425" podStartSLOduration=1.587208808 podStartE2EDuration="21.878790495s" totalImagesPullingTime="20.291581687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:50:28.876737105 +0000 UTC m=+744.530629420" watchObservedRunningTime="2026-07-19 16:50:28.878790495 +0000 UTC m=+744.532682808" Jul 19 16:50:28.881310 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.881186 2563 scope.go:117] "RemoveContainer" containerID="ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a" Jul 19 16:50:28.881521 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:50:28.881498 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a\": container with ID starting with ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a not found: ID does not exist" containerID="ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a" Jul 19 16:50:28.881570 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.881539 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a"} err="failed to get container status \"ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a\": rpc error: code = NotFound desc = could not find container \"ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a\": container with ID starting with ff8193dbf2e28f876db36d81902d637de26edc9eb463f00259980b78cdf5665a not found: ID does not exist" Jul 19 16:50:28.893664 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.893640 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf86c7d8-lk58r"] Jul 19 16:50:28.897639 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:28.897619 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79cf86c7d8-lk58r"] Jul 19 16:50:30.832702 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:30.832669 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f76a104c-355b-450a-88c1-bf102fbf2828" path="/var/lib/kubelet/pods/f76a104c-355b-450a-88c1-bf102fbf2828/volumes" Jul 19 16:50:48.778313 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.778279 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:50:48.778692 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.778614 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f76a104c-355b-450a-88c1-bf102fbf2828" containerName="console" Jul 19 16:50:48.778692 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.778625 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f76a104c-355b-450a-88c1-bf102fbf2828" containerName="console" Jul 19 16:50:48.778762 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.778695 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f76a104c-355b-450a-88c1-bf102fbf2828" containerName="console" Jul 19 16:50:48.797385 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.797356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:50:48.797514 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.797475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:48.799823 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.799802 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 19 16:50:48.810700 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.810679 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:50:48.906020 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.905999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwf6\" (UniqueName: \"kubernetes.io/projected/5092f072-3aea-4b5e-90f8-d42e68cedd36-kube-api-access-4kwf6\") pod \"limitador-limitador-54d6d988d5-kg5j2\" (UID: \"5092f072-3aea-4b5e-90f8-d42e68cedd36\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:48.906113 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:48.906028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5092f072-3aea-4b5e-90f8-d42e68cedd36-config-file\") pod \"limitador-limitador-54d6d988d5-kg5j2\" (UID: \"5092f072-3aea-4b5e-90f8-d42e68cedd36\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:49.006574 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.006551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwf6\" (UniqueName: \"kubernetes.io/projected/5092f072-3aea-4b5e-90f8-d42e68cedd36-kube-api-access-4kwf6\") pod \"limitador-limitador-54d6d988d5-kg5j2\" (UID: \"5092f072-3aea-4b5e-90f8-d42e68cedd36\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:49.006660 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.006579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5092f072-3aea-4b5e-90f8-d42e68cedd36-config-file\") pod \"limitador-limitador-54d6d988d5-kg5j2\" (UID: \"5092f072-3aea-4b5e-90f8-d42e68cedd36\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:49.007150 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.007134 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5092f072-3aea-4b5e-90f8-d42e68cedd36-config-file\") pod \"limitador-limitador-54d6d988d5-kg5j2\" (UID: \"5092f072-3aea-4b5e-90f8-d42e68cedd36\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:49.015826 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.015799 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwf6\" (UniqueName: \"kubernetes.io/projected/5092f072-3aea-4b5e-90f8-d42e68cedd36-kube-api-access-4kwf6\") pod \"limitador-limitador-54d6d988d5-kg5j2\" (UID: \"5092f072-3aea-4b5e-90f8-d42e68cedd36\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:49.106751 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.106730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:49.233013 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.232991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:50:49.235248 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:50:49.235221 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5092f072_3aea_4b5e_90f8_d42e68cedd36.slice/crio-24d269c67e3c0bc252f4715fb9ea0e13e8ba4a825eb079691682fb907a59b0bf WatchSource:0}: Error finding container 24d269c67e3c0bc252f4715fb9ea0e13e8ba4a825eb079691682fb907a59b0bf: Status 404 returned error can't find the container with id 24d269c67e3c0bc252f4715fb9ea0e13e8ba4a825eb079691682fb907a59b0bf Jul 19 16:50:49.468205 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.468127 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z8sml"] Jul 19 16:50:49.497318 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.497289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:50:49.497458 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.497297 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z8sml"] Jul 19 16:50:49.499705 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.499688 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b9dtc\"" Jul 19 16:50:49.610010 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.609972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqfth\" (UniqueName: \"kubernetes.io/projected/dcdeb4ee-2237-4718-a128-c80ded0aaefe-kube-api-access-kqfth\") pod \"authorino-75d556bd77-z8sml\" (UID: \"dcdeb4ee-2237-4718-a128-c80ded0aaefe\") " pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:50:49.710775 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.710745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfth\" (UniqueName: \"kubernetes.io/projected/dcdeb4ee-2237-4718-a128-c80ded0aaefe-kube-api-access-kqfth\") pod \"authorino-75d556bd77-z8sml\" (UID: \"dcdeb4ee-2237-4718-a128-c80ded0aaefe\") " pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:50:49.718614 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.718565 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqfth\" (UniqueName: \"kubernetes.io/projected/dcdeb4ee-2237-4718-a128-c80ded0aaefe-kube-api-access-kqfth\") pod \"authorino-75d556bd77-z8sml\" (UID: \"dcdeb4ee-2237-4718-a128-c80ded0aaefe\") " pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:50:49.806231 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.806205 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:50:49.961484 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.961456 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z8sml"] Jul 19 16:50:49.963468 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:50:49.963434 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcdeb4ee_2237_4718_a128_c80ded0aaefe.slice/crio-18beec010c78aa40befb012ad9cd63cc904078131cc061900a1d91d4da448762 WatchSource:0}: Error finding container 18beec010c78aa40befb012ad9cd63cc904078131cc061900a1d91d4da448762: Status 404 returned error can't find the container with id 18beec010c78aa40befb012ad9cd63cc904078131cc061900a1d91d4da448762 Jul 19 16:50:49.978617 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.978549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" event={"ID":"5092f072-3aea-4b5e-90f8-d42e68cedd36","Type":"ContainerStarted","Data":"24d269c67e3c0bc252f4715fb9ea0e13e8ba4a825eb079691682fb907a59b0bf"} Jul 19 16:50:49.980022 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:49.979964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z8sml" event={"ID":"dcdeb4ee-2237-4718-a128-c80ded0aaefe","Type":"ContainerStarted","Data":"18beec010c78aa40befb012ad9cd63cc904078131cc061900a1d91d4da448762"} Jul 19 16:50:56.023627 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:56.023544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z8sml" event={"ID":"dcdeb4ee-2237-4718-a128-c80ded0aaefe","Type":"ContainerStarted","Data":"ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527"} Jul 19 16:50:56.025131 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:56.025108 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" event={"ID":"5092f072-3aea-4b5e-90f8-d42e68cedd36","Type":"ContainerStarted","Data":"58ce4376ab98e92dc9e6f2b4ec7edb7e47530f26f0bd51261f1c5bd2ee5bd9d6"} Jul 19 16:50:56.025238 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:56.025221 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:50:56.038456 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:56.038409 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z8sml" podStartSLOduration=1.369145864 podStartE2EDuration="7.038397995s" totalImagesPullingTime="5.669252131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:50:56.036296638 +0000 UTC m=+771.690188950" watchObservedRunningTime="2026-07-19 16:50:56.038397995 +0000 UTC m=+771.692290362" Jul 19 16:50:56.051554 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:50:56.051510 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" podStartSLOduration=1.646485266 podStartE2EDuration="8.051497756s" totalImagesPullingTime="6.40501249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:50:56.051132453 +0000 UTC m=+771.705024766" watchObservedRunningTime="2026-07-19 16:50:56.051497756 +0000 UTC m=+771.705390081" Jul 19 16:51:07.032816 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:07.032783 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kg5j2" Jul 19 16:51:25.570288 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:25.570256 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z8sml"] Jul 19 16:51:25.570673 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:25.570434 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z8sml" podUID="dcdeb4ee-2237-4718-a128-c80ded0aaefe" containerName="authorino" containerID="cri-o://ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527" gracePeriod=30 Jul 19 16:51:25.847353 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:25.847297 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:51:25.989208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:25.989181 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqfth\" (UniqueName: \"kubernetes.io/projected/dcdeb4ee-2237-4718-a128-c80ded0aaefe-kube-api-access-kqfth\") pod \"dcdeb4ee-2237-4718-a128-c80ded0aaefe\" (UID: \"dcdeb4ee-2237-4718-a128-c80ded0aaefe\") " Jul 19 16:51:25.991122 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:25.991093 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcdeb4ee-2237-4718-a128-c80ded0aaefe-kube-api-access-kqfth" (OuterVolumeSpecName: "kube-api-access-kqfth") pod "dcdeb4ee-2237-4718-a128-c80ded0aaefe" (UID: "dcdeb4ee-2237-4718-a128-c80ded0aaefe"). InnerVolumeSpecName "kube-api-access-kqfth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 16:51:26.090658 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.090636 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqfth\" (UniqueName: \"kubernetes.io/projected/dcdeb4ee-2237-4718-a128-c80ded0aaefe-kube-api-access-kqfth\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 16:51:26.179100 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.179043 2563 generic.go:356] "Generic (PLEG): container finished" podID="dcdeb4ee-2237-4718-a128-c80ded0aaefe" containerID="ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527" exitCode=0 Jul 19 16:51:26.179100 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.179088 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z8sml" Jul 19 16:51:26.179230 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.179134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z8sml" event={"ID":"dcdeb4ee-2237-4718-a128-c80ded0aaefe","Type":"ContainerDied","Data":"ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527"} Jul 19 16:51:26.179230 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.179174 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z8sml" event={"ID":"dcdeb4ee-2237-4718-a128-c80ded0aaefe","Type":"ContainerDied","Data":"18beec010c78aa40befb012ad9cd63cc904078131cc061900a1d91d4da448762"} Jul 19 16:51:26.179230 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.179189 2563 scope.go:117] "RemoveContainer" containerID="ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527" Jul 19 16:51:26.188346 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.188331 2563 scope.go:117] "RemoveContainer" containerID="ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527" Jul 19 16:51:26.188595 ip-10-0-135-68 kubenswrapper[2563]: E0719 16:51:26.188578 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527\": container with ID starting with ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527 not found: ID does not exist" containerID="ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527" Jul 19 16:51:26.188651 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.188603 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527"} err="failed to get container status \"ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527\": rpc error: code = NotFound desc = could not find container \"ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527\": container with ID starting with ad5534b85917e2b87a6b55ce55edfa961b1c462981124c45dec51c1042918527 not found: ID does not exist" Jul 19 16:51:26.201562 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.201539 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z8sml"] Jul 19 16:51:26.207046 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.207020 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z8sml"] Jul 19 16:51:26.832142 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:51:26.832113 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcdeb4ee-2237-4718-a128-c80ded0aaefe" path="/var/lib/kubelet/pods/dcdeb4ee-2237-4718-a128-c80ded0aaefe/volumes" Jul 19 16:52:06.368289 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:06.368255 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:52:28.044679 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.044649 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp"] Jul 19 16:52:28.045071 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.045055 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcdeb4ee-2237-4718-a128-c80ded0aaefe" containerName="authorino" Jul 19 16:52:28.045114 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.045076 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcdeb4ee-2237-4718-a128-c80ded0aaefe" containerName="authorino" Jul 19 16:52:28.045224 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.045210 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcdeb4ee-2237-4718-a128-c80ded0aaefe" containerName="authorino" Jul 19 16:52:28.049535 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.049519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.052208 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.052187 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 19 16:52:28.052329 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.052209 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kp5v5\"" Jul 19 16:52:28.053138 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.053117 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 19 16:52:28.053289 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.053268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 19 16:52:28.056584 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.056562 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp"] Jul 19 16:52:28.118520 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.118498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.118629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.118528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489396e3-fe98-417f-97de-f9794d3038b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.118629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.118548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf2lx\" (UniqueName: \"kubernetes.io/projected/489396e3-fe98-417f-97de-f9794d3038b4-kube-api-access-nf2lx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.118629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.118576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.118629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.118597 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.118629 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.118615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219502 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489396e3-fe98-417f-97de-f9794d3038b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2lx\" (UniqueName: \"kubernetes.io/projected/489396e3-fe98-417f-97de-f9794d3038b4-kube-api-access-nf2lx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219611 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219794 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219906 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219979 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219936 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.219979 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.219970 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.221681 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.221663 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489396e3-fe98-417f-97de-f9794d3038b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.221817 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.221798 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489396e3-fe98-417f-97de-f9794d3038b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.226284 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.226268 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf2lx\" (UniqueName: \"kubernetes.io/projected/489396e3-fe98-417f-97de-f9794d3038b4-kube-api-access-nf2lx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp\" (UID: \"489396e3-fe98-417f-97de-f9794d3038b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.361152 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.361101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:28.490843 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.490818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp"] Jul 19 16:52:28.491604 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:52:28.491576 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489396e3_fe98_417f_97de_f9794d3038b4.slice/crio-883e05b1b16d12ceda6998cf3c7aeb9802216db9ce7ee27e245525cb4fbcdcdb WatchSource:0}: Error finding container 883e05b1b16d12ceda6998cf3c7aeb9802216db9ce7ee27e245525cb4fbcdcdb: Status 404 returned error can't find the container with id 883e05b1b16d12ceda6998cf3c7aeb9802216db9ce7ee27e245525cb4fbcdcdb Jul 19 16:52:28.498806 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.498778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" event={"ID":"489396e3-fe98-417f-97de-f9794d3038b4","Type":"ContainerStarted","Data":"883e05b1b16d12ceda6998cf3c7aeb9802216db9ce7ee27e245525cb4fbcdcdb"} Jul 19 16:52:28.536775 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:28.536751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:52:30.511452 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:30.511421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" event={"ID":"489396e3-fe98-417f-97de-f9794d3038b4","Type":"ContainerStarted","Data":"f1fdb4d6b1f8369ccda9e18751f06a141ebe245db22914add43d20d69af009ad"} Jul 19 16:52:30.529920 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:30.529866 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" podStartSLOduration=1.379257648 podStartE2EDuration="2.529851747s" totalImagesPullingTime="1.150594099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:52:30.526759121 +0000 UTC m=+866.180651451" watchObservedRunningTime="2026-07-19 16:52:30.529851747 +0000 UTC m=+866.183744037" Jul 19 16:52:37.830859 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:37.830824 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:52:38.361795 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:38.361766 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:38.361967 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:38.361816 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:38.373798 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:38.373774 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:38.561552 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:38.561529 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp" Jul 19 16:52:48.234661 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:52:48.234630 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:53:05.936599 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:05.936569 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:53:08.547648 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:08.547617 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:53:08.547648 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:08.547639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:53:08.555122 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:08.555099 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:53:08.555289 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:08.555273 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:53:19.037727 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.037694 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r"] Jul 19 16:53:19.041200 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.041178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.043982 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.043959 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 19 16:53:19.052052 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.052032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r"] Jul 19 16:53:19.198823 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.198797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.198946 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.198830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4vl\" (UniqueName: \"kubernetes.io/projected/10d7ccf1-e18e-4df5-af17-182e57da67a1-kube-api-access-wt4vl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.198946 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.198862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.198946 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.198902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d7ccf1-e18e-4df5-af17-182e57da67a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.199091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.198988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.199091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.199011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300231 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300231 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4vl\" (UniqueName: \"kubernetes.io/projected/10d7ccf1-e18e-4df5-af17-182e57da67a1-kube-api-access-wt4vl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300387 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300387 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d7ccf1-e18e-4df5-af17-182e57da67a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300387 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300387 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300602 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300580 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300650 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300590 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.300700 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.300680 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.302369 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.302349 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d7ccf1-e18e-4df5-af17-182e57da67a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.302630 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.302615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d7ccf1-e18e-4df5-af17-182e57da67a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.307843 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.307822 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4vl\" (UniqueName: \"kubernetes.io/projected/10d7ccf1-e18e-4df5-af17-182e57da67a1-kube-api-access-wt4vl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d897r\" (UID: \"10d7ccf1-e18e-4df5-af17-182e57da67a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.352506 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.352487 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:19.482906 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.482862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r"] Jul 19 16:53:19.484554 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:53:19.484524 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d7ccf1_e18e_4df5_af17_182e57da67a1.slice/crio-0307f274653a9cfa589b048b65dc7e4023bc4f725cec152dde5dfd1d8386a3bc WatchSource:0}: Error finding container 0307f274653a9cfa589b048b65dc7e4023bc4f725cec152dde5dfd1d8386a3bc: Status 404 returned error can't find the container with id 0307f274653a9cfa589b048b65dc7e4023bc4f725cec152dde5dfd1d8386a3bc Jul 19 16:53:19.485795 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.485776 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 16:53:19.757625 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.757593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" event={"ID":"10d7ccf1-e18e-4df5-af17-182e57da67a1","Type":"ContainerStarted","Data":"08fa0ecd2938edbd176eb7007c4c9b11fa45f6c76ca200228efaad4fbb86e466"} Jul 19 16:53:19.757764 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.757648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" event={"ID":"10d7ccf1-e18e-4df5-af17-182e57da67a1","Type":"ContainerStarted","Data":"0307f274653a9cfa589b048b65dc7e4023bc4f725cec152dde5dfd1d8386a3bc"} Jul 19 16:53:19.774000 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:19.773957 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" podStartSLOduration=0.621250243 podStartE2EDuration="773.943549ms" totalImagesPullingTime="152.693306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:53:19.772803403 +0000 UTC m=+915.426695715" watchObservedRunningTime="2026-07-19 16:53:19.773943549 +0000 UTC m=+915.427835860" Jul 19 16:53:21.836607 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:21.836576 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:53:29.353118 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:29.353090 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:29.353478 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:29.353136 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:29.364663 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:29.364643 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:29.817482 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:29.817458 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d897r" Jul 19 16:53:38.536844 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:53:38.536812 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:54:56.319913 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.319867 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78fb74b97c-grfp8"] Jul 19 16:54:56.323374 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.323357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.327050 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.327024 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b9dtc\"" Jul 19 16:54:56.327200 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.327082 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 19 16:54:56.330413 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.329985 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fb74b97c-grfp8"] Jul 19 16:54:56.426227 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.426205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e89bb187-ecfe-4abe-a050-0c05ef2df97c-tls-cert\") pod \"authorino-78fb74b97c-grfp8\" (UID: \"e89bb187-ecfe-4abe-a050-0c05ef2df97c\") " pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.426329 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.426256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbglf\" (UniqueName: \"kubernetes.io/projected/e89bb187-ecfe-4abe-a050-0c05ef2df97c-kube-api-access-tbglf\") pod \"authorino-78fb74b97c-grfp8\" (UID: \"e89bb187-ecfe-4abe-a050-0c05ef2df97c\") " pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.527187 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.527169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbglf\" (UniqueName: \"kubernetes.io/projected/e89bb187-ecfe-4abe-a050-0c05ef2df97c-kube-api-access-tbglf\") pod \"authorino-78fb74b97c-grfp8\" (UID: \"e89bb187-ecfe-4abe-a050-0c05ef2df97c\") " pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.527281 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.527236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e89bb187-ecfe-4abe-a050-0c05ef2df97c-tls-cert\") pod \"authorino-78fb74b97c-grfp8\" (UID: \"e89bb187-ecfe-4abe-a050-0c05ef2df97c\") " pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.529551 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.529533 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e89bb187-ecfe-4abe-a050-0c05ef2df97c-tls-cert\") pod \"authorino-78fb74b97c-grfp8\" (UID: \"e89bb187-ecfe-4abe-a050-0c05ef2df97c\") " pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.534810 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.534790 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbglf\" (UniqueName: \"kubernetes.io/projected/e89bb187-ecfe-4abe-a050-0c05ef2df97c-kube-api-access-tbglf\") pod \"authorino-78fb74b97c-grfp8\" (UID: \"e89bb187-ecfe-4abe-a050-0c05ef2df97c\") " pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.633007 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.632964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fb74b97c-grfp8" Jul 19 16:54:56.757356 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:56.757333 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fb74b97c-grfp8"] Jul 19 16:54:56.759241 ip-10-0-135-68 kubenswrapper[2563]: W0719 16:54:56.759214 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode89bb187_ecfe_4abe_a050_0c05ef2df97c.slice/crio-fd48288d263cadada6e45686c40c222c319a351d7e3ef18bbeaf04ab57cb7777 WatchSource:0}: Error finding container fd48288d263cadada6e45686c40c222c319a351d7e3ef18bbeaf04ab57cb7777: Status 404 returned error can't find the container with id fd48288d263cadada6e45686c40c222c319a351d7e3ef18bbeaf04ab57cb7777 Jul 19 16:54:57.237395 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:57.237369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fb74b97c-grfp8" event={"ID":"e89bb187-ecfe-4abe-a050-0c05ef2df97c","Type":"ContainerStarted","Data":"fd48288d263cadada6e45686c40c222c319a351d7e3ef18bbeaf04ab57cb7777"} Jul 19 16:54:58.244697 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:58.244662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fb74b97c-grfp8" event={"ID":"e89bb187-ecfe-4abe-a050-0c05ef2df97c","Type":"ContainerStarted","Data":"11ed1d51d2d5d8156ad83fac77ed10ac3ccf9e315ce2db88b26f7cc5c45a3f7e"} Jul 19 16:54:58.261130 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:54:58.261078 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78fb74b97c-grfp8" podStartSLOduration=1.803127114 podStartE2EDuration="2.261063515s" totalImagesPullingTime="457.936401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 16:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 16:54:58.258647903 +0000 UTC m=+1013.912540431" watchObservedRunningTime="2026-07-19 16:54:58.261063515 +0000 UTC m=+1013.914955827" Jul 19 16:55:26.639183 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:55:26.639147 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:55:37.029433 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:55:37.029400 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:55:47.334249 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:55:47.334217 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:57:28.227070 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:57:28.226995 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:58:08.331859 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:08.331826 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:58:08.584655 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:08.584514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:58:08.587901 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:08.585123 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 16:58:08.592091 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:08.592072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:58:08.592512 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:08.592495 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 16:58:16.725603 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:16.725573 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:58:25.735939 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:25.735905 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:58:33.729727 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:33.729695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:58:42.934531 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:42.934497 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:58:53.235162 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:58:53.235129 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:59:06.145104 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:59:06.145069 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:59:16.229753 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:59:16.229720 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:59:37.329290 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:59:37.329254 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 16:59:46.529969 ip-10-0-135-68 kubenswrapper[2563]: I0719 16:59:46.529928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:00:09.334921 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:00:09.334874 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:00:20.331595 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:00:20.331561 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:00:36.635168 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:00:36.635130 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:00:46.339339 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:00:46.339299 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:00:55.838632 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:00:55.838597 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:01:06.038343 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:01:06.038310 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:01:15.734917 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:01:15.734867 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:03:02.438016 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:02.437982 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:03:08.626291 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:08.626192 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:03:08.631122 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:08.627875 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:03:08.633548 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:08.633527 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:03:08.635105 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:08.635089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:03:13.829282 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:13.829241 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:03:22.229983 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:22.229945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:03:33.538626 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:33.538551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:03:44.630478 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:44.630447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:03:55.931477 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:03:55.931438 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:04:06.138026 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:04:06.137991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:04:15.931403 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:04:15.931374 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:04:26.934366 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:04:26.934332 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:04:35.735421 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:04:35.735391 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:04:46.531909 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:04:46.531865 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:05:10.526419 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:05:10.526380 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:05:18.237956 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:05:18.237920 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:05:30.535642 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:05:30.535608 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:05:46.329931 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:05:46.329880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:06:11.433244 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:06:11.433206 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:06:27.532414 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:06:27.532329 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:06:35.436669 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:06:35.436634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:06:47.644654 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:06:47.644619 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:06:56.728678 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:06:56.728648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:07:05.631958 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:07:05.631928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:07:13.527541 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:07:13.527504 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:07:24.736490 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:07:24.736441 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:07:34.137852 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:07:34.137817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:07:48.027741 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:07:48.027706 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:07:56.428913 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:07:56.428870 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:08:05.931413 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:05.931378 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:08:08.666570 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:08.666462 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:08:08.672372 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:08.669994 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:08:08.674528 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:08.674509 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:08:08.677623 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:08.677605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:08:15.832604 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:15.832564 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:08:27.237186 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:27.237154 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:08:33.826290 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:33.826254 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:08:49.931271 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:08:49.931234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:09:02.135743 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:09:02.135714 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:09:14.733566 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:09:14.733534 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:09:23.430047 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:09:23.430014 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:09:45.028788 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:09:45.028711 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:10:01.432840 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:10:01.432809 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:10:31.834066 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:10:31.834033 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:10:43.633282 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:10:43.633244 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:11:16.029202 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:11:16.029170 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:11:26.937040 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:11:26.937007 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:11:59.730950 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:11:59.730918 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:12:13.232987 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:12:13.232960 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:12:44.031838 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:12:44.031765 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:13:08.704019 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:13:08.703920 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:13:08.708174 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:13:08.708038 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:13:08.711290 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:13:08.711272 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:13:08.715359 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:13:08.715343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:14:10.439011 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:14:10.438968 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:14:20.033308 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:14:20.033272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:14:29.532265 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:14:29.532228 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:14:40.436416 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:14:40.436378 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:14:55.233699 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:14:55.233664 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:15:32.635194 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:15:32.635115 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:15:44.929322 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:15:44.929286 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:16:05.829797 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:16:05.829761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:16:23.138279 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:16:23.138246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:16:33.933709 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:16:33.933676 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:18:08.739523 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:08.739414 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:18:08.745357 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:08.745337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:18:08.747696 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:08.747668 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:18:08.752991 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:08.752974 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:18:23.833951 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:23.833919 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:18:32.732962 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:32.732871 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:18:56.137187 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:18:56.137155 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:19:09.934091 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:19:09.934054 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:19:22.136168 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:19:22.136139 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:19:40.337274 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:19:40.337243 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:19:50.231713 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:19:50.231681 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:20:11.034158 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:20:11.034123 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:20:28.233110 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:20:28.233073 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:20:42.130349 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:20:42.130307 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:21:01.431052 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:21:01.431003 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:21:30.337708 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:21:30.337632 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:21:47.834282 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:21:47.834226 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:21:58.835204 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:21:58.835158 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:22:10.138532 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:22:10.138495 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:22:32.442387 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:22:32.442351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:22:57.832762 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:22:57.832684 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:23:08.779532 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:08.779419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:23:08.785580 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:08.785560 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:23:08.788318 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:08.788300 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:23:08.793541 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:08.793524 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:23:15.628089 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:15.628057 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:23:32.836805 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:32.836774 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:23:47.731817 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:23:47.731784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:24:07.136723 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:24:07.136691 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:24:23.840642 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:24:23.840613 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:24:36.835461 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:24:36.835386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:24:52.937537 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:24:52.937506 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:25:04.635987 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:25:04.635953 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:25:17.329040 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:25:17.329005 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:25:35.441915 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:25:35.440866 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:25:56.039639 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:25:56.039607 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:26:14.339813 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:26:14.339780 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:26:43.334048 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:26:43.334019 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:27:00.044412 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:00.044376 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:27:15.335069 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:15.335039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:27:25.049563 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.049528 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7448-139963577699888"] Jul 19 17:27:25.052947 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.052931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:25.055594 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.055565 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cm2bs\"" Jul 19 17:27:25.059498 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.059478 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577699888"] Jul 19 17:27:25.168658 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.168632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhfmc\" (UniqueName: \"kubernetes.io/projected/e4c54ffe-dc04-432e-865e-884fb02cb3eb-kube-api-access-bhfmc\") pod \"test-curl-7448-139963577699888\" (UID: \"e4c54ffe-dc04-432e-865e-884fb02cb3eb\") " pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:25.269410 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.269389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhfmc\" (UniqueName: \"kubernetes.io/projected/e4c54ffe-dc04-432e-865e-884fb02cb3eb-kube-api-access-bhfmc\") pod \"test-curl-7448-139963577699888\" (UID: \"e4c54ffe-dc04-432e-865e-884fb02cb3eb\") " pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:25.282012 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.278417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhfmc\" (UniqueName: \"kubernetes.io/projected/e4c54ffe-dc04-432e-865e-884fb02cb3eb-kube-api-access-bhfmc\") pod \"test-curl-7448-139963577699888\" (UID: \"e4c54ffe-dc04-432e-865e-884fb02cb3eb\") " pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:25.363049 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.362985 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:25.490243 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.490177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577699888"] Jul 19 17:27:25.492947 ip-10-0-135-68 kubenswrapper[2563]: W0719 17:27:25.492913 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4c54ffe_dc04_432e_865e_884fb02cb3eb.slice/crio-2cc990118d3b6097c7674c70c0bad71642a1dc57ccec71cac24d49b0a0fd5769 WatchSource:0}: Error finding container 2cc990118d3b6097c7674c70c0bad71642a1dc57ccec71cac24d49b0a0fd5769: Status 404 returned error can't find the container with id 2cc990118d3b6097c7674c70c0bad71642a1dc57ccec71cac24d49b0a0fd5769 Jul 19 17:27:25.494305 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.494282 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 17:27:25.523927 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:25.523872 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577699888" event={"ID":"e4c54ffe-dc04-432e-865e-884fb02cb3eb","Type":"ContainerStarted","Data":"2cc990118d3b6097c7674c70c0bad71642a1dc57ccec71cac24d49b0a0fd5769"} Jul 19 17:27:26.530934 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:26.530858 2563 generic.go:356] "Generic (PLEG): container finished" podID="e4c54ffe-dc04-432e-865e-884fb02cb3eb" containerID="434a90377f75dabc7b0fe11de7dc6034a2171296c69a5cc093734a21ec2f0069" exitCode=0 Jul 19 17:27:26.530934 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:26.530923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577699888" event={"ID":"e4c54ffe-dc04-432e-865e-884fb02cb3eb","Type":"ContainerDied","Data":"434a90377f75dabc7b0fe11de7dc6034a2171296c69a5cc093734a21ec2f0069"} Jul 19 17:27:27.668359 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.668331 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:27.702833 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.702813 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7448-139963577699888_e4c54ffe-dc04-432e-865e-884fb02cb3eb/test-curl-7448-139963577699888/0.log" Jul 19 17:27:27.727641 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.727618 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7448-139963577699888"] Jul 19 17:27:27.733338 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.733311 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7448-139963577699888"] Jul 19 17:27:27.791408 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.791354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhfmc\" (UniqueName: \"kubernetes.io/projected/e4c54ffe-dc04-432e-865e-884fb02cb3eb-kube-api-access-bhfmc\") pod \"e4c54ffe-dc04-432e-865e-884fb02cb3eb\" (UID: \"e4c54ffe-dc04-432e-865e-884fb02cb3eb\") " Jul 19 17:27:27.793384 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.793361 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c54ffe-dc04-432e-865e-884fb02cb3eb-kube-api-access-bhfmc" (OuterVolumeSpecName: "kube-api-access-bhfmc") pod "e4c54ffe-dc04-432e-865e-884fb02cb3eb" (UID: "e4c54ffe-dc04-432e-865e-884fb02cb3eb"). InnerVolumeSpecName "kube-api-access-bhfmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 17:27:27.852290 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.852263 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7448-139963577699504"] Jul 19 17:27:27.852643 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.852628 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c54ffe-dc04-432e-865e-884fb02cb3eb" containerName="test-curl-7448-139963577699888" Jul 19 17:27:27.852684 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.852644 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c54ffe-dc04-432e-865e-884fb02cb3eb" containerName="test-curl-7448-139963577699888" Jul 19 17:27:27.852735 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.852725 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4c54ffe-dc04-432e-865e-884fb02cb3eb" containerName="test-curl-7448-139963577699888" Jul 19 17:27:27.855697 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.855681 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:27.860244 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.860205 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577699504"] Jul 19 17:27:27.892630 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.892610 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhfmc\" (UniqueName: \"kubernetes.io/projected/e4c54ffe-dc04-432e-865e-884fb02cb3eb-kube-api-access-bhfmc\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 17:27:27.993698 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:27.993676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5k79\" (UniqueName: \"kubernetes.io/projected/edbd751e-d9db-4e50-9768-265202a97d45-kube-api-access-k5k79\") pod \"test-curl-7448-139963577699504\" (UID: \"edbd751e-d9db-4e50-9768-265202a97d45\") " pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:28.094859 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.094799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5k79\" (UniqueName: \"kubernetes.io/projected/edbd751e-d9db-4e50-9768-265202a97d45-kube-api-access-k5k79\") pod \"test-curl-7448-139963577699504\" (UID: \"edbd751e-d9db-4e50-9768-265202a97d45\") " pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:28.103136 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.103112 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5k79\" (UniqueName: \"kubernetes.io/projected/edbd751e-d9db-4e50-9768-265202a97d45-kube-api-access-k5k79\") pod \"test-curl-7448-139963577699504\" (UID: \"edbd751e-d9db-4e50-9768-265202a97d45\") " pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:28.166052 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.166027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:28.291182 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.291157 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577699504"] Jul 19 17:27:28.292497 ip-10-0-135-68 kubenswrapper[2563]: W0719 17:27:28.292470 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedbd751e_d9db_4e50_9768_265202a97d45.slice/crio-c67773d883ba8abf8fdb755c225f1fffaf869c8fd4bfdd526a3e6cfa92375d91 WatchSource:0}: Error finding container c67773d883ba8abf8fdb755c225f1fffaf869c8fd4bfdd526a3e6cfa92375d91: Status 404 returned error can't find the container with id c67773d883ba8abf8fdb755c225f1fffaf869c8fd4bfdd526a3e6cfa92375d91 Jul 19 17:27:28.543912 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.543879 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:28.544044 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.543929 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cc990118d3b6097c7674c70c0bad71642a1dc57ccec71cac24d49b0a0fd5769" Jul 19 17:27:28.545051 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.545024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577699504" event={"ID":"edbd751e-d9db-4e50-9768-265202a97d45","Type":"ContainerStarted","Data":"c67773d883ba8abf8fdb755c225f1fffaf869c8fd4bfdd526a3e6cfa92375d91"} Jul 19 17:27:28.554331 ip-10-0-135-68 kubenswrapper[2563]: E0719 17:27:28.554304 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7448-139963577699888\" is forbidden: User \"system:node:ip-10-0-135-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-68.ec2.internal' and this object" podUID="e4c54ffe-dc04-432e-865e-884fb02cb3eb" pod="opendatahub/test-curl-7448-139963577699888" Jul 19 17:27:28.832648 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:28.832593 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4c54ffe-dc04-432e-865e-884fb02cb3eb" path="/var/lib/kubelet/pods/e4c54ffe-dc04-432e-865e-884fb02cb3eb/volumes" Jul 19 17:27:29.559201 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:29.559165 2563 generic.go:356] "Generic (PLEG): container finished" podID="edbd751e-d9db-4e50-9768-265202a97d45" containerID="46fa0e57fdc9bc675bfc1e15b2b114a8c550f6c905e52181da548e4ec40fc506" exitCode=0 Jul 19 17:27:29.559370 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:29.559249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577699504" event={"ID":"edbd751e-d9db-4e50-9768-265202a97d45","Type":"ContainerDied","Data":"46fa0e57fdc9bc675bfc1e15b2b114a8c550f6c905e52181da548e4ec40fc506"} Jul 19 17:27:29.833431 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:29.833357 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:27:30.695544 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.695518 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:30.714420 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.714397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7448-139963577699504_edbd751e-d9db-4e50-9768-265202a97d45/test-curl-7448-139963577699504/0.log" Jul 19 17:27:30.739439 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.739417 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7448-139963577699504"] Jul 19 17:27:30.743232 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.743208 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7448-139963577699504"] Jul 19 17:27:30.820189 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.820131 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5k79\" (UniqueName: \"kubernetes.io/projected/edbd751e-d9db-4e50-9768-265202a97d45-kube-api-access-k5k79\") pod \"edbd751e-d9db-4e50-9768-265202a97d45\" (UID: \"edbd751e-d9db-4e50-9768-265202a97d45\") " Jul 19 17:27:30.822132 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.822105 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edbd751e-d9db-4e50-9768-265202a97d45-kube-api-access-k5k79" (OuterVolumeSpecName: "kube-api-access-k5k79") pod "edbd751e-d9db-4e50-9768-265202a97d45" (UID: "edbd751e-d9db-4e50-9768-265202a97d45"). InnerVolumeSpecName "kube-api-access-k5k79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 17:27:30.832581 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.832560 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edbd751e-d9db-4e50-9768-265202a97d45" path="/var/lib/kubelet/pods/edbd751e-d9db-4e50-9768-265202a97d45/volumes" Jul 19 17:27:30.905859 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.905840 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:30.906355 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.906336 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbd751e-d9db-4e50-9768-265202a97d45" containerName="test-curl-7448-139963577699504" Jul 19 17:27:30.906428 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.906357 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbd751e-d9db-4e50-9768-265202a97d45" containerName="test-curl-7448-139963577699504" Jul 19 17:27:30.906494 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.906481 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="edbd751e-d9db-4e50-9768-265202a97d45" containerName="test-curl-7448-139963577699504" Jul 19 17:27:30.909691 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.909674 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:30.914474 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.914448 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:30.921017 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:30.920998 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5k79\" (UniqueName: \"kubernetes.io/projected/edbd751e-d9db-4e50-9768-265202a97d45-kube-api-access-k5k79\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 17:27:31.021644 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.021619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6428x\" (UniqueName: \"kubernetes.io/projected/8dc1803b-1135-4f59-a051-b8c22900243f-kube-api-access-6428x\") pod \"test-curl-7448-139963577787568\" (UID: \"8dc1803b-1135-4f59-a051-b8c22900243f\") " pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:31.122814 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.122762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6428x\" (UniqueName: \"kubernetes.io/projected/8dc1803b-1135-4f59-a051-b8c22900243f-kube-api-access-6428x\") pod \"test-curl-7448-139963577787568\" (UID: \"8dc1803b-1135-4f59-a051-b8c22900243f\") " pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:31.130307 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.130283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6428x\" (UniqueName: \"kubernetes.io/projected/8dc1803b-1135-4f59-a051-b8c22900243f-kube-api-access-6428x\") pod \"test-curl-7448-139963577787568\" (UID: \"8dc1803b-1135-4f59-a051-b8c22900243f\") " pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:31.219527 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.219505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:31.345657 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.345633 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:31.347100 ip-10-0-135-68 kubenswrapper[2563]: W0719 17:27:31.347075 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dc1803b_1135_4f59_a051_b8c22900243f.slice/crio-79cb54bd7273672880025a5f581112ed169986e698c06a488c2ec6914db13882 WatchSource:0}: Error finding container 79cb54bd7273672880025a5f581112ed169986e698c06a488c2ec6914db13882: Status 404 returned error can't find the container with id 79cb54bd7273672880025a5f581112ed169986e698c06a488c2ec6914db13882 Jul 19 17:27:31.570634 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.570616 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577699504" Jul 19 17:27:31.570737 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.570643 2563 scope.go:117] "RemoveContainer" containerID="46fa0e57fdc9bc675bfc1e15b2b114a8c550f6c905e52181da548e4ec40fc506" Jul 19 17:27:31.571989 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:31.571963 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577787568" event={"ID":"8dc1803b-1135-4f59-a051-b8c22900243f","Type":"ContainerStarted","Data":"79cb54bd7273672880025a5f581112ed169986e698c06a488c2ec6914db13882"} Jul 19 17:27:32.578641 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:32.578604 2563 generic.go:356] "Generic (PLEG): container finished" podID="8dc1803b-1135-4f59-a051-b8c22900243f" containerID="22d45e6cf81746bfead13b6667699a8bf7d9403878a7e53dbaf9c9073693c108" exitCode=0 Jul 19 17:27:32.579077 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:32.578659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577787568" event={"ID":"8dc1803b-1135-4f59-a051-b8c22900243f","Type":"ContainerDied","Data":"22d45e6cf81746bfead13b6667699a8bf7d9403878a7e53dbaf9c9073693c108"} Jul 19 17:27:33.716009 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.715979 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:33.734699 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.734657 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7448-139963577787568_8dc1803b-1135-4f59-a051-b8c22900243f/test-curl-7448-139963577787568/0.log" Jul 19 17:27:33.757703 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.757669 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:33.761083 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.761061 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:33.845457 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.845404 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6428x\" (UniqueName: \"kubernetes.io/projected/8dc1803b-1135-4f59-a051-b8c22900243f-kube-api-access-6428x\") pod \"8dc1803b-1135-4f59-a051-b8c22900243f\" (UID: \"8dc1803b-1135-4f59-a051-b8c22900243f\") " Jul 19 17:27:33.847322 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.847301 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc1803b-1135-4f59-a051-b8c22900243f-kube-api-access-6428x" (OuterVolumeSpecName: "kube-api-access-6428x") pod "8dc1803b-1135-4f59-a051-b8c22900243f" (UID: "8dc1803b-1135-4f59-a051-b8c22900243f"). InnerVolumeSpecName "kube-api-access-6428x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 17:27:33.885589 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.885557 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:33.885924 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.885911 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dc1803b-1135-4f59-a051-b8c22900243f" containerName="test-curl-7448-139963577787568" Jul 19 17:27:33.885974 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.885926 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dc1803b-1135-4f59-a051-b8c22900243f" containerName="test-curl-7448-139963577787568" Jul 19 17:27:33.886009 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.885991 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dc1803b-1135-4f59-a051-b8c22900243f" containerName="test-curl-7448-139963577787568" Jul 19 17:27:33.888915 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.888901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:33.892900 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.892857 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:33.946337 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:33.946311 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6428x\" (UniqueName: \"kubernetes.io/projected/8dc1803b-1135-4f59-a051-b8c22900243f-kube-api-access-6428x\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 17:27:34.053227 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.047501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsv9v\" (UniqueName: \"kubernetes.io/projected/f6501028-e57c-403d-ab0c-89a365cfb1f1-kube-api-access-tsv9v\") pod \"test-curl-7448-139963577787568\" (UID: \"f6501028-e57c-403d-ab0c-89a365cfb1f1\") " pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:34.148577 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.148518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsv9v\" (UniqueName: \"kubernetes.io/projected/f6501028-e57c-403d-ab0c-89a365cfb1f1-kube-api-access-tsv9v\") pod \"test-curl-7448-139963577787568\" (UID: \"f6501028-e57c-403d-ab0c-89a365cfb1f1\") " pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:34.157015 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.156995 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsv9v\" (UniqueName: \"kubernetes.io/projected/f6501028-e57c-403d-ab0c-89a365cfb1f1-kube-api-access-tsv9v\") pod \"test-curl-7448-139963577787568\" (UID: \"f6501028-e57c-403d-ab0c-89a365cfb1f1\") " pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:34.199555 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.199526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:34.326720 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.326687 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:34.327891 ip-10-0-135-68 kubenswrapper[2563]: W0719 17:27:34.327857 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6501028_e57c_403d_ab0c_89a365cfb1f1.slice/crio-5f25e190e8650546424dc06a2c00a33de9679f8f6558319732e265be6d48f911 WatchSource:0}: Error finding container 5f25e190e8650546424dc06a2c00a33de9679f8f6558319732e265be6d48f911: Status 404 returned error can't find the container with id 5f25e190e8650546424dc06a2c00a33de9679f8f6558319732e265be6d48f911 Jul 19 17:27:34.590811 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.590776 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577787568" event={"ID":"f6501028-e57c-403d-ab0c-89a365cfb1f1","Type":"ContainerStarted","Data":"5f25e190e8650546424dc06a2c00a33de9679f8f6558319732e265be6d48f911"} Jul 19 17:27:34.591966 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.591951 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79cb54bd7273672880025a5f581112ed169986e698c06a488c2ec6914db13882" Jul 19 17:27:34.591966 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.591951 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:34.603815 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.603790 2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7448-139963577787568" oldPodUID="8dc1803b-1135-4f59-a051-b8c22900243f" podUID="f6501028-e57c-403d-ab0c-89a365cfb1f1" Jul 19 17:27:34.832943 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:34.832914 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dc1803b-1135-4f59-a051-b8c22900243f" path="/var/lib/kubelet/pods/8dc1803b-1135-4f59-a051-b8c22900243f/volumes" Jul 19 17:27:35.598541 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:35.598507 2563 generic.go:356] "Generic (PLEG): container finished" podID="f6501028-e57c-403d-ab0c-89a365cfb1f1" containerID="c9eb8aba900c0c110a6eef2e681e6fd1e9f379d9af6b3db158459cf4df403b66" exitCode=0 Jul 19 17:27:35.598682 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:35.598579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577787568" event={"ID":"f6501028-e57c-403d-ab0c-89a365cfb1f1","Type":"ContainerDied","Data":"c9eb8aba900c0c110a6eef2e681e6fd1e9f379d9af6b3db158459cf4df403b66"} Jul 19 17:27:36.741733 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.741707 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:36.760584 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.760558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7448-139963577787568_f6501028-e57c-403d-ab0c-89a365cfb1f1/test-curl-7448-139963577787568/0.log" Jul 19 17:27:36.785278 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.785255 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:36.790092 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.790070 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7448-139963577787568"] Jul 19 17:27:36.870328 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.870271 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsv9v\" (UniqueName: \"kubernetes.io/projected/f6501028-e57c-403d-ab0c-89a365cfb1f1-kube-api-access-tsv9v\") pod \"f6501028-e57c-403d-ab0c-89a365cfb1f1\" (UID: \"f6501028-e57c-403d-ab0c-89a365cfb1f1\") " Jul 19 17:27:36.872229 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.872204 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6501028-e57c-403d-ab0c-89a365cfb1f1-kube-api-access-tsv9v" (OuterVolumeSpecName: "kube-api-access-tsv9v") pod "f6501028-e57c-403d-ab0c-89a365cfb1f1" (UID: "f6501028-e57c-403d-ab0c-89a365cfb1f1"). InnerVolumeSpecName "kube-api-access-tsv9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 17:27:36.929847 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.929825 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7448-139963577788576"] Jul 19 17:27:36.930205 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.930193 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6501028-e57c-403d-ab0c-89a365cfb1f1" containerName="test-curl-7448-139963577787568" Jul 19 17:27:36.930252 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.930206 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6501028-e57c-403d-ab0c-89a365cfb1f1" containerName="test-curl-7448-139963577787568" Jul 19 17:27:36.930287 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.930271 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6501028-e57c-403d-ab0c-89a365cfb1f1" containerName="test-curl-7448-139963577787568" Jul 19 17:27:36.933083 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.933068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:36.939428 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.939408 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577788576"] Jul 19 17:27:36.971674 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:36.971652 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsv9v\" (UniqueName: \"kubernetes.io/projected/f6501028-e57c-403d-ab0c-89a365cfb1f1-kube-api-access-tsv9v\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 17:27:37.072504 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.072478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fht4\" (UniqueName: \"kubernetes.io/projected/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee-kube-api-access-5fht4\") pod \"test-curl-7448-139963577788576\" (UID: \"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee\") " pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:37.173566 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.173510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fht4\" (UniqueName: \"kubernetes.io/projected/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee-kube-api-access-5fht4\") pod \"test-curl-7448-139963577788576\" (UID: \"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee\") " pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:37.181366 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.181346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fht4\" (UniqueName: \"kubernetes.io/projected/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee-kube-api-access-5fht4\") pod \"test-curl-7448-139963577788576\" (UID: \"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee\") " pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:37.243307 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.243283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:37.380168 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.380144 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7448-139963577788576"] Jul 19 17:27:37.381454 ip-10-0-135-68 kubenswrapper[2563]: W0719 17:27:37.381427 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8db8d0f0_de2b_4cbc_9c62_0d6d26e73cee.slice/crio-27c647186d0f738f5da2f33f5c83e41e4aac1a69f0052708560adde6b9b4bd16 WatchSource:0}: Error finding container 27c647186d0f738f5da2f33f5c83e41e4aac1a69f0052708560adde6b9b4bd16: Status 404 returned error can't find the container with id 27c647186d0f738f5da2f33f5c83e41e4aac1a69f0052708560adde6b9b4bd16 Jul 19 17:27:37.609448 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.609428 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577787568" Jul 19 17:27:37.609448 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.609444 2563 scope.go:117] "RemoveContainer" containerID="c9eb8aba900c0c110a6eef2e681e6fd1e9f379d9af6b3db158459cf4df403b66" Jul 19 17:27:37.610909 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:37.610865 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577788576" event={"ID":"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee","Type":"ContainerStarted","Data":"27c647186d0f738f5da2f33f5c83e41e4aac1a69f0052708560adde6b9b4bd16"} Jul 19 17:27:38.619149 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:38.619122 2563 generic.go:356] "Generic (PLEG): container finished" podID="8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" containerID="58f899a02da0840bab701d7706065570249d1d0f97b014ed9b355f1dc04057a9" exitCode=0 Jul 19 17:27:38.619499 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:38.619209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7448-139963577788576" event={"ID":"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee","Type":"ContainerDied","Data":"58f899a02da0840bab701d7706065570249d1d0f97b014ed9b355f1dc04057a9"} Jul 19 17:27:38.832433 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:38.832402 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6501028-e57c-403d-ab0c-89a365cfb1f1" path="/var/lib/kubelet/pods/f6501028-e57c-403d-ab0c-89a365cfb1f1/volumes" Jul 19 17:27:39.746378 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.746357 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:39.766828 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.766796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7448-139963577788576_8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee/test-curl-7448-139963577788576/0.log" Jul 19 17:27:39.793520 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.793494 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7448-139963577788576"] Jul 19 17:27:39.797417 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.797396 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7448-139963577788576"] Jul 19 17:27:39.892048 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.891993 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fht4\" (UniqueName: \"kubernetes.io/projected/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee-kube-api-access-5fht4\") pod \"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee\" (UID: \"8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee\") " Jul 19 17:27:39.893908 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.893870 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee-kube-api-access-5fht4" (OuterVolumeSpecName: "kube-api-access-5fht4") pod "8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" (UID: "8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee"). InnerVolumeSpecName "kube-api-access-5fht4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 17:27:39.993870 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:39.993852 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fht4\" (UniqueName: \"kubernetes.io/projected/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee-kube-api-access-5fht4\") on node \"ip-10-0-135-68.ec2.internal\" DevicePath \"\"" Jul 19 17:27:40.631783 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:40.631751 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:40.631958 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:40.631805 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27c647186d0f738f5da2f33f5c83e41e4aac1a69f0052708560adde6b9b4bd16" Jul 19 17:27:40.640843 ip-10-0-135-68 kubenswrapper[2563]: E0719 17:27:40.640820 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7448-139963577788576\" is forbidden: User \"system:node:ip-10-0-135-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-68.ec2.internal' and this object" podUID="8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" pod="opendatahub/test-curl-7448-139963577788576" Jul 19 17:27:40.832735 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:40.832713 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" path="/var/lib/kubelet/pods/8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee/volumes" Jul 19 17:27:56.235696 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:27:56.235661 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:28:08.816629 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:08.816592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:28:08.822683 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:08.822662 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:28:08.824143 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:08.824118 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:28:08.830395 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:08.830376 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zpnh6_39f8cab8-38fa-4508-aa92-71604ed11526/ovn-acl-logging/0.log" Jul 19 17:28:18.330016 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:18.329977 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kg5j2"] Jul 19 17:28:27.478629 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:27.478595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78fb74b97c-grfp8_e89bb187-ecfe-4abe-a050-0c05ef2df97c/authorino/0.log" Jul 19 17:28:34.155596 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:34.155567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7db45576-vvlgl_1d99e8d4-d493-46b0-bbf8-8c7336b2bb33/copy-manifests/0.log" Jul 19 17:28:34.163282 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:34.163258 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7db45576-vvlgl_1d99e8d4-d493-46b0-bbf8-8c7336b2bb33/manager/0.log" Jul 19 17:28:35.755485 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:35.755458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5_a324e1ad-2620-427b-a764-44d9c994c0ff/extract/0.log" Jul 19 17:28:35.761300 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:35.761281 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5_a324e1ad-2620-427b-a764-44d9c994c0ff/util/0.log" Jul 19 17:28:35.767614 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:35.767595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5_a324e1ad-2620-427b-a764-44d9c994c0ff/pull/0.log" Jul 19 17:28:35.901971 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:35.901951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv_895057fd-c046-4eb8-b473-4022f72439e5/util/0.log" Jul 19 17:28:35.908095 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:35.908078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv_895057fd-c046-4eb8-b473-4022f72439e5/pull/0.log" Jul 19 17:28:35.914239 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:35.914224 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv_895057fd-c046-4eb8-b473-4022f72439e5/extract/0.log" Jul 19 17:28:36.040438 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.040420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5_f6702ff2-7add-490d-b707-f7edae762c44/pull/0.log" Jul 19 17:28:36.046709 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.046691 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5_f6702ff2-7add-490d-b707-f7edae762c44/extract/0.log" Jul 19 17:28:36.053317 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.053296 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5_f6702ff2-7add-490d-b707-f7edae762c44/util/0.log" Jul 19 17:28:36.172562 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.172543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms_ec288acd-fd10-444b-9fd7-7ef65a39d60d/extract/0.log" Jul 19 17:28:36.178636 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.178617 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms_ec288acd-fd10-444b-9fd7-7ef65a39d60d/util/0.log" Jul 19 17:28:36.184792 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.184777 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms_ec288acd-fd10-444b-9fd7-7ef65a39d60d/pull/0.log" Jul 19 17:28:36.306173 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.306126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78fb74b97c-grfp8_e89bb187-ecfe-4abe-a050-0c05ef2df97c/authorino/0.log" Jul 19 17:28:36.683684 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:36.683629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kl425_f5ee9e34-c792-441b-ad31-ae46d318b88f/kuadrant-console-plugin/0.log" Jul 19 17:28:37.076851 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:37.076834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kg5j2_5092f072-3aea-4b5e-90f8-d42e68cedd36/limitador/0.log" Jul 19 17:28:37.832167 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:37.832149 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf6466d9-57hst_97bb0578-7483-4fae-86d1-bc06644f983b/kube-auth-proxy/0.log" Jul 19 17:28:38.814386 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:38.814361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-j4msp_489396e3-fe98-417f-97de-f9794d3038b4/main/0.log" Jul 19 17:28:39.291602 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:39.291573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-d897r_10d7ccf1-e18e-4df5-af17-182e57da67a1/main/0.log" Jul 19 17:28:45.675310 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.675280 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6jsn/must-gather-xhhp8"] Jul 19 17:28:45.675680 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.675650 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" containerName="test-curl-7448-139963577788576" Jul 19 17:28:45.675680 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.675661 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" containerName="test-curl-7448-139963577788576" Jul 19 17:28:45.675760 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.675722 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8db8d0f0-de2b-4cbc-9c62-0d6d26e73cee" containerName="test-curl-7448-139963577788576" Jul 19 17:28:45.678948 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.678924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.685522 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.685501 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6jsn\"/\"default-dockercfg-xgbgc\"" Jul 19 17:28:45.686629 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.686611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6jsn\"/\"kube-root-ca.crt\"" Jul 19 17:28:45.686629 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.686625 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6jsn\"/\"openshift-service-ca.crt\"" Jul 19 17:28:45.708905 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.708856 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6jsn/must-gather-xhhp8"] Jul 19 17:28:45.779981 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.779952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6kgc\" (UniqueName: \"kubernetes.io/projected/9f09483f-f092-4ad0-b18d-b4631d9dbb81-kube-api-access-m6kgc\") pod \"must-gather-xhhp8\" (UID: \"9f09483f-f092-4ad0-b18d-b4631d9dbb81\") " pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.780096 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.780026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f09483f-f092-4ad0-b18d-b4631d9dbb81-must-gather-output\") pod \"must-gather-xhhp8\" (UID: \"9f09483f-f092-4ad0-b18d-b4631d9dbb81\") " pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.880679 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.880639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f09483f-f092-4ad0-b18d-b4631d9dbb81-must-gather-output\") pod \"must-gather-xhhp8\" (UID: \"9f09483f-f092-4ad0-b18d-b4631d9dbb81\") " pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.880815 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.880791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6kgc\" (UniqueName: \"kubernetes.io/projected/9f09483f-f092-4ad0-b18d-b4631d9dbb81-kube-api-access-m6kgc\") pod \"must-gather-xhhp8\" (UID: \"9f09483f-f092-4ad0-b18d-b4631d9dbb81\") " pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.880979 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.880965 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f09483f-f092-4ad0-b18d-b4631d9dbb81-must-gather-output\") pod \"must-gather-xhhp8\" (UID: \"9f09483f-f092-4ad0-b18d-b4631d9dbb81\") " pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.888346 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.888322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6kgc\" (UniqueName: \"kubernetes.io/projected/9f09483f-f092-4ad0-b18d-b4631d9dbb81-kube-api-access-m6kgc\") pod \"must-gather-xhhp8\" (UID: \"9f09483f-f092-4ad0-b18d-b4631d9dbb81\") " pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:45.988134 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:45.988077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6jsn/must-gather-xhhp8" Jul 19 17:28:46.112674 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:46.112638 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6jsn/must-gather-xhhp8"] Jul 19 17:28:46.114962 ip-10-0-135-68 kubenswrapper[2563]: W0719 17:28:46.114937 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f09483f_f092_4ad0_b18d_b4631d9dbb81.slice/crio-741922c6325a899295042eb02fbc3e8c564fb919bfa78a8b0d7ca923294ec02c WatchSource:0}: Error finding container 741922c6325a899295042eb02fbc3e8c564fb919bfa78a8b0d7ca923294ec02c: Status 404 returned error can't find the container with id 741922c6325a899295042eb02fbc3e8c564fb919bfa78a8b0d7ca923294ec02c Jul 19 17:28:46.967823 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:46.967788 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6jsn/must-gather-xhhp8" event={"ID":"9f09483f-f092-4ad0-b18d-b4631d9dbb81","Type":"ContainerStarted","Data":"741922c6325a899295042eb02fbc3e8c564fb919bfa78a8b0d7ca923294ec02c"} Jul 19 17:28:47.978349 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:47.978312 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6jsn/must-gather-xhhp8" event={"ID":"9f09483f-f092-4ad0-b18d-b4631d9dbb81","Type":"ContainerStarted","Data":"d402c2026f2679feff8d7b585eb983c788ba118b4081a25037a4105996b33f2c"} Jul 19 17:28:47.978823 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:47.978362 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6jsn/must-gather-xhhp8" event={"ID":"9f09483f-f092-4ad0-b18d-b4631d9dbb81","Type":"ContainerStarted","Data":"bb8df82d05db64315424747dd247f5b274daa71040f38eeef2e29811c97d5e85"} Jul 19 17:28:47.995768 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:47.995720 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6jsn/must-gather-xhhp8" podStartSLOduration=2.128290968 podStartE2EDuration="2.995705887s" totalImagesPullingTime="867.414919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 17:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 17:28:47.9921561 +0000 UTC m=+3043.646048411" watchObservedRunningTime="2026-07-19 17:28:47.995705887 +0000 UTC m=+3043.649598240" Jul 19 17:28:48.459441 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:48.459412 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s875t_1e921ab2-20e7-47e9-ae78-818c5afb27a0/global-pull-secret-syncer/0.log" Jul 19 17:28:48.581013 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:48.580979 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ms2gm_df21941b-9c93-489c-ac4f-f4ca4125c5da/konnectivity-agent/0.log" Jul 19 17:28:48.652760 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:48.652729 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-68.ec2.internal_56f0edff43ab05466ea8a52af03f54d8/haproxy/0.log" Jul 19 17:28:52.269145 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.269110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5_a324e1ad-2620-427b-a764-44d9c994c0ff/extract/0.log" Jul 19 17:28:52.291758 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.291726 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5_a324e1ad-2620-427b-a764-44d9c994c0ff/util/0.log" Jul 19 17:28:52.317232 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.317197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vggz5_a324e1ad-2620-427b-a764-44d9c994c0ff/pull/0.log" Jul 19 17:28:52.362093 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.362062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv_895057fd-c046-4eb8-b473-4022f72439e5/extract/0.log" Jul 19 17:28:52.382869 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.382833 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv_895057fd-c046-4eb8-b473-4022f72439e5/util/0.log" Jul 19 17:28:52.403156 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.403113 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwvrv_895057fd-c046-4eb8-b473-4022f72439e5/pull/0.log" Jul 19 17:28:52.428728 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.428699 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5_f6702ff2-7add-490d-b707-f7edae762c44/extract/0.log" Jul 19 17:28:52.449382 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.449358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5_f6702ff2-7add-490d-b707-f7edae762c44/util/0.log" Jul 19 17:28:52.472293 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.472259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736c6d5_f6702ff2-7add-490d-b707-f7edae762c44/pull/0.log" Jul 19 17:28:52.502105 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.502081 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms_ec288acd-fd10-444b-9fd7-7ef65a39d60d/extract/0.log" Jul 19 17:28:52.530143 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.530054 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms_ec288acd-fd10-444b-9fd7-7ef65a39d60d/util/0.log" Jul 19 17:28:52.549824 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.549800 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef169xms_ec288acd-fd10-444b-9fd7-7ef65a39d60d/pull/0.log" Jul 19 17:28:52.998721 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:52.998660 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78fb74b97c-grfp8_e89bb187-ecfe-4abe-a050-0c05ef2df97c/authorino/0.log" Jul 19 17:28:53.099178 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:53.099145 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kl425_f5ee9e34-c792-441b-ad31-ae46d318b88f/kuadrant-console-plugin/0.log" Jul 19 17:28:53.287664 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:53.287631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kg5j2_5092f072-3aea-4b5e-90f8-d42e68cedd36/limitador/0.log" Jul 19 17:28:55.019348 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.019318 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/alertmanager/0.log" Jul 19 17:28:55.045636 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.045597 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/config-reloader/0.log" Jul 19 17:28:55.068384 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.068348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/kube-rbac-proxy-web/0.log" Jul 19 17:28:55.091100 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.091057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/kube-rbac-proxy/0.log" Jul 19 17:28:55.112130 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.112094 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/kube-rbac-proxy-metric/0.log" Jul 19 17:28:55.132608 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.132579 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/prom-label-proxy/0.log" Jul 19 17:28:55.152002 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.151978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30f647eb-179d-4689-b3ab-95c94cc9d227/init-config-reloader/0.log" Jul 19 17:28:55.190261 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.190229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-c2zvg_9f3053a5-218b-4fa5-a949-5aa9eda51e92/cluster-monitoring-operator/0.log" Jul 19 17:28:55.325109 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.325077 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-gttd2_abd8e0b1-615c-46d6-810d-e53f9f9cab72/monitoring-plugin/0.log" Jul 19 17:28:55.525504 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.525473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgtz2_4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19/node-exporter/0.log" Jul 19 17:28:55.562832 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.562797 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgtz2_4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19/kube-rbac-proxy/0.log" Jul 19 17:28:55.592219 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.592126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgtz2_4a6ab4a9-451c-4a1b-9bc9-8fad3e5aad19/init-textfile/0.log" Jul 19 17:28:55.632687 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.632465 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-fm7n5_34fd31a6-c6fc-4c06-a803-15308dde199d/kube-rbac-proxy-main/0.log" Jul 19 17:28:55.657573 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.657542 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-fm7n5_34fd31a6-c6fc-4c06-a803-15308dde199d/kube-rbac-proxy-self/0.log" Jul 19 17:28:55.687573 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.686559 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-fm7n5_34fd31a6-c6fc-4c06-a803-15308dde199d/openshift-state-metrics/0.log" Jul 19 17:28:55.953557 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.953475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-2hzzx_61f569e5-51eb-44a8-a87a-fda4082184da/prometheus-operator-admission-webhook/0.log" Jul 19 17:28:55.985240 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:55.985204 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55b5ff4c6d-vsb88_78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e/telemeter-client/0.log" Jul 19 17:28:56.005621 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:56.005597 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55b5ff4c6d-vsb88_78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e/reload/0.log" Jul 19 17:28:56.027089 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:56.027057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55b5ff4c6d-vsb88_78005c5b-76ce-4252-9a6d-dd1a3bf3fe6e/kube-rbac-proxy/0.log" Jul 19 17:28:57.443739 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:57.443708 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-shdt6_64e05a95-a2ae-4ab0-a779-908e2f3b96f5/networking-console-plugin/0.log" Jul 19 17:28:58.002770 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.002731 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/1.log" Jul 19 17:28:58.008604 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.008539 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n5h7w_bd9c4f23-1131-4994-bab4-b004e9b73b82/console-operator/2.log" Jul 19 17:28:58.244313 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.244280 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r"] Jul 19 17:28:58.252355 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.252328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.257460 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.257388 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r"] Jul 19 17:28:58.422242 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.422188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-podres\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.422431 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.422286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkfx8\" (UniqueName: \"kubernetes.io/projected/0e9d7261-007c-4ce9-8477-0b8ae368acfd-kube-api-access-qkfx8\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.422431 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.422335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-proc\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.422431 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.422382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-lib-modules\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.422611 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.422453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-sys\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523361 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkfx8\" (UniqueName: \"kubernetes.io/projected/0e9d7261-007c-4ce9-8477-0b8ae368acfd-kube-api-access-qkfx8\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-proc\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-lib-modules\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-sys\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523544 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-proc\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523639 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-sys\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-podres\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523677 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-lib-modules\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.523812 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.523792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e9d7261-007c-4ce9-8477-0b8ae368acfd-podres\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.531950 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.531926 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkfx8\" (UniqueName: \"kubernetes.io/projected/0e9d7261-007c-4ce9-8477-0b8ae368acfd-kube-api-access-qkfx8\") pod \"perf-node-gather-daemonset-zrz8r\" (UID: \"0e9d7261-007c-4ce9-8477-0b8ae368acfd\") " pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.545850 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.545830 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86567854cc-nccwk_539d77b4-1e2a-41df-b26e-314a7e3a01cd/console/0.log" Jul 19 17:28:58.566519 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.566489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:58.587502 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.587430 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-8t6hl_8dacc8c4-6437-45c7-a03d-f6d3d8cde123/download-server/0.log" Jul 19 17:28:58.756734 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:58.756708 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r"] Jul 19 17:28:59.085411 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:59.085359 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" event={"ID":"0e9d7261-007c-4ce9-8477-0b8ae368acfd","Type":"ContainerStarted","Data":"c5eac44a9855694f14bc0d0939dfd9535584c84ef3a207e915498f347c4deb18"} Jul 19 17:28:59.085609 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:59.085428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" event={"ID":"0e9d7261-007c-4ce9-8477-0b8ae368acfd","Type":"ContainerStarted","Data":"dd40f786f079a608cbb676fdbb482c011bc75a49f797520cc1739521a29baec3"} Jul 19 17:28:59.085680 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:59.085645 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:28:59.102236 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:59.102175 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" podStartSLOduration=1.102153697 podStartE2EDuration="1.102153697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 17:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 17:28:59.099959372 +0000 UTC m=+3054.753851688" watchObservedRunningTime="2026-07-19 17:28:59.102153697 +0000 UTC m=+3054.756046009" Jul 19 17:28:59.240287 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:28:59.240257 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-rv5rl_a3e176c3-0778-4772-8fe0-c5a1e5740b54/volume-data-source-validator/0.log" Jul 19 17:29:00.188561 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:00.188532 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nr4dt_6231b743-d5e6-45d5-bff0-c7cf930c7b78/dns/0.log" Jul 19 17:29:00.207310 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:00.207282 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nr4dt_6231b743-d5e6-45d5-bff0-c7cf930c7b78/kube-rbac-proxy/0.log" Jul 19 17:29:00.363786 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:00.363759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-flxbd_124516d4-5d51-483b-b292-de29432d7797/dns-node-resolver/0.log" Jul 19 17:29:00.935540 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:00.935514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qd6rh_00631596-a145-4788-9027-5d7e8aa14929/node-ca/0.log" Jul 19 17:29:01.961129 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:01.961096 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf6466d9-57hst_97bb0578-7483-4fae-86d1-bc06644f983b/kube-auth-proxy/0.log" Jul 19 17:29:02.783079 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:02.783052 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxms8_ce83ca2b-2ea7-44f9-b123-04f1699eb702/serve-healthcheck-canary/0.log" Jul 19 17:29:03.248190 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:03.248114 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2lm2q_1173fe4d-4615-4e77-b0e8-65616a480cfd/insights-operator/0.log" Jul 19 17:29:03.250249 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:03.250225 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2lm2q_1173fe4d-4615-4e77-b0e8-65616a480cfd/insights-operator/1.log" Jul 19 17:29:03.337628 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:03.337589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gzlz_c78c4479-1c8f-45e5-a460-69b150b36cd6/kube-rbac-proxy/0.log" Jul 19 17:29:03.358434 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:03.358407 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gzlz_c78c4479-1c8f-45e5-a460-69b150b36cd6/exporter/0.log" Jul 19 17:29:03.379503 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:03.379477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gzlz_c78c4479-1c8f-45e5-a460-69b150b36cd6/extractor/0.log" Jul 19 17:29:05.105029 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:05.104997 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6jsn/perf-node-gather-daemonset-zrz8r" Jul 19 17:29:05.972490 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:05.972465 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7db45576-vvlgl_1d99e8d4-d493-46b0-bbf8-8c7336b2bb33/manager/0.log" Jul 19 17:29:05.991638 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:05.991612 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7db45576-vvlgl_1d99e8d4-d493-46b0-bbf8-8c7336b2bb33/copy-manifests/0.log" Jul 19 17:29:07.261667 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:07.261625 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dffb557f4-v52m6_63495359-00cc-4d29-9d24-cc3b44cd0392/manager/0.log" Jul 19 17:29:08.297875 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:08.297846 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf6466d9-57hst_97bb0578-7483-4fae-86d1-bc06644f983b/kube-auth-proxy/0.log" Jul 19 17:29:09.612492 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:09.612409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdf6466d9-57hst_97bb0578-7483-4fae-86d1-bc06644f983b/kube-auth-proxy/0.log" Jul 19 17:29:12.234337 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:12.234307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jws68_b473e724-73a8-45ae-b36d-e0bdb2957e71/migrator/0.log" Jul 19 17:29:12.253923 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:12.253899 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jws68_b473e724-73a8-45ae-b36d-e0bdb2957e71/graceful-termination/0.log" Jul 19 17:29:12.587793 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:12.587763 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-v5b8m_c6f99975-9b7b-430d-bc70-d430b47e89cc/kube-storage-version-migrator-operator/1.log" Jul 19 17:29:12.588439 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:12.588420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-v5b8m_c6f99975-9b7b-430d-bc70-d430b47e89cc/kube-storage-version-migrator-operator/0.log" Jul 19 17:29:13.475624 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.475594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/kube-multus-additional-cni-plugins/0.log" Jul 19 17:29:13.496009 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.495983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/egress-router-binary-copy/0.log" Jul 19 17:29:13.514582 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.514563 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/cni-plugins/0.log" Jul 19 17:29:13.532581 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.532560 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/bond-cni-plugin/0.log" Jul 19 17:29:13.552703 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.552683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/routeoverride-cni/0.log" Jul 19 17:29:13.571183 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.571164 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/whereabouts-cni-bincopy/0.log" Jul 19 17:29:13.589027 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.589012 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvz5g_18d09047-630d-4ecb-ac4a-0377506463a1/whereabouts-cni/0.log" Jul 19 17:29:13.966398 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:13.966365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v577f_fccb1785-7a2f-466f-a24f-dff097b59069/kube-multus/0.log" Jul 19 17:29:14.026673 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:14.026646 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x6wk4_7137a64a-214b-414e-8b44-ac2dd29b37ed/network-metrics-daemon/0.log" Jul 19 17:29:14.048809 ip-10-0-135-68 kubenswrapper[2563]: I0719 17:29:14.048778 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x6wk4_7137a64a-214b-414e-8b44-ac2dd29b37ed/kube-rbac-proxy/0.log"