Jul 07 18:47:41.524747 ip-10-0-140-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 18:47:41.524760 ip-10-0-140-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 18:47:41.524769 ip-10-0-140-153 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 18:47:41.524980 ip-10-0-140-153 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 18:47:51.537473 ip-10-0-140-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 18:47:51.537490 ip-10-0-140-153 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3a2d7f4f08df4be699f2bd5cc99a928b -- Jul 07 18:49:26.765050 ip-10-0-140-153 systemd[1]: Starting Kubernetes Kubelet... Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.197526 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204198 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204213 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204217 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204220 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204223 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204226 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204229 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:27.335458 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204232 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204234 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204239 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204243 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204247 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204250 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204253 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204256 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204259 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204261 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204264 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204269 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204272 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204275 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204278 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204281 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204283 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204286 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204288 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204291 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:27.338185 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204293 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:27.274988 ip-10-0-140-153 systemd[1]: Started Kubernetes Kubelet. Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204296 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204298 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204301 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204304 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204306 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204309 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204311 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204314 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204317 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204319 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204321 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204324 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204326 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204330 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204333 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204337 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204340 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204342 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:27.364740 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204345 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204348 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204351 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204353 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204357 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204359 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204362 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204365 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204368 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204370 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204373 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204376 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204378 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204380 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204383 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204386 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204389 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204392 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204396 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:27.498093 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204400 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204402 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204405 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204408 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204410 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204413 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204415 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204418 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204420 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204423 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204426 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204429 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204432 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204434 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204437 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204441 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204443 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204446 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204449 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204452 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:27.499177 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204454 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204457 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204459 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204462 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204465 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204467 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204470 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204472 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204475 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204478 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204480 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204483 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204486 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.204488 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205177 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205184 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205187 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205190 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205193 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205196 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:27.500228 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205198 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205201 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205204 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205206 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205209 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205212 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205214 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205217 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205219 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205222 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205225 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205228 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205230 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205233 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205235 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205237 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205240 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205242 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205245 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205247 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:27.501290 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205250 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205253 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205255 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205257 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205260 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205262 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205265 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205267 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205270 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205273 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205276 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205278 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205281 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205283 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205285 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205288 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205290 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205293 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205295 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205297 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:27.502602 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205300 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205302 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205304 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205307 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205311 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205313 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205318 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205322 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205325 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205327 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205330 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205333 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205336 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205339 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205341 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205344 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205346 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205349 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205351 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:27.503658 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205353 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205356 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205361 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205364 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205367 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205370 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205373 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205377 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205379 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205382 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205384 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205387 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205390 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205394 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205397 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205400 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205403 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205405 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205408 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:27.505145 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205411 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205414 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205417 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205420 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205422 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205425 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205427 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205430 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205432 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205435 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205437 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205440 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205442 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205445 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205448 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205842 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205849 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205852 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205856 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:27.505995 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205859 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205862 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205867 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205870 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205872 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205875 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205877 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205880 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205882 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205885 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205887 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205890 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205893 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205898 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205901 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205904 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205906 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205909 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205913 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205915 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:27.506901 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205917 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205920 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205923 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205925 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205928 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205930 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205933 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205935 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205938 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205940 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205943 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205945 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205948 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205950 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205958 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205960 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205962 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205965 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205967 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205970 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:27.508141 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205972 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205975 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205978 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205980 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205983 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205987 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205989 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205992 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205994 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205996 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.205999 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206001 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206004 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206007 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206009 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206011 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206014 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206016 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206019 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206021 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:27.509198 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206025 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206028 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206030 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206033 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206035 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206038 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206043 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206047 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206050 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206052 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206055 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206057 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206060 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206063 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206065 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206067 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206070 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206073 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206076 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206079 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:27.510023 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206081 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206083 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206086 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206088 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206091 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206093 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206096 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206098 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206100 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206103 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206105 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206108 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206110 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206112 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206114 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206191 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206202 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206211 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206220 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206226 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206231 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 18:49:27.511095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206236 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206240 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206243 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206246 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206250 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206253 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206256 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206259 2560 flags.go:64] FLAG: --cgroup-root="" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206262 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206265 2560 flags.go:64] FLAG: --client-ca-file="" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206269 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206272 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206276 2560 flags.go:64] FLAG: --cluster-domain="" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206278 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206281 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206284 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206287 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206291 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206294 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206297 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206300 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206303 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206306 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206308 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 18:49:27.511963 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206311 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206314 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206318 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206322 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206325 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206329 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206332 2560 flags.go:64] FLAG: --enable-server="true" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206335 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206343 2560 flags.go:64] FLAG: --event-burst="100" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206346 2560 flags.go:64] FLAG: --event-qps="50" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206349 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206352 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206355 2560 flags.go:64] FLAG: --eviction-hard="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206358 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206361 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206364 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206368 2560 flags.go:64] FLAG: --eviction-soft="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206371 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206374 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206377 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206380 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206390 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206393 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206396 2560 flags.go:64] FLAG: --feature-gates="" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206400 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 18:49:27.513059 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206403 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206406 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206409 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206412 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206415 2560 flags.go:64] FLAG: --help="false" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206418 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206421 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206423 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206426 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206429 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206432 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206435 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206439 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206442 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206445 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206447 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206450 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206453 2560 flags.go:64] FLAG: --kube-reserved="" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206456 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206459 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206461 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206464 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206467 2560 flags.go:64] FLAG: --lock-file="" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206471 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 18:49:27.514124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206474 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206477 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206482 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206485 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206488 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206490 2560 flags.go:64] FLAG: --logging-format="text" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206493 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206496 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206499 2560 flags.go:64] FLAG: --manifest-url="" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206502 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206506 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206509 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206512 2560 flags.go:64] FLAG: --max-pods="110" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206515 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206518 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206520 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206523 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206526 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206528 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206531 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206540 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206542 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206545 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 18:49:27.515211 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206549 2560 flags.go:64] FLAG: --pod-cidr="" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206551 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206556 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206559 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206562 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206564 2560 flags.go:64] FLAG: --port="10250" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206567 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206570 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a266b5c7c4f7923e" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206573 2560 flags.go:64] FLAG: --qos-reserved="" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206577 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206580 2560 flags.go:64] FLAG: --register-node="true" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206583 2560 flags.go:64] FLAG: --register-with-taints="" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206587 2560 flags.go:64] FLAG: --registry-burst="10" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206590 2560 flags.go:64] FLAG: --registry-qps="5" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206593 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206596 2560 flags.go:64] FLAG: --reserved-memory="" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206600 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206603 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206606 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206609 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206611 2560 flags.go:64] FLAG: --runonce="false" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206614 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206617 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206620 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206622 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 18:49:27.518598 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206625 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206628 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206631 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206633 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206638 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206640 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206643 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206645 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206648 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206651 2560 flags.go:64] FLAG: --system-cgroups="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206654 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206659 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206661 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206664 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206671 2560 flags.go:64] FLAG: --tls-min-version="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206673 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206677 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206680 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206683 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206685 2560 flags.go:64] FLAG: --v="2" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206689 2560 flags.go:64] FLAG: --version="false" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206693 2560 flags.go:64] FLAG: --vmodule="" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206701 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.206704 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 18:49:27.519685 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206832 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206835 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206838 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206841 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206843 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206846 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206849 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206852 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206854 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206857 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206859 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206862 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206866 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206869 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206871 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206874 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206876 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206878 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206881 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206884 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:27.526240 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206886 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206888 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206891 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206893 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206897 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206900 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206903 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206905 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206908 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206910 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206913 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206916 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206918 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206921 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206924 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206926 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206929 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206931 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206934 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206936 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:27.526827 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206939 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206942 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206946 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206949 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206953 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206955 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206958 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206960 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206964 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206967 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206970 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206973 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206976 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206978 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206981 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206983 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206987 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206989 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206992 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:27.527363 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206994 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.206997 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207000 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207002 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207006 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207008 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207010 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207013 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207015 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207017 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207020 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207022 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207024 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207027 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207029 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207032 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207034 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207038 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207040 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207043 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:27.527994 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207045 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207048 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207051 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207053 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207055 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207058 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207060 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207064 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207067 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207070 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207073 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207076 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207079 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207082 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207084 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207087 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207089 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207092 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207094 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:27.528509 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.207097 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.208028 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.215308 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.215323 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.215344 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.215349 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215407 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215412 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215415 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215418 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215422 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215425 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215428 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215431 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:27.529098 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215434 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215437 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215439 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215442 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215444 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215447 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215449 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215452 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215455 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215457 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215460 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215463 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215465 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215468 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215470 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215473 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215478 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215482 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215485 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215488 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:27.529483 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215490 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215493 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215495 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215498 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215500 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215503 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215505 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215508 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215510 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215513 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215518 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215521 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215523 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215526 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215528 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215531 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215534 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215536 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215539 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:27.693494 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215541 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215543 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215547 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215549 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215552 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215554 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215557 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215559 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215562 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215564 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215567 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215570 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215573 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215575 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215578 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215580 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215583 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215586 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215588 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215590 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:27.694476 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215593 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215597 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215599 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215605 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215608 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215611 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215614 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215616 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215619 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215622 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215625 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215627 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215630 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215632 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215635 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215637 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215639 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215642 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215644 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:27.695542 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215646 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215649 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215651 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215654 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215657 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215659 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215661 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215664 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215666 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215670 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215673 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215676 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215679 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.215684 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:49:27.696394 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215824 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215830 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215834 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215838 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215841 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215844 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215846 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215849 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215852 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215855 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215857 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215860 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215862 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215865 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215867 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215870 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215873 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215875 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215878 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215880 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:27.697039 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215883 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215885 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215888 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215891 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215893 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215896 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215898 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215901 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215903 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215906 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215908 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215910 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215914 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215917 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215919 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215923 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215926 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215928 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215931 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:27.698100 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215933 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215935 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215938 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215940 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215943 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215945 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215947 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215950 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215952 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215955 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215957 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215960 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215962 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215964 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215967 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215969 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215972 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215975 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215978 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215980 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:27.698960 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215983 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215985 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215988 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215990 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215993 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215996 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.215999 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216001 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216004 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216007 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216009 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216013 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216016 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216019 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216022 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216025 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216027 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216030 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216032 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:27.699839 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216034 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216037 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216039 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216042 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216044 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216048 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216051 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216054 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216057 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216059 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216062 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216064 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216067 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216069 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216072 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216074 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216076 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216079 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216082 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216085 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:27.700671 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:27.216087 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.216092 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.216195 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.218561 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.220332 2560 server.go:1019] "Starting client certificate rotation" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.220432 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.220470 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.224958 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.229426 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.236113 2560 log.go:25] "Validated CRI v1 runtime API" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.238509 2560 log.go:25] "Validated CRI v1 image API" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.242009 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 18:49:27.701538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.245274 2560 fs.go:135] Filesystem UUIDs: map[23588b4d-6e43-45e4-a078-f52f3052e416:/dev/nvme0n1p4 2c72f4cf-3712-4c8f-bde7-9b6d009ae87b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 18:49:27.702173 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.245289 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.249365 2560 manager.go:216] Machine: {Timestamp:2026-07-07 18:49:27.248932254 +0000 UTC m=+0.376289398 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199271 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e6515ef65a6cd5def57d95a689016 SystemUUID:ec2e6515-ef65-a6cd-5def-57d95a689016 BootID:3a2d7f4f-08df-4be6-99f2-bd5cc99a928b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:41:2a:30:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:41:2a:30:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:4f:4f:ad:17:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.249457 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.249549 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.253092 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.253124 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.253963 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.253974 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 18:49:27.702399 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.254005 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.254007 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.254638 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.256604 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261227 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261336 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261365 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261377 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261391 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261399 2560 kubelet.go:398] "Adding apiserver pod source" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261408 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261708 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.261722 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.264090 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.266405 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.266432 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267878 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267895 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267902 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267909 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267919 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267927 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267937 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267942 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267949 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267954 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267963 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267967 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267991 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.267996 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.274080 2560 server.go:1268] "Started kubelet" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.274181 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.274366 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.274454 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.275194 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.275198 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.275291 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.275693 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.276595 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 18:49:27.702845 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.280357 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.282499 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-153.ec2.internal.18c0167a5efa9245 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-153.ec2.internal,UID:ip-10-0-140-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-153.ec2.internal,},FirstTimestamp:2026-07-07 18:49:27.274017349 +0000 UTC m=+0.401374493,LastTimestamp:2026-07-07 18:49:27.274017349 +0000 UTC m=+0.401374493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-153.ec2.internal,}" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.287886 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.287900 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.289923 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290614 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290628 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290614 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290749 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290754 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290760 2560 factory.go:153] Registering CRI-O factory Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290775 2560 factory.go:223] Registration of the crio container factory successfully Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290839 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290848 2560 factory.go:55] Registering systemd factory Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290854 2560 factory.go:223] Registration of the systemd container factory successfully Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290869 2560 factory.go:103] Registering Raw factory Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.290877 2560 manager.go:1196] Started watching for new ooms in manager Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.291247 2560 manager.go:349] Starting recovery of all containers Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.299782 2560 manager.go:354] Recovery completed Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.300379 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.300468 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.303787 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.305472 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.305497 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.305512 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306038 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306048 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306063 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306102 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306713 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306734 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.306744 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.308329 2560 policy_none.go:49] "None policy: Start" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.308340 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 18:49:27.706640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.308349 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.308570 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brb6v" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.310422 2560 policy_none.go:47] "Start" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.314581 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-153.ec2.internal.18c0167a60dac1d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-153.ec2.internal,UID:ip-10-0-140-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-153.ec2.internal,},FirstTimestamp:2026-07-07 18:49:27.305486809 +0000 UTC m=+0.432843959,LastTimestamp:2026-07-07 18:49:27.305486809 +0000 UTC m=+0.432843959,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-153.ec2.internal,}" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.316541 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-153.ec2.internal.18c0167a60db0569 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-153.ec2.internal,UID:ip-10-0-140-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-153.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-153.ec2.internal,},FirstTimestamp:2026-07-07 18:49:27.305504105 +0000 UTC m=+0.432861249,LastTimestamp:2026-07-07 18:49:27.305504105 +0000 UTC m=+0.432861249,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-153.ec2.internal,}" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.322956 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brb6v" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.324105 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-153.ec2.internal.18c0167a60db361a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-153.ec2.internal,UID:ip-10-0-140-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-153.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-153.ec2.internal,},FirstTimestamp:2026-07-07 18:49:27.30551657 +0000 UTC m=+0.432873714,LastTimestamp:2026-07-07 18:49:27.30551657 +0000 UTC m=+0.432873714,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-153.ec2.internal,}" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378313 2560 manager.go:337] "Starting Device Plugin manager" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.378338 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378347 2560 server.go:87] "Starting device plugin registration server" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378537 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378554 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378647 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378733 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.378742 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.379187 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.379234 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.427650 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.428849 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.428885 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 18:49:27.708146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.428905 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.428939 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.431218 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.479154 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.479932 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.479955 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.479970 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.479994 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.493472 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.493487 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-153.ec2.internal\": node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.529940 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal"] Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.529989 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.531209 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.531227 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.531235 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.533403 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.533563 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.533625 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.534138 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.534154 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.534164 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.534480 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.534499 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.534513 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.536349 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.536376 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.537024 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.537052 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.537066 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.570309 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-153.ec2.internal\" not found" node="ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.577911 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-153.ec2.internal\" not found" node="ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.714872 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.587058 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.593269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500fd99c86edfb54db753b6440957a3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal\" (UID: \"500fd99c86edfb54db753b6440957a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.593289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/407ab6e563598eecc05b9012141a51c0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-153.ec2.internal\" (UID: \"407ab6e563598eecc05b9012141a51c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.593307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/500fd99c86edfb54db753b6440957a3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal\" (UID: \"500fd99c86edfb54db753b6440957a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.687400 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.714915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500fd99c86edfb54db753b6440957a3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal\" (UID: \"500fd99c86edfb54db753b6440957a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.714945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/407ab6e563598eecc05b9012141a51c0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-153.ec2.internal\" (UID: \"407ab6e563598eecc05b9012141a51c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.714973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/500fd99c86edfb54db753b6440957a3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal\" (UID: \"500fd99c86edfb54db753b6440957a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.715011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500fd99c86edfb54db753b6440957a3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal\" (UID: \"500fd99c86edfb54db753b6440957a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.715024 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/500fd99c86edfb54db753b6440957a3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal\" (UID: \"500fd99c86edfb54db753b6440957a3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.715833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.715014 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/407ab6e563598eecc05b9012141a51c0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-153.ec2.internal\" (UID: \"407ab6e563598eecc05b9012141a51c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.888487 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.788258 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:27.888487 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.873753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.888487 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:27.881647 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" Jul 07 18:49:27.888710 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.888544 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:28.080567 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:27.989008 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:28.284115 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:28.089463 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:28.284115 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.167674 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:28.284115 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:28.190276 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:28.284115 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.219634 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 18:49:28.284115 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.219762 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 18:49:28.284115 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.219794 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 18:49:28.291055 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:28.290521 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-153.ec2.internal\" not found" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.326254 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:44:28 +0000 UTC" deadline="2027-12-31 21:26:41.176690597 +0000 UTC" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.326274 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13010h37m12.850418987s" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.369694 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.374340 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.391058 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.405545 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.406521 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" Jul 07 18:49:28.477784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:28.418694 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 18:49:30.270358 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:30.117853 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500fd99c86edfb54db753b6440957a3f.slice/crio-42d76d835205c528385a85c4210510750b11b8f0eff1568c1dbda3761339c130 WatchSource:0}: Error finding container 42d76d835205c528385a85c4210510750b11b8f0eff1568c1dbda3761339c130: Status 404 returned error can't find the container with id 42d76d835205c528385a85c4210510750b11b8f0eff1568c1dbda3761339c130 Jul 07 18:49:30.270358 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:30.118309 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407ab6e563598eecc05b9012141a51c0.slice/crio-a2abf7437a57d5fe7079be651cd6f83feec65451370b9b49b11041be4cb550a2 WatchSource:0}: Error finding container a2abf7437a57d5fe7079be651cd6f83feec65451370b9b49b11041be4cb550a2: Status 404 returned error can't find the container with id a2abf7437a57d5fe7079be651cd6f83feec65451370b9b49b11041be4cb550a2 Jul 07 18:49:30.270358 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.122471 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:49:30.625731 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.535044 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.754038 2560 apiserver.go:52] "Watching apiserver" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.770279 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.770713 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f","openshift-dns/node-resolver-wbww7","openshift-image-registry/node-ca-cjbzs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal","openshift-multus/network-metrics-daemon-wj5hl","openshift-network-diagnostics/network-check-target-mpbmd","kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dknhl","openshift-multus/multus-additional-cni-plugins-m2s5k","openshift-multus/multus-rrqsp","openshift-network-operator/iptables-alerter-694c6","openshift-ovn-kubernetes/ovnkube-node-llk96","kube-system/global-pull-secret-syncer-xwfcb","kube-system/konnectivity-agent-znvdp"] Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.773252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.775279 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.776118 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.776127 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sfrvp\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.776136 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.776198 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.777464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.778021 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pszlz\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.778031 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.778022 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.779659 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.779719 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.780116 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.780144 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.780358 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.780454 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h4jpk\"" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.780524 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.781871 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:30.788930 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.781915 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:30.793057 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.792847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.797244 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.795679 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.798893 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.798031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.807960 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.808223 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.808239 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nr8dh\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.808259 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.808769 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.808827 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.809028 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cp4mh\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.810102 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.811063 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.811338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.814029 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.814788 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lmzcr\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.814813 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.816448 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.816715 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.816916 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.816916 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.816982 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nrgnd\"" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-lib-modules\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-tuned\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818159 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-sys\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818191 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-socket-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-registration-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.863836 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-device-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-serviceca\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysconfig\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-var-lib-kubelet\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818338 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdz7b\" (UniqueName: \"kubernetes.io/projected/68221979-c421-4004-986c-6443df47fb5d-kube-api-access-kdz7b\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-modprobe-d\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818366 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysctl-d\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818379 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-run\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5zkz\" (UniqueName: \"kubernetes.io/projected/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-kube-api-access-t5zkz\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsb8\" (UniqueName: \"kubernetes.io/projected/90ceee22-2927-405a-9290-903c611272f4-kube-api-access-hdsb8\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-kubernetes\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865032 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818494 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcpkt\" (UniqueName: \"kubernetes.io/projected/c026874b-2d4b-4363-93f3-2d84e2c2661c-kube-api-access-lcpkt\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea37309e-5f9e-4a64-8f5e-097dddeb1093-tmp\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-sys-fs\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68221979-c421-4004-986c-6443df47fb5d-tmp-dir\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-host\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-systemd\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8bwq\" (UniqueName: \"kubernetes.io/projected/ea37309e-5f9e-4a64-8f5e-097dddeb1093-kube-api-access-f8bwq\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68221979-c421-4004-986c-6443df47fb5d-hosts-file\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-host\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818645 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.818662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysctl-conf\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.819460 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.819511 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.820681 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.820706 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 18:49:30.865920 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.820736 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.820820 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.820878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.821216 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.821355 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6bh9s\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.822110 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.824157 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kvjrv" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.825200 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f5xf6\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.825477 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.825640 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 18:49:30.866981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.836122 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kvjrv" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.883542 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-cni-bin\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-node-log\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovn-node-metrics-cert\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919478 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-kubelet-config\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-cni-multus\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919575 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-sys\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-device-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:30.950558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-var-lib-kubelet\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919736 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-system-cni-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-multus-certs\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cnibin\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdz7b\" (UniqueName: \"kubernetes.io/projected/68221979-c421-4004-986c-6443df47fb5d-kube-api-access-kdz7b\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-run\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919866 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-os-release\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919885 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-hostroot\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-systemd-units\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66e88745-ee8f-4836-8732-f9fd7511c5d5-konnectivity-ca\") pod \"konnectivity-agent-znvdp\" (UID: \"66e88745-ee8f-4836-8732-f9fd7511c5d5\") " pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.919975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-conf-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-etc-kubernetes\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wqfd\" (UniqueName: \"kubernetes.io/projected/1d6235bb-dc33-41d2-8bcd-eef24101eebc-kube-api-access-5wqfd\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.951715 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920129 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b5ab925-8c65-4485-8c81-299717f410ee-iptables-alerter-script\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-sys\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b5ab925-8c65-4485-8c81-299717f410ee-host-slash\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920182 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-var-lib-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-env-overrides\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-kubernetes\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcpkt\" (UniqueName: \"kubernetes.io/projected/c026874b-2d4b-4363-93f3-2d84e2c2661c-kube-api-access-lcpkt\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920328 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea37309e-5f9e-4a64-8f5e-097dddeb1093-tmp\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.920359 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920356 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-var-lib-kubelet\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.920486 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:31.420461332 +0000 UTC m=+3.056237782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920917 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-device-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.953218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-slash\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.920999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-host\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-netns\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921044 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzck\" (UniqueName: \"kubernetes.io/projected/8a7c790b-769a-475f-ae5c-537bcbb37592-kube-api-access-4kzck\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-systemd\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-dbus\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-systemd\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bwq\" (UniqueName: \"kubernetes.io/projected/ea37309e-5f9e-4a64-8f5e-097dddeb1093-kube-api-access-f8bwq\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68221979-c421-4004-986c-6443df47fb5d-hosts-file\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-host\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysctl-conf\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-lib-modules\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.954097 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-tuned\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921459 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-cni-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921556 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovnkube-script-lib\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-systemd\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-host\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-kubernetes\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysctl-conf\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-socket-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.921988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-registration-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922017 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-serviceca\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-run-netns\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.955796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysconfig\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-k8s-cni-cncf-io\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-etc-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-cni-netd\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovnkube-config\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-os-release\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922322 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-lib-modules\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-host\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysconfig\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68221979-c421-4004-986c-6443df47fb5d-hosts-file\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922687 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-registration-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922758 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-run\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-modprobe-d\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysctl-d\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.956451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a7c790b-769a-475f-ae5c-537bcbb37592-cni-binary-copy\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-cni-bin\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-kubelet\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922968 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5zkz\" (UniqueName: \"kubernetes.io/projected/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-kube-api-access-t5zkz\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.922994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-socket-dir-parent\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-kubelet\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-daemon-config\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-system-cni-dir\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-log-socket\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52bcm\" (UniqueName: \"kubernetes.io/projected/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-kube-api-access-52bcm\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923130 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-serviceca\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66e88745-ee8f-4836-8732-f9fd7511c5d5-agent-certs\") pod \"konnectivity-agent-znvdp\" (UID: \"66e88745-ee8f-4836-8732-f9fd7511c5d5\") " pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsb8\" (UniqueName: \"kubernetes.io/projected/90ceee22-2927-405a-9290-903c611272f4-kube-api-access-hdsb8\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.923251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-sys-fs\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.958362 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.926263 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-socket-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.926285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-tuned\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.926547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-sys-fs\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.926950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea37309e-5f9e-4a64-8f5e-097dddeb1093-tmp\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.927292 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c026874b-2d4b-4363-93f3-2d84e2c2661c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.927380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-modprobe-d\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.927585 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea37309e-5f9e-4a64-8f5e-097dddeb1093-etc-sysctl-d\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.928151 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.928175 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.928188 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.928288 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68221979-c421-4004-986c-6443df47fb5d-tmp-dir\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.928326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-cnibin\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.928362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8fp\" (UniqueName: \"kubernetes.io/projected/8b5ab925-8c65-4485-8c81-299717f410ee-kube-api-access-fs8fp\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.928426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-ovn\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:30.959222 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.928753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68221979-c421-4004-986c-6443df47fb5d-tmp-dir\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:30.961756 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:30.928896 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:31.428876165 +0000 UTC m=+3.064652617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:30.961756 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.933115 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdz7b\" (UniqueName: \"kubernetes.io/projected/68221979-c421-4004-986c-6443df47fb5d-kube-api-access-kdz7b\") pod \"node-resolver-wbww7\" (UID: \"68221979-c421-4004-986c-6443df47fb5d\") " pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:30.935592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" event={"ID":"407ab6e563598eecc05b9012141a51c0","Type":"ContainerStarted","Data":"a2abf7437a57d5fe7079be651cd6f83feec65451370b9b49b11041be4cb550a2"} Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.005513 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" event={"ID":"500fd99c86edfb54db753b6440957a3f","Type":"ContainerStarted","Data":"42d76d835205c528385a85c4210510750b11b8f0eff1568c1dbda3761339c130"} Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.008577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcpkt\" (UniqueName: \"kubernetes.io/projected/c026874b-2d4b-4363-93f3-2d84e2c2661c-kube-api-access-lcpkt\") pod \"aws-ebs-csi-driver-node-zxn5f\" (UID: \"c026874b-2d4b-4363-93f3-2d84e2c2661c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.010123 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsb8\" (UniqueName: \"kubernetes.io/projected/90ceee22-2927-405a-9290-903c611272f4-kube-api-access-hdsb8\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.011700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8bwq\" (UniqueName: \"kubernetes.io/projected/ea37309e-5f9e-4a64-8f5e-097dddeb1093-kube-api-access-f8bwq\") pod \"tuned-dknhl\" (UID: \"ea37309e-5f9e-4a64-8f5e-097dddeb1093\") " pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.015055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5zkz\" (UniqueName: \"kubernetes.io/projected/6a49a9ba-a493-4e64-aa74-d27f0c1b123e-kube-api-access-t5zkz\") pod \"node-ca-cjbzs\" (UID: \"6a49a9ba-a493-4e64-aa74-d27f0c1b123e\") " pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-env-overrides\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-slash\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-netns\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzck\" (UniqueName: \"kubernetes.io/projected/8a7c790b-769a-475f-ae5c-537bcbb37592-kube-api-access-4kzck\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-systemd\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028911 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-slash\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-netns\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.040704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-dbus\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.028973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-cni-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029059 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovnkube-script-lib\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.029092 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-run-netns\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029120 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-dbus\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029003 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-systemd\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.029142 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:49:31.529126192 +0000 UTC m=+3.164902638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029152 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-run-netns\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.041984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029171 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-k8s-cni-cncf-io\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029190 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029204 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-k8s-cni-cncf-io\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-etc-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029175 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-cni-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-cni-netd\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029251 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-etc-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovnkube-config\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-os-release\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029298 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-cni-netd\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a7c790b-769a-475f-ae5c-537bcbb37592-cni-binary-copy\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029259 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-env-overrides\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-cni-bin\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-kubelet\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-kubelet\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.044793 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029483 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-cni-bin\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029381 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-os-release\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-socket-dir-parent\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-kubelet\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-daemon-config\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-system-cni-dir\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-log-socket\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-socket-dir-parent\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029633 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52bcm\" (UniqueName: \"kubernetes.io/projected/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-kube-api-access-52bcm\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029644 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovnkube-script-lib\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66e88745-ee8f-4836-8732-f9fd7511c5d5-agent-certs\") pod \"konnectivity-agent-znvdp\" (UID: \"66e88745-ee8f-4836-8732-f9fd7511c5d5\") " pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-cnibin\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029695 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-log-socket\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8fp\" (UniqueName: \"kubernetes.io/projected/8b5ab925-8c65-4485-8c81-299717f410ee-kube-api-access-fs8fp\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-system-cni-dir\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.045662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-ovn\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-cni-bin\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029757 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-kubelet\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-node-log\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovn-node-metrics-cert\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-cnibin\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a7c790b-769a-475f-ae5c-537bcbb37592-cni-binary-copy\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-kubelet-config\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-cni-multus\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029914 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-node-log\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029956 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-cni-bin\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.048410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029979 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovnkube-config\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029986 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.029895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-run-ovn\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-system-cni-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-daemon-config\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-multus-certs\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030096 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cnibin\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-os-release\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030133 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-system-cni-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030146 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-hostroot\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-systemd-units\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cnibin\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030097 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-run-multus-certs\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66e88745-ee8f-4836-8732-f9fd7511c5d5-konnectivity-ca\") pod \"konnectivity-agent-znvdp\" (UID: \"66e88745-ee8f-4836-8732-f9fd7511c5d5\") " pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:31.049458 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-conf-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030250 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-etc-kubernetes\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030252 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-systemd-units\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-os-release\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-hostroot\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030290 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-multus-conf-dir\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030306 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-etc-kubernetes\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wqfd\" (UniqueName: \"kubernetes.io/projected/1d6235bb-dc33-41d2-8bcd-eef24101eebc-kube-api-access-5wqfd\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b5ab925-8c65-4485-8c81-299717f410ee-iptables-alerter-script\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b5ab925-8c65-4485-8c81-299717f410ee-host-slash\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-var-lib-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a7c790b-769a-475f-ae5c-537bcbb37592-host-var-lib-cni-multus\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-var-lib-openvswitch\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.055671 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030594 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b5ab925-8c65-4485-8c81-299717f410ee-host-slash\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-kubelet-config\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d6235bb-dc33-41d2-8bcd-eef24101eebc-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.030828 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66e88745-ee8f-4836-8732-f9fd7511c5d5-konnectivity-ca\") pod \"konnectivity-agent-znvdp\" (UID: \"66e88745-ee8f-4836-8732-f9fd7511c5d5\") " pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.031095 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b5ab925-8c65-4485-8c81-299717f410ee-iptables-alerter-script\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.032660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66e88745-ee8f-4836-8732-f9fd7511c5d5-agent-certs\") pod \"konnectivity-agent-znvdp\" (UID: \"66e88745-ee8f-4836-8732-f9fd7511c5d5\") " pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.033117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-ovn-node-metrics-cert\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.048942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzck\" (UniqueName: \"kubernetes.io/projected/8a7c790b-769a-475f-ae5c-537bcbb37592-kube-api-access-4kzck\") pod \"multus-rrqsp\" (UID: \"8a7c790b-769a-475f-ae5c-537bcbb37592\") " pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.052022 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wqfd\" (UniqueName: \"kubernetes.io/projected/1d6235bb-dc33-41d2-8bcd-eef24101eebc-kube-api-access-5wqfd\") pod \"multus-additional-cni-plugins-m2s5k\" (UID: \"1d6235bb-dc33-41d2-8bcd-eef24101eebc\") " pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.052023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52bcm\" (UniqueName: \"kubernetes.io/projected/93a7cb9c-315a-4eab-99e6-12ab5c8d06e7-kube-api-access-52bcm\") pod \"ovnkube-node-llk96\" (UID: \"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.056714 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.053586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8fp\" (UniqueName: \"kubernetes.io/projected/8b5ab925-8c65-4485-8c81-299717f410ee-kube-api-access-fs8fp\") pod \"iptables-alerter-694c6\" (UID: \"8b5ab925-8c65-4485-8c81-299717f410ee\") " pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.094510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.108638 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc026874b_2d4b_4363_93f3_2d84e2c2661c.slice/crio-1876cc7548cdcc7a3413836170ccd964c1a4f17a5d16ae2a3d5b035835c2c4fa WatchSource:0}: Error finding container 1876cc7548cdcc7a3413836170ccd964c1a4f17a5d16ae2a3d5b035835c2c4fa: Status 404 returned error can't find the container with id 1876cc7548cdcc7a3413836170ccd964c1a4f17a5d16ae2a3d5b035835c2c4fa Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.110889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cjbzs" Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.119513 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbww7" Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.120036 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a49a9ba_a493_4e64_aa74_d27f0c1b123e.slice/crio-89914c7897fe008081227034118c0ac3cccf3a5cd2e5438e9abb117c932047e7 WatchSource:0}: Error finding container 89914c7897fe008081227034118c0ac3cccf3a5cd2e5438e9abb117c932047e7: Status 404 returned error can't find the container with id 89914c7897fe008081227034118c0ac3cccf3a5cd2e5438e9abb117c932047e7 Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.124639 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dknhl" Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.130724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" Jul 07 18:49:31.138835 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.132846 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68221979_c421_4004_986c_6443df47fb5d.slice/crio-8de103e8521306cc9bd9b1b12e6af58f16298ccf18425f7efefb64f1eb2d19d8 WatchSource:0}: Error finding container 8de103e8521306cc9bd9b1b12e6af58f16298ccf18425f7efefb64f1eb2d19d8: Status 404 returned error can't find the container with id 8de103e8521306cc9bd9b1b12e6af58f16298ccf18425f7efefb64f1eb2d19d8 Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.140132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rrqsp" Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.144433 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea37309e_5f9e_4a64_8f5e_097dddeb1093.slice/crio-9bec8b70bd9f0dec861c508d9ffc89c844edfc4bb0a0540cd9e54cc6eea2883a WatchSource:0}: Error finding container 9bec8b70bd9f0dec861c508d9ffc89c844edfc4bb0a0540cd9e54cc6eea2883a: Status 404 returned error can't find the container with id 9bec8b70bd9f0dec861c508d9ffc89c844edfc4bb0a0540cd9e54cc6eea2883a Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.147799 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6235bb_dc33_41d2_8bcd_eef24101eebc.slice/crio-6f587eecfc8be12f7b1d0f6577dee3e45e9a5c6ac0f864e8304a35119d9acccc WatchSource:0}: Error finding container 6f587eecfc8be12f7b1d0f6577dee3e45e9a5c6ac0f864e8304a35119d9acccc: Status 404 returned error can't find the container with id 6f587eecfc8be12f7b1d0f6577dee3e45e9a5c6ac0f864e8304a35119d9acccc Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.150215 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7c790b_769a_475f_ae5c_537bcbb37592.slice/crio-c8642dfe2d95d0abed34647dbc4a9373ad1e3171726a7f3e7169ceeb14798869 WatchSource:0}: Error finding container c8642dfe2d95d0abed34647dbc4a9373ad1e3171726a7f3e7169ceeb14798869: Status 404 returned error can't find the container with id c8642dfe2d95d0abed34647dbc4a9373ad1e3171726a7f3e7169ceeb14798869 Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.206771 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-694c6" Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.220380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:31.260443 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:49:31.236755 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a7cb9c_315a_4eab_99e6_12ab5c8d06e7.slice/crio-19094a65b4bf43673b5a557317912d39c9877f08a1e7d09004a8286144955123 WatchSource:0}: Error finding container 19094a65b4bf43673b5a557317912d39c9877f08a1e7d09004a8286144955123: Status 404 returned error can't find the container with id 19094a65b4bf43673b5a557317912d39c9877f08a1e7d09004a8286144955123 Jul 07 18:49:31.307360 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.307326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:31.434068 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.434042 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:31.434177 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.434078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:31.434240 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.434177 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:31.434240 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.434185 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:31.434240 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.434191 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:31.434240 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.434201 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:31.434240 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.434238 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:32.434221485 +0000 UTC m=+4.069997934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:31.434504 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.434256 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:32.434245958 +0000 UTC m=+4.070022407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:31.445599 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.445579 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:31.535204 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.535143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.535316 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.535264 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:31.535365 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.535325 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:49:32.535309821 +0000 UTC m=+4.171086271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:31.839771 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.839626 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:44:30 +0000 UTC" deadline="2028-04-21 01:16:07.212137086 +0000 UTC" Jul 07 18:49:31.839771 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.839680 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15678h26m35.372460779s" Jul 07 18:49:31.926566 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.926420 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:31.926566 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:31.926547 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:31.953120 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.953088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbww7" event={"ID":"68221979-c421-4004-986c-6443df47fb5d","Type":"ContainerStarted","Data":"8de103e8521306cc9bd9b1b12e6af58f16298ccf18425f7efefb64f1eb2d19d8"} Jul 07 18:49:31.958594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.958520 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-694c6" event={"ID":"8b5ab925-8c65-4485-8c81-299717f410ee","Type":"ContainerStarted","Data":"40c053a1d5922b24207f03ea9df203f53ebd096b198b4cfa2f7515a61548a5e2"} Jul 07 18:49:31.962642 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.962581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rrqsp" event={"ID":"8a7c790b-769a-475f-ae5c-537bcbb37592","Type":"ContainerStarted","Data":"c8642dfe2d95d0abed34647dbc4a9373ad1e3171726a7f3e7169ceeb14798869"} Jul 07 18:49:31.964134 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.964066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cjbzs" event={"ID":"6a49a9ba-a493-4e64-aa74-d27f0c1b123e","Type":"ContainerStarted","Data":"89914c7897fe008081227034118c0ac3cccf3a5cd2e5438e9abb117c932047e7"} Jul 07 18:49:31.966559 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.966483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" event={"ID":"c026874b-2d4b-4363-93f3-2d84e2c2661c","Type":"ContainerStarted","Data":"1876cc7548cdcc7a3413836170ccd964c1a4f17a5d16ae2a3d5b035835c2c4fa"} Jul 07 18:49:31.968204 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.968184 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-znvdp" event={"ID":"66e88745-ee8f-4836-8732-f9fd7511c5d5","Type":"ContainerStarted","Data":"1e39498fa7ff45f4717b9fcb726c081fc7b3caa817af8f02109b4d2da65ba381"} Jul 07 18:49:31.970618 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.970532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"19094a65b4bf43673b5a557317912d39c9877f08a1e7d09004a8286144955123"} Jul 07 18:49:31.975426 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.975345 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerStarted","Data":"6f587eecfc8be12f7b1d0f6577dee3e45e9a5c6ac0f864e8304a35119d9acccc"} Jul 07 18:49:31.977092 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:31.977048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dknhl" event={"ID":"ea37309e-5f9e-4a64-8f5e-097dddeb1093","Type":"ContainerStarted","Data":"9bec8b70bd9f0dec861c508d9ffc89c844edfc4bb0a0540cd9e54cc6eea2883a"} Jul 07 18:49:32.443096 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.443051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.443110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.443278 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.443339 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:34.443320768 +0000 UTC m=+6.079097220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.443507 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.443526 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.443538 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:32.443781 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.443587 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:34.443572577 +0000 UTC m=+6.079349027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:32.544003 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.543959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:32.544163 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.544095 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:32.544163 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.544155 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:49:34.54413671 +0000 UTC m=+6.179913160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:32.840651 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.840542 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:44:30 +0000 UTC" deadline="2028-04-11 16:24:13.880344746 +0000 UTC" Jul 07 18:49:32.840651 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.840576 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15453h34m41.039773777s" Jul 07 18:49:32.923424 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.922747 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:32.923424 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.922867 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:32.923424 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:32.923243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:32.923424 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:32.923333 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:33.921441 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:33.921199 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:33.921441 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:33.921332 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:34.458231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:34.458276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.458448 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.458509 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:38.458489397 +0000 UTC m=+10.094265849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.458890 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.458910 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.458925 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:34.459002 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.458968 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:38.458954405 +0000 UTC m=+10.094730853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:34.559502 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:34.559464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:34.559659 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.559595 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:34.559659 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.559653 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:49:38.559634895 +0000 UTC m=+10.195411344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:34.921287 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:34.921252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:34.921475 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.921407 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:34.921475 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:34.921444 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:34.921989 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:34.921551 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:35.920800 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:35.920770 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:35.920973 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:35.920894 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:36.920868 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:36.920833 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:36.921286 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:36.920957 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:36.921286 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:36.920833 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:36.921286 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:36.921070 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:37.921691 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:37.921655 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:37.922141 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:37.921812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:38.492156 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:38.492121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:38.492317 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:38.492166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:38.492317 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.492270 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:38.492317 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.492293 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:38.492317 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.492316 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:38.492541 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.492329 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:38.492541 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.492332 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:46.492312998 +0000 UTC m=+18.128089461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:38.492541 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.492377 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:46.492361307 +0000 UTC m=+18.128137757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:38.593147 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:38.593113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:38.593282 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.593233 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:38.593333 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.593292 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:49:46.593274321 +0000 UTC m=+18.229050771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:38.922248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:38.922211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:38.922695 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.922315 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:38.922695 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:38.922669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:38.922798 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:38.922754 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:39.921515 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:39.921481 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:39.921680 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:39.921600 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:40.921426 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:40.920774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:40.921426 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:40.920898 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:40.921426 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:40.921286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:40.921426 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:40.921372 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:41.921243 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:41.921215 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:41.921440 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:41.921341 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:42.921704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:42.921102 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:42.921704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:42.921127 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:42.921704 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:42.921238 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:42.921704 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:42.921318 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:43.920945 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:43.920910 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:43.921110 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:43.921031 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:44.921010 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:44.920980 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:44.921451 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:44.920982 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:44.921451 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:44.921084 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:44.921451 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:44.921181 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:45.920662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:45.920637 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:45.920774 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:45.920751 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:46.011854 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.011829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" event={"ID":"407ab6e563598eecc05b9012141a51c0","Type":"ContainerStarted","Data":"87f8e16db758bb72146cdd2a7d4c081c2bd7b66619ada427f676c2676520f49a"} Jul 07 18:49:46.013060 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.013041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dknhl" event={"ID":"ea37309e-5f9e-4a64-8f5e-097dddeb1093","Type":"ContainerStarted","Data":"11f14c0b051ede4d1b031896c89cc84e70d4b06d28e8622a79764f53e76b40cf"} Jul 07 18:49:46.049428 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.049367 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-153.ec2.internal" podStartSLOduration=17.049355438 podStartE2EDuration="17.049355438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:46.04926084 +0000 UTC m=+17.685037304" watchObservedRunningTime="2026-07-07 18:49:46.049355438 +0000 UTC m=+17.685131906" Jul 07 18:49:46.559242 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.559203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:46.559242 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.559252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:46.559496 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.559364 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:46.559496 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.559412 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:46.559496 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.559442 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:02.55942144 +0000 UTC m=+34.195197887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:46.559496 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.559442 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:46.559496 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.559459 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:46.559496 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.559485 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:02.559476418 +0000 UTC m=+34.195252864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:46.660246 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.660162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:46.660383 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.660283 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:46.660383 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.660350 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:50:02.660332636 +0000 UTC m=+34.296109082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:46.921352 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.921284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:46.921506 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:46.921415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:46.921506 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.921422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:46.921506 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:46.921494 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:47.016218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:47.016186 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rrqsp" event={"ID":"8a7c790b-769a-475f-ae5c-537bcbb37592","Type":"ContainerStarted","Data":"e68f0cfa00ca26bac947de12682ce9b83bc324f8225462a390d3f279de8ea5c0"} Jul 07 18:49:47.039056 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:47.039019 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rrqsp" podStartSLOduration=3.189219599 podStartE2EDuration="18.039007141s" totalImagesPullingTime="14.849787542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:47.03886039 +0000 UTC m=+18.674636857" watchObservedRunningTime="2026-07-07 18:49:47.039007141 +0000 UTC m=+18.674783608" Jul 07 18:49:47.921046 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:47.920850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:47.921211 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:47.921141 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:48.020075 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.020039 2560 generic.go:356] "Generic (PLEG): container finished" podID="1d6235bb-dc33-41d2-8bcd-eef24101eebc" containerID="f2e3919d21f29e9aff7504dd6d3bbebead8bef73183fe45617ddaf7570b02d5b" exitCode=0 Jul 07 18:49:48.020541 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.020125 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerDied","Data":"f2e3919d21f29e9aff7504dd6d3bbebead8bef73183fe45617ddaf7570b02d5b"} Jul 07 18:49:48.021738 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.021685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbww7" event={"ID":"68221979-c421-4004-986c-6443df47fb5d","Type":"ContainerStarted","Data":"35c85886ba9c481968fdf210e765d9661ac06841ed8d34c8551b6f4ea4dbc2f0"} Jul 07 18:49:48.023270 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.023250 2560 generic.go:356] "Generic (PLEG): container finished" podID="500fd99c86edfb54db753b6440957a3f" containerID="d505accca98a44c4fcbe53533fcddf8f2df22f9c62486c95aa9f458811789faa" exitCode=0 Jul 07 18:49:48.023352 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.023316 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" event={"ID":"500fd99c86edfb54db753b6440957a3f","Type":"ContainerDied","Data":"d505accca98a44c4fcbe53533fcddf8f2df22f9c62486c95aa9f458811789faa"} Jul 07 18:49:48.025066 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.025011 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-694c6" event={"ID":"8b5ab925-8c65-4485-8c81-299717f410ee","Type":"ContainerStarted","Data":"4e7fbbdf9c23e4de52fdf19dea6e16c85272e58e6330473a7087317d95a5e248"} Jul 07 18:49:48.026553 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.026503 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cjbzs" event={"ID":"6a49a9ba-a493-4e64-aa74-d27f0c1b123e","Type":"ContainerStarted","Data":"30c8576a64a5414007fc921c5ac41d1a60a6909e1c53dad1850cef1070e8562d"} Jul 07 18:49:48.028468 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.028447 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" event={"ID":"c026874b-2d4b-4363-93f3-2d84e2c2661c","Type":"ContainerStarted","Data":"f9e488ba9c3ca9a0645247c145db39c1d7cafdb1fa706b814493c479ff82d173"} Jul 07 18:49:48.029886 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.029863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-znvdp" event={"ID":"66e88745-ee8f-4836-8732-f9fd7511c5d5","Type":"ContainerStarted","Data":"89d077939769b3112c2332e75596281c519ac2faecc6dd701f720ae67aeb8a48"} Jul 07 18:49:48.055895 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.054929 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dknhl" podStartSLOduration=4.435853766 podStartE2EDuration="19.054912883s" totalImagesPullingTime="14.619059117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:47.0603579 +0000 UTC m=+18.696134368" watchObservedRunningTime="2026-07-07 18:49:48.054912883 +0000 UTC m=+19.690689354" Jul 07 18:49:48.076840 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.076800 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cjbzs" podStartSLOduration=4.800939174 podStartE2EDuration="19.076785119s" totalImagesPullingTime="14.275845945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:48.076742871 +0000 UTC m=+19.712519343" watchObservedRunningTime="2026-07-07 18:49:48.076785119 +0000 UTC m=+19.712561587" Jul 07 18:49:48.094680 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.094635 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-694c6" podStartSLOduration=4.550233983 podStartE2EDuration="19.094619972s" totalImagesPullingTime="14.544385989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:48.094471629 +0000 UTC m=+19.730248097" watchObservedRunningTime="2026-07-07 18:49:48.094619972 +0000 UTC m=+19.730396441" Jul 07 18:49:48.118382 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.118339 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-znvdp" podStartSLOduration=4.703828812 podStartE2EDuration="19.118324354s" totalImagesPullingTime="14.414495542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:48.117966359 +0000 UTC m=+19.753742827" watchObservedRunningTime="2026-07-07 18:49:48.118324354 +0000 UTC m=+19.754100824" Jul 07 18:49:48.164480 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.164411 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wbww7" podStartSLOduration=4.90713784 podStartE2EDuration="19.164376149s" totalImagesPullingTime="14.257238309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:48.163891753 +0000 UTC m=+19.799668221" watchObservedRunningTime="2026-07-07 18:49:48.164376149 +0000 UTC m=+19.800152616" Jul 07 18:49:48.922277 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.922247 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:48.922484 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:48.922283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:48.922484 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:48.922351 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:48.922583 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:48.922490 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:49.541246 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:49.541218 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:49.541824 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:49.541748 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:49.921460 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:49.921430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:49.921616 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:49.921565 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:50.921152 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:50.921113 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:50.921731 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:50.921245 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:50.921731 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:50.921323 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:50.921731 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:50.921443 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:51.035122 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:51.035094 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 18:49:51.921570 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:51.921542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:51.922032 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:51.921652 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:52.041634 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.041599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"b759b56d4e21c4b2bb8248ea3508418dc46fd6193a0df814a14c17c4505cb1c0"} Jul 07 18:49:52.041775 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.041688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"063ce4a0cface9f04343b7b67905a575a71c8390994ed4b52a8f333a03cf61d2"} Jul 07 18:49:52.041775 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.041734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"18443f63f41343de063e4558fee3c10b1b762eac3d9a471d14a01a02bf9fd4a6"} Jul 07 18:49:52.041893 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.041781 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"26e2224b155e46aef6a97be6b0e70af83dd0c0f6964ac95fffcd6cdfb12f0247"} Jul 07 18:49:52.041893 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.041827 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"6fc23d28aaf98e45d85956306f378383b39a4193ce734f4e998bc5a3f1e661d8"} Jul 07 18:49:52.041975 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.041919 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"3918057361b226af67d638e6cc3aa3ccd0ea3862a1120afbc8342ca4627f1ab7"} Jul 07 18:49:52.043881 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.043857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" event={"ID":"500fd99c86edfb54db753b6440957a3f","Type":"ContainerStarted","Data":"4f05848aa9e9e570fd86f72fbcbd7b48e1de257077a0faae11b89de41522d37d"} Jul 07 18:49:52.062541 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.062495 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-153.ec2.internal" podStartSLOduration=23.062479081 podStartE2EDuration="23.062479081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:52.06224803 +0000 UTC m=+23.698024538" watchObservedRunningTime="2026-07-07 18:49:52.062479081 +0000 UTC m=+23.698255550" Jul 07 18:49:52.837078 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.836941 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 18:49:52.883090 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.883001 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:49:52.837073836Z","UUID":"821f8351-4be1-4737-a7f1-fe89a5543a94","Handler":null,"Name":"","Endpoint":""} Jul 07 18:49:52.884689 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.884673 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 18:49:52.884785 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.884709 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 18:49:52.920994 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.920971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:52.921108 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:52.921087 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:52.921146 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:52.921123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:52.921206 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:52.921191 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:53.047704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:53.047619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" event={"ID":"c026874b-2d4b-4363-93f3-2d84e2c2661c","Type":"ContainerStarted","Data":"2892874ed00aa26c9f50b97ac8043774ef4680be90dd1ce923f27e77a0016d1c"} Jul 07 18:49:53.921479 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:53.921453 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:53.921651 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:53.921540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:54.051385 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:54.051357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" event={"ID":"c026874b-2d4b-4363-93f3-2d84e2c2661c","Type":"ContainerStarted","Data":"bdb1e07276d7670765913139f7bd65c00a02888b048a819b51d1b73e5315a9aa"} Jul 07 18:49:54.073565 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:54.073532 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxn5f" podStartSLOduration=3.858700286 podStartE2EDuration="25.073519601s" totalImagesPullingTime="21.214819315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:54.07348676 +0000 UTC m=+25.709263229" watchObservedRunningTime="2026-07-07 18:49:54.073519601 +0000 UTC m=+25.709296068" Jul 07 18:49:54.921007 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:54.920978 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:54.921155 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:54.921118 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:54.921233 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:54.921176 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:54.921288 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:54.921269 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:55.057155 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:55.057122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"66f5606040f8801e764405108753b5df521d8d2a5e2cf09942900034d848c68f"} Jul 07 18:49:55.921482 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:55.921451 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:55.921640 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:55.921557 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:56.921089 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:56.921057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:56.921809 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:56.921179 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:56.921809 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:56.921230 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:56.921809 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:56.921340 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:57.064338 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.064306 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" event={"ID":"93a7cb9c-315a-4eab-99e6-12ab5c8d06e7","Type":"ContainerStarted","Data":"8a4f99f30368c44bc43fb04a1ac7ef5452ccbe1af34d6de7a137c08801dac9dd"} Jul 07 18:49:57.064557 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.064542 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:57.079408 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.079368 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:57.094675 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.094641 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" podStartSLOduration=7.68552655 podStartE2EDuration="28.094630306s" totalImagesPullingTime="20.409103756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:57.094539408 +0000 UTC m=+28.730315876" watchObservedRunningTime="2026-07-07 18:49:57.094630306 +0000 UTC m=+28.730406773" Jul 07 18:49:57.638693 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.638381 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:57.638852 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.638763 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 18:49:57.639014 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.638994 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-znvdp" Jul 07 18:49:57.920999 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:57.920970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:57.921142 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:57.921095 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:58.067187 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.067160 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:58.067349 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.067234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:58.082726 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.082706 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:49:58.439561 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.439521 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpbmd"] Jul 07 18:49:58.439719 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.439674 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:58.439908 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:58.439774 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:58.444532 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.444508 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj5hl"] Jul 07 18:49:58.444775 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.444638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:58.444775 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:58.444740 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:49:58.445254 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.445223 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwfcb"] Jul 07 18:49:58.445335 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:58.445315 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:58.445473 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:58.445433 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:59.921336 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:59.921303 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:49:59.921742 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:59.921346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:49:59.921742 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:49:59.921317 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:49:59.921742 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:59.921427 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:49:59.921742 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:59.921487 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:49:59.921742 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:49:59.921601 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:50:00.071480 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:00.071451 2560 generic.go:356] "Generic (PLEG): container finished" podID="1d6235bb-dc33-41d2-8bcd-eef24101eebc" containerID="53d1ff2434b8ee06d83164b46cc8b26ac334aed1ec7802e0e28cdc3cf81a4ec4" exitCode=0 Jul 07 18:50:00.071617 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:00.071531 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerDied","Data":"53d1ff2434b8ee06d83164b46cc8b26ac334aed1ec7802e0e28cdc3cf81a4ec4"} Jul 07 18:50:01.921264 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:01.921099 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:01.921639 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:01.921122 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:01.921639 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:01.921099 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:50:01.921639 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:01.921422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:50:01.921639 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:01.921494 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:50:01.921639 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:01.921319 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:50:02.077340 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:02.077314 2560 generic.go:356] "Generic (PLEG): container finished" podID="1d6235bb-dc33-41d2-8bcd-eef24101eebc" containerID="118ff4fd0a093310419d487f3bae17bc4ef270be4c123cd5c3ec344fdadbd4e9" exitCode=0 Jul 07 18:50:02.077505 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:02.077350 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerDied","Data":"118ff4fd0a093310419d487f3bae17bc4ef270be4c123cd5c3ec344fdadbd4e9"} Jul 07 18:50:02.581786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:02.581754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:02.581786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:02.581790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:50:02.582013 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.581890 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:02.582013 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.581904 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:50:02.582013 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.581923 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:50:02.582013 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.581942 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m875j for pod openshift-network-diagnostics/network-check-target-mpbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:02.582013 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.581959 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:34.581932765 +0000 UTC m=+66.217709223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:02.582013 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.581976 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j podName:799a6737-cf62-4c79-b926-61659eb56632 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:34.581966013 +0000 UTC m=+66.217742476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m875j" (UniqueName: "kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j") pod "network-check-target-mpbmd" (UID: "799a6737-cf62-4c79-b926-61659eb56632") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:02.682363 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:02.682330 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:02.682618 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.682463 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:02.682618 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:02.682522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret podName:5d5900cf-f5bd-413e-aa33-3bac0738f6fe nodeName:}" failed. No retries permitted until 2026-07-07 18:50:34.682509438 +0000 UTC m=+66.318285884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret") pod "global-pull-secret-syncer-xwfcb" (UID: "5d5900cf-f5bd-413e-aa33-3bac0738f6fe") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:03.921352 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:03.921320 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:50:03.921352 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:03.921343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:03.921865 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:03.921369 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:03.921865 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:03.921469 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5hl" podUID="90ceee22-2927-405a-9290-903c611272f4" Jul 07 18:50:03.921865 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:03.921571 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpbmd" podUID="799a6737-cf62-4c79-b926-61659eb56632" Jul 07 18:50:03.921865 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:03.921630 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwfcb" podUID="5d5900cf-f5bd-413e-aa33-3bac0738f6fe" Jul 07 18:50:05.086082 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.086017 2560 generic.go:356] "Generic (PLEG): container finished" podID="1d6235bb-dc33-41d2-8bcd-eef24101eebc" containerID="b4620e8cfad00bb0e3fbb2a97b9661b99080359582a4edad3b71183f99fafea0" exitCode=0 Jul 07 18:50:05.086082 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.086062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerDied","Data":"b4620e8cfad00bb0e3fbb2a97b9661b99080359582a4edad3b71183f99fafea0"} Jul 07 18:50:05.162568 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.162544 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-153.ec2.internal" event="NodeReady" Jul 07 18:50:05.162688 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.162647 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 18:50:05.207278 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.207248 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc75c54d8-q2x5w"] Jul 07 18:50:05.229302 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.229279 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d6vd8"] Jul 07 18:50:05.229506 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.229416 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.233420 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.233379 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 18:50:05.233545 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.233427 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4c4xx\"" Jul 07 18:50:05.233545 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.233464 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 18:50:05.233691 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.233586 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 18:50:05.240251 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.240233 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 18:50:05.251320 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.251299 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc75c54d8-q2x5w"] Jul 07 18:50:05.251320 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.251318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.251497 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.251340 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sr6gt"] Jul 07 18:50:05.254266 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.254252 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 18:50:05.254406 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.254371 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9shx6\"" Jul 07 18:50:05.254472 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.254444 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 18:50:05.254472 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.254464 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 18:50:05.271584 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.271566 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d6vd8"] Jul 07 18:50:05.271662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.271596 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sr6gt"] Jul 07 18:50:05.271708 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.271663 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.274735 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.274711 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krxdw\"" Jul 07 18:50:05.274936 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.274736 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 18:50:05.275237 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.275216 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 18:50:05.298939 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.298920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/593a4b8e-01db-4a92-9efc-cf12c51b91d0-cert\") pod \"ingress-canary-d6vd8\" (UID: \"593a4b8e-01db-4a92-9efc-cf12c51b91d0\") " pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.299013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.298955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-registry-certificates\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.298972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e9b63bc-02be-456c-a702-044dd76e3420-ca-trust-extracted\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.298989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e533e5dd-bc91-442c-9491-330b2995001e-tmp-dir\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.299013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-trusted-ca\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299142 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-installation-pull-secrets\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299142 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbf9f\" (UniqueName: \"kubernetes.io/projected/593a4b8e-01db-4a92-9efc-cf12c51b91d0-kube-api-access-kbf9f\") pod \"ingress-canary-d6vd8\" (UID: \"593a4b8e-01db-4a92-9efc-cf12c51b91d0\") " pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.299142 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e533e5dd-bc91-442c-9491-330b2995001e-config-volume\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.299142 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.299142 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q69kh\" (UniqueName: \"kubernetes.io/projected/e533e5dd-bc91-442c-9491-330b2995001e-kube-api-access-q69kh\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.299284 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-image-registry-private-configuration\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299284 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299209 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2kjx\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-kube-api-access-l2kjx\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299284 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.299284 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.299250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-bound-sa-token\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400074 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbf9f\" (UniqueName: \"kubernetes.io/projected/593a4b8e-01db-4a92-9efc-cf12c51b91d0-kube-api-access-kbf9f\") pod \"ingress-canary-d6vd8\" (UID: \"593a4b8e-01db-4a92-9efc-cf12c51b91d0\") " pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.400157 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e533e5dd-bc91-442c-9491-330b2995001e-config-volume\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.400157 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400096 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.400157 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q69kh\" (UniqueName: \"kubernetes.io/projected/e533e5dd-bc91-442c-9491-330b2995001e-kube-api-access-q69kh\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.400272 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.400169 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:05.400272 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.400205 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:50:05.900193479 +0000 UTC m=+37.535969926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:05.400272 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-image-registry-private-configuration\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400412 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2kjx\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-kube-api-access-l2kjx\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400412 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400412 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-bound-sa-token\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400412 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/593a4b8e-01db-4a92-9efc-cf12c51b91d0-cert\") pod \"ingress-canary-d6vd8\" (UID: \"593a4b8e-01db-4a92-9efc-cf12c51b91d0\") " pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-registry-certificates\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e9b63bc-02be-456c-a702-044dd76e3420-ca-trust-extracted\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.400478 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e533e5dd-bc91-442c-9491-330b2995001e-tmp-dir\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-trusted-ca\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-installation-pull-secrets\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.400494 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:05.400594 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e533e5dd-bc91-442c-9491-330b2995001e-config-volume\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.400945 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.400641 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:05.900625281 +0000 UTC m=+37.536401738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:05.400945 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400883 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e9b63bc-02be-456c-a702-044dd76e3420-ca-trust-extracted\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.400945 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.400915 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e533e5dd-bc91-442c-9491-330b2995001e-tmp-dir\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.401043 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.401021 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-registry-certificates\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.401300 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.401284 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-trusted-ca\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.404268 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.404245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-installation-pull-secrets\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.404346 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.404289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-image-registry-private-configuration\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.404346 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.404308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/593a4b8e-01db-4a92-9efc-cf12c51b91d0-cert\") pod \"ingress-canary-d6vd8\" (UID: \"593a4b8e-01db-4a92-9efc-cf12c51b91d0\") " pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.409961 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.409928 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q69kh\" (UniqueName: \"kubernetes.io/projected/e533e5dd-bc91-442c-9491-330b2995001e-kube-api-access-q69kh\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.410576 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.410551 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-bound-sa-token\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.410665 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.410625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2kjx\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-kube-api-access-l2kjx\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.410790 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.410771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbf9f\" (UniqueName: \"kubernetes.io/projected/593a4b8e-01db-4a92-9efc-cf12c51b91d0-kube-api-access-kbf9f\") pod \"ingress-canary-d6vd8\" (UID: \"593a4b8e-01db-4a92-9efc-cf12c51b91d0\") " pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.559299 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.559280 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d6vd8" Jul 07 18:50:05.749515 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.749483 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d6vd8"] Jul 07 18:50:05.753515 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:05.753494 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593a4b8e_01db_4a92_9efc_cf12c51b91d0.slice/crio-d0a2c517c8b61a87844daf9411844633dde5c6b8d9d0490b690b5b3eb60c5f6e WatchSource:0}: Error finding container d0a2c517c8b61a87844daf9411844633dde5c6b8d9d0490b690b5b3eb60c5f6e: Status 404 returned error can't find the container with id d0a2c517c8b61a87844daf9411844633dde5c6b8d9d0490b690b5b3eb60c5f6e Jul 07 18:50:05.905704 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.905680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:05.905803 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.905726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:05.905849 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.905820 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:05.905883 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.905869 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:50:06.905855055 +0000 UTC m=+38.541631502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:05.905927 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.905820 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:05.905927 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.905913 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:05.905996 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:05.905963 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:06.905950725 +0000 UTC m=+38.541727171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:05.920851 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.920804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:05.920926 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.920885 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:05.920926 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.920892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:50:05.923898 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.923879 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 18:50:05.924000 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.923884 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 18:50:05.924162 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.924148 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x88g7\"" Jul 07 18:50:05.924292 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.924278 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 18:50:05.924346 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.924304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mdbh\"" Jul 07 18:50:05.925332 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:05.925319 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 18:50:06.089208 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:06.089171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d6vd8" event={"ID":"593a4b8e-01db-4a92-9efc-cf12c51b91d0","Type":"ContainerStarted","Data":"d0a2c517c8b61a87844daf9411844633dde5c6b8d9d0490b690b5b3eb60c5f6e"} Jul 07 18:50:06.912620 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:06.912545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:06.912620 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:06.912624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:06.912857 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:06.912772 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:06.912857 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:06.912785 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:06.912857 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:06.912821 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:06.912857 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:06.912848 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:08.912836546 +0000 UTC m=+40.548612993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:06.913071 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:06.912894 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:50:08.912875178 +0000 UTC m=+40.548651637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:08.927535 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:08.927509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:08.927815 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:08.927615 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:08.927815 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:08.927631 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:08.927815 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:08.927681 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:12.927667761 +0000 UTC m=+44.563444209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:08.927815 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:08.927618 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:08.927815 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:08.927699 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:08.927815 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:08.927764 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:50:12.927747956 +0000 UTC m=+44.563524421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:09.097549 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:09.097473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d6vd8" event={"ID":"593a4b8e-01db-4a92-9efc-cf12c51b91d0","Type":"ContainerStarted","Data":"4b46a53aee6d61618f5d2af92192a2c10efe169f2c5d1981a0fdb8c5a33b1a89"} Jul 07 18:50:09.123834 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:09.123785 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d6vd8" podStartSLOduration=1.045930948 podStartE2EDuration="4.123771997s" totalImagesPullingTime="3.077841049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:09.122971829 +0000 UTC m=+40.758748309" watchObservedRunningTime="2026-07-07 18:50:09.123771997 +0000 UTC m=+40.759548485" Jul 07 18:50:12.958485 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:12.958455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:12.958824 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:12.958501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:12.958824 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:12.958592 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:12.958824 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:12.958604 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:12.958824 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:12.958616 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:12.958824 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:12.958647 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:50:20.95863401 +0000 UTC m=+52.594410461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:12.958824 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:12.958662 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:20.958655605 +0000 UTC m=+52.594432051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:13.110312 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:13.110289 2560 generic.go:356] "Generic (PLEG): container finished" podID="1d6235bb-dc33-41d2-8bcd-eef24101eebc" containerID="c05772345a65fca5d0320e0da351a360177853e7ca570451a90dd5b5591908e3" exitCode=0 Jul 07 18:50:13.110312 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:13.110321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerDied","Data":"c05772345a65fca5d0320e0da351a360177853e7ca570451a90dd5b5591908e3"} Jul 07 18:50:14.114463 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:14.114428 2560 generic.go:356] "Generic (PLEG): container finished" podID="1d6235bb-dc33-41d2-8bcd-eef24101eebc" containerID="c9dc0fcf92a780632f23609f6e6b37bb3a839cb0d2dce6e5ed6fd05bda029560" exitCode=0 Jul 07 18:50:14.114784 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:14.114475 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerDied","Data":"c9dc0fcf92a780632f23609f6e6b37bb3a839cb0d2dce6e5ed6fd05bda029560"} Jul 07 18:50:15.119817 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:15.119791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" event={"ID":"1d6235bb-dc33-41d2-8bcd-eef24101eebc","Type":"ContainerStarted","Data":"b8a6ec92ae7f64be745ed5e3949f08e03e13ef82f956ffb8324e7d50cdc3f361"} Jul 07 18:50:15.153121 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:15.153078 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m2s5k" podStartSLOduration=10.539699705 podStartE2EDuration="46.153065101s" totalImagesPullingTime="35.613365396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:15.152344234 +0000 UTC m=+46.788120702" watchObservedRunningTime="2026-07-07 18:50:15.153065101 +0000 UTC m=+46.788841568" Jul 07 18:50:21.011795 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:21.011762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:21.012148 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:21.011812 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:21.012148 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:21.011904 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:21.012148 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:21.011958 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.011939936 +0000 UTC m=+68.647716395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:21.012148 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:21.011907 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:21.012148 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:21.012008 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:21.012148 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:21.012056 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.012043641 +0000 UTC m=+68.647820087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:30.085252 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.085228 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llk96" Jul 07 18:50:30.422205 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.422176 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx"] Jul 07 18:50:30.456726 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.456702 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx"] Jul 07 18:50:30.456835 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.456774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" Jul 07 18:50:30.459673 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.459652 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k7brl\"" Jul 07 18:50:30.538936 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.538909 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd"] Jul 07 18:50:30.540551 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.540535 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:30.543558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.543543 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 18:50:30.543913 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.543896 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 18:50:30.544063 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.544050 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:50:30.544133 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.544118 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5m4n6\"" Jul 07 18:50:30.554649 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.554628 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd"] Jul 07 18:50:30.574108 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.574082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wrv\" (UniqueName: \"kubernetes.io/projected/6791089c-4b23-4323-96d1-d6b6b5a55ba9-kube-api-access-f7wrv\") pod \"network-check-source-989f8b8dc-pd9fx\" (UID: \"6791089c-4b23-4323-96d1-d6b6b5a55ba9\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" Jul 07 18:50:30.675312 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.675265 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:30.675312 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.675288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqsj\" (UniqueName: \"kubernetes.io/projected/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-kube-api-access-mvqsj\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:30.675484 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.675317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wrv\" (UniqueName: \"kubernetes.io/projected/6791089c-4b23-4323-96d1-d6b6b5a55ba9-kube-api-access-f7wrv\") pod \"network-check-source-989f8b8dc-pd9fx\" (UID: \"6791089c-4b23-4323-96d1-d6b6b5a55ba9\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" Jul 07 18:50:30.685401 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.685375 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 18:50:30.696277 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.696262 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 18:50:30.706824 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.706806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wrv\" (UniqueName: \"kubernetes.io/projected/6791089c-4b23-4323-96d1-d6b6b5a55ba9-kube-api-access-f7wrv\") pod \"network-check-source-989f8b8dc-pd9fx\" (UID: \"6791089c-4b23-4323-96d1-d6b6b5a55ba9\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" Jul 07 18:50:30.765221 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.765202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" Jul 07 18:50:30.776016 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.775992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:30.776095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.776029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqsj\" (UniqueName: \"kubernetes.io/projected/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-kube-api-access-mvqsj\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:30.776187 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:30.776164 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:50:30.776278 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:30.776263 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls podName:ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:31.276241524 +0000 UTC m=+62.912018042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rkjwd" (UID: "ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7") : secret "samples-operator-tls" not found Jul 07 18:50:30.786407 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.786367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqsj\" (UniqueName: \"kubernetes.io/projected/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-kube-api-access-mvqsj\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:30.880952 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:30.880932 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx"] Jul 07 18:50:30.883250 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:30.883226 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6791089c_4b23_4323_96d1_d6b6b5a55ba9.slice/crio-e56ce5172dc0eac46a13b9de81cdbbd27aabecdc1116f94a354bedc973de3965 WatchSource:0}: Error finding container e56ce5172dc0eac46a13b9de81cdbbd27aabecdc1116f94a354bedc973de3965: Status 404 returned error can't find the container with id e56ce5172dc0eac46a13b9de81cdbbd27aabecdc1116f94a354bedc973de3965 Jul 07 18:50:31.153382 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:31.153355 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" event={"ID":"6791089c-4b23-4323-96d1-d6b6b5a55ba9","Type":"ContainerStarted","Data":"e56ce5172dc0eac46a13b9de81cdbbd27aabecdc1116f94a354bedc973de3965"} Jul 07 18:50:31.279799 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:31.279779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:31.279890 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:31.279883 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:50:31.279952 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:31.279942 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls podName:ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:32.279929601 +0000 UTC m=+63.915706048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rkjwd" (UID: "ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7") : secret "samples-operator-tls" not found Jul 07 18:50:32.288827 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:32.288790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:32.289177 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:32.288927 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:50:32.289177 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:32.288993 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls podName:ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:34.288978616 +0000 UTC m=+65.924755062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rkjwd" (UID: "ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7") : secret "samples-operator-tls" not found Jul 07 18:50:34.161841 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.161809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" event={"ID":"6791089c-4b23-4323-96d1-d6b6b5a55ba9","Type":"ContainerStarted","Data":"22847c30e0026ad2af979670ed76df1c7088971ddfda9907266e481490b09187"} Jul 07 18:50:34.184232 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.184187 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pd9fx" podStartSLOduration=0.984570167 podStartE2EDuration="4.184172923s" totalImagesPullingTime="3.199602756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:34.18308052 +0000 UTC m=+65.818856989" watchObservedRunningTime="2026-07-07 18:50:34.184172923 +0000 UTC m=+65.819949424" Jul 07 18:50:34.303895 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.303871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:34.304030 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:34.304012 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:50:34.304082 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:34.304072 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls podName:ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:38.304058008 +0000 UTC m=+69.939834471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rkjwd" (UID: "ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7") : secret "samples-operator-tls" not found Jul 07 18:50:34.606816 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.606786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:34.606912 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.606821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:50:34.609003 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.608979 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m875j\" (UniqueName: \"kubernetes.io/projected/799a6737-cf62-4c79-b926-61659eb56632-kube-api-access-m875j\") pod \"network-check-target-mpbmd\" (UID: \"799a6737-cf62-4c79-b926-61659eb56632\") " pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:34.609699 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.609681 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 18:50:34.617260 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:34.617244 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 18:50:34.617332 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:34.617289 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs podName:90ceee22-2927-405a-9290-903c611272f4 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:38.617276119 +0000 UTC m=+130.253052569 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs") pod "network-metrics-daemon-wj5hl" (UID: "90ceee22-2927-405a-9290-903c611272f4") : secret "metrics-daemon-secret" not found Jul 07 18:50:34.707998 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.707976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:34.711262 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.711246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 18:50:34.721174 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.721156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d5900cf-f5bd-413e-aa33-3bac0738f6fe-original-pull-secret\") pod \"global-pull-secret-syncer-xwfcb\" (UID: \"5d5900cf-f5bd-413e-aa33-3bac0738f6fe\") " pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:34.730753 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.730735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwfcb" Jul 07 18:50:34.740111 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.740095 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mdbh\"" Jul 07 18:50:34.747510 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.747494 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:34.862625 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.862569 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwfcb"] Jul 07 18:50:34.865229 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:34.865200 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5900cf_f5bd_413e_aa33_3bac0738f6fe.slice/crio-5530e959b4336679348e1d8264273b3b0f2c18ae376a3f4b38cbe3348963c50d WatchSource:0}: Error finding container 5530e959b4336679348e1d8264273b3b0f2c18ae376a3f4b38cbe3348963c50d: Status 404 returned error can't find the container with id 5530e959b4336679348e1d8264273b3b0f2c18ae376a3f4b38cbe3348963c50d Jul 07 18:50:34.876055 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:34.876033 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpbmd"] Jul 07 18:50:34.878760 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:34.878739 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799a6737_cf62_4c79_b926_61659eb56632.slice/crio-02964c94da7e2db2953b559ac6d3f8fce4ca14404fcc5044b1168e4f98316a99 WatchSource:0}: Error finding container 02964c94da7e2db2953b559ac6d3f8fce4ca14404fcc5044b1168e4f98316a99: Status 404 returned error can't find the container with id 02964c94da7e2db2953b559ac6d3f8fce4ca14404fcc5044b1168e4f98316a99 Jul 07 18:50:35.164989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.164962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpbmd" event={"ID":"799a6737-cf62-4c79-b926-61659eb56632","Type":"ContainerStarted","Data":"4bf5688fd51a1c6abcf30075e2ae3da67bcaad850fcb3e26608c69531c5b010f"} Jul 07 18:50:35.165350 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.165003 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpbmd" event={"ID":"799a6737-cf62-4c79-b926-61659eb56632","Type":"ContainerStarted","Data":"02964c94da7e2db2953b559ac6d3f8fce4ca14404fcc5044b1168e4f98316a99"} Jul 07 18:50:35.165350 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.165053 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:50:35.166090 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.166071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwfcb" event={"ID":"5d5900cf-f5bd-413e-aa33-3bac0738f6fe","Type":"ContainerStarted","Data":"5530e959b4336679348e1d8264273b3b0f2c18ae376a3f4b38cbe3348963c50d"} Jul 07 18:50:35.184649 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.184603 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mpbmd" podStartSLOduration=66.184587986 podStartE2EDuration="1m6.184587986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:35.183564714 +0000 UTC m=+66.819341181" watchObservedRunningTime="2026-07-07 18:50:35.184587986 +0000 UTC m=+66.820364435" Jul 07 18:50:35.674274 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.674245 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cgw45"] Jul 07 18:50:35.676188 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.676169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.684187 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.684162 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 18:50:35.684293 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.684185 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 18:50:35.684293 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.684283 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ckhk8\"" Jul 07 18:50:35.684410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.684295 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 18:50:35.684468 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.684421 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 18:50:35.694759 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.694741 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cgw45"] Jul 07 18:50:35.816404 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.816372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.816538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.816414 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.816538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.816439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6791c204-7828-4bd1-bb57-834323e9cc1c-data-volume\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.816658 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.816547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9v2d\" (UniqueName: \"kubernetes.io/projected/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-api-access-w9v2d\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.816658 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.816583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6791c204-7828-4bd1-bb57-834323e9cc1c-crio-socket\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917161 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917283 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917283 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6791c204-7828-4bd1-bb57-834323e9cc1c-data-volume\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917283 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9v2d\" (UniqueName: \"kubernetes.io/projected/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-api-access-w9v2d\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917283 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:35.917265 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:35.917283 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6791c204-7828-4bd1-bb57-834323e9cc1c-crio-socket\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917537 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:35.917293 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:35.917537 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:35.917345 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:36.417325334 +0000 UTC m=+68.053101808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : configmap "kube-rbac-proxy" not found Jul 07 18:50:35.917537 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:35.917365 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:36.417355991 +0000 UTC m=+68.053132443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:35.917537 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6791c204-7828-4bd1-bb57-834323e9cc1c-crio-socket\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.917708 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.917638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6791c204-7828-4bd1-bb57-834323e9cc1c-data-volume\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:35.926905 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:35.926855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9v2d\" (UniqueName: \"kubernetes.io/projected/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-api-access-w9v2d\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:36.420155 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.420125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:36.420558 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.420158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:36.420558 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:36.420245 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:36.420558 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:36.420298 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.420285806 +0000 UTC m=+69.056062253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : configmap "kube-rbac-proxy" not found Jul 07 18:50:36.420558 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:36.420314 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:36.420558 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:36.420361 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.420346307 +0000 UTC m=+69.056122758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:36.803372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.803304 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96"] Jul 07 18:50:36.808608 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.808594 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" Jul 07 18:50:36.811670 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.811647 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 18:50:36.813015 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.812997 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 18:50:36.813093 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.813033 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-q54x9\"" Jul 07 18:50:36.816606 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.816587 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96"] Jul 07 18:50:36.923184 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:36.923161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grmq9\" (UniqueName: \"kubernetes.io/projected/0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c-kube-api-access-grmq9\") pod \"migrator-d57d58cc9-h8z96\" (UID: \"0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" Jul 07 18:50:37.024498 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.024468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grmq9\" (UniqueName: \"kubernetes.io/projected/0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c-kube-api-access-grmq9\") pod \"migrator-d57d58cc9-h8z96\" (UID: \"0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" Jul 07 18:50:37.024645 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.024514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:50:37.024645 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.024544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:50:37.024645 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.024621 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:50:37.024645 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.024631 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bc75c54d8-q2x5w: secret "image-registry-tls" not found Jul 07 18:50:37.024645 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.024639 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:37.024838 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.024673 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls podName:5e9b63bc-02be-456c-a702-044dd76e3420 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.024661808 +0000 UTC m=+100.660438255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls") pod "image-registry-7bc75c54d8-q2x5w" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420") : secret "image-registry-tls" not found Jul 07 18:50:37.024838 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.024685 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls podName:e533e5dd-bc91-442c-9491-330b2995001e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.024679124 +0000 UTC m=+100.660455571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls") pod "dns-default-sr6gt" (UID: "e533e5dd-bc91-442c-9491-330b2995001e") : secret "dns-default-metrics-tls" not found Jul 07 18:50:37.033944 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.033913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grmq9\" (UniqueName: \"kubernetes.io/projected/0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c-kube-api-access-grmq9\") pod \"migrator-d57d58cc9-h8z96\" (UID: \"0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" Jul 07 18:50:37.117575 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.117517 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" Jul 07 18:50:37.251849 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.251821 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96"] Jul 07 18:50:37.256106 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:37.256071 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cea0f9e_7e8e_42e3_96e8_29c1e06d8a8c.slice/crio-2acb82a797d55cae1302e05d0fa526c116ee50e443aac8ea26c4ffd232941a34 WatchSource:0}: Error finding container 2acb82a797d55cae1302e05d0fa526c116ee50e443aac8ea26c4ffd232941a34: Status 404 returned error can't find the container with id 2acb82a797d55cae1302e05d0fa526c116ee50e443aac8ea26c4ffd232941a34 Jul 07 18:50:37.427610 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.427584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:37.427876 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.427615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:37.427876 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.427694 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:37.427876 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.427695 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:37.427876 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.427734 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.42772295 +0000 UTC m=+71.063499397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:37.427876 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:37.427746 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.427740578 +0000 UTC m=+71.063517024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : configmap "kube-rbac-proxy" not found Jul 07 18:50:37.962885 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:37.962856 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbww7_68221979-c421-4004-986c-6443df47fb5d/dns-node-resolver/0.log" Jul 07 18:50:38.177057 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:38.177020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" event={"ID":"0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c","Type":"ContainerStarted","Data":"2acb82a797d55cae1302e05d0fa526c116ee50e443aac8ea26c4ffd232941a34"} Jul 07 18:50:38.333254 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:38.333185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:38.333375 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:38.333346 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:50:38.333447 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:38.333426 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls podName:ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:46.333406136 +0000 UTC m=+77.969182587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rkjwd" (UID: "ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7") : secret "samples-operator-tls" not found Jul 07 18:50:38.566505 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:38.566478 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cjbzs_6a49a9ba-a493-4e64-aa74-d27f0c1b123e/node-ca/0.log" Jul 07 18:50:39.441048 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:39.441012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:39.441230 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:39.441155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:39.441230 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:39.441170 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:39.441341 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:39.441234 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:39.441341 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:39.441245 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.441223646 +0000 UTC m=+75.077000094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:39.441341 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:39.441287 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.441271377 +0000 UTC m=+75.077047839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : configmap "kube-rbac-proxy" not found Jul 07 18:50:39.561854 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:39.561826 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d6vd8_593a4b8e-01db-4a92-9efc-cf12c51b91d0/serve-healthcheck-canary/0.log" Jul 07 18:50:40.184680 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:40.184643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" event={"ID":"0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c","Type":"ContainerStarted","Data":"ee398b71a6dbb2a2ae7ca19a4131805d9c28e332a5d629cbaaf8e54c2a62fd8c"} Jul 07 18:50:40.185053 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:40.184738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" event={"ID":"0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c","Type":"ContainerStarted","Data":"f73f98d60eb0003bceceea0010864978dce274194b9d3590c045e877cf2bc667"} Jul 07 18:50:40.186114 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:40.186092 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwfcb" event={"ID":"5d5900cf-f5bd-413e-aa33-3bac0738f6fe","Type":"ContainerStarted","Data":"f429b1df5ec1a2278831680857e3422a96f4d868ae9ca53585055f7a36eaf309"} Jul 07 18:50:40.206984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:40.206942 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h8z96" podStartSLOduration=1.4560570099999999 podStartE2EDuration="4.206930386s" totalImagesPullingTime="2.750873376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:40.205001984 +0000 UTC m=+71.840778451" watchObservedRunningTime="2026-07-07 18:50:40.206930386 +0000 UTC m=+71.842706854" Jul 07 18:50:40.229674 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:40.229628 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xwfcb" podStartSLOduration=66.079112155 podStartE2EDuration="1m11.229611233s" totalImagesPullingTime="5.150499078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:40.228991289 +0000 UTC m=+71.864767757" watchObservedRunningTime="2026-07-07 18:50:40.229611233 +0000 UTC m=+71.865387702" Jul 07 18:50:43.468490 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:43.468461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:43.468490 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:43.468493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:43.468878 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:43.468566 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:43.468878 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:43.468610 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:43.468878 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:43.468628 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:51.468615665 +0000 UTC m=+83.104392111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : configmap "kube-rbac-proxy" not found Jul 07 18:50:43.468878 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:50:43.468650 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls podName:6791c204-7828-4bd1-bb57-834323e9cc1c nodeName:}" failed. No retries permitted until 2026-07-07 18:50:51.468639302 +0000 UTC m=+83.104415748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cgw45" (UID: "6791c204-7828-4bd1-bb57-834323e9cc1c") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:46.390072 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:46.390038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:46.392355 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:46.392333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rkjwd\" (UID: \"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:46.447696 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:46.447672 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" Jul 07 18:50:46.562722 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:46.562643 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd"] Jul 07 18:50:47.206597 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:47.206545 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" event={"ID":"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7","Type":"ContainerStarted","Data":"719aea28c6881a9af7578526b09b95d5d58b6a2361a6454c7f5533ad1250bb1c"} Jul 07 18:50:49.215407 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:49.215355 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" event={"ID":"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7","Type":"ContainerStarted","Data":"08311889d53f99fbc45d91c34470f89f82e0ffac57a0ceecc83ece5c4691a288"} Jul 07 18:50:49.215751 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:49.215469 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" event={"ID":"ae5f0bc0-8215-4b4d-8909-0b9a4cd2b1a7","Type":"ContainerStarted","Data":"7c3d2a266e8b94a29a07775faf63e19cbb8f3d0c11da7625d3a7ffb3179ae3dc"} Jul 07 18:50:49.240662 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:49.240619 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rkjwd" podStartSLOduration=17.149800768 podStartE2EDuration="19.240605063s" totalImagesPullingTime="2.090804295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:49.239795207 +0000 UTC m=+80.875571674" watchObservedRunningTime="2026-07-07 18:50:49.240605063 +0000 UTC m=+80.876381530" Jul 07 18:50:51.522220 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:51.522084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:51.522220 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:51.522132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:51.522695 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:51.522668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6791c204-7828-4bd1-bb57-834323e9cc1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:51.524338 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:51.524319 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6791c204-7828-4bd1-bb57-834323e9cc1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgw45\" (UID: \"6791c204-7828-4bd1-bb57-834323e9cc1c\") " pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:51.585456 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:51.585420 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cgw45" Jul 07 18:50:51.708884 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:51.708855 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cgw45"] Jul 07 18:50:51.711267 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:51.711239 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6791c204_7828_4bd1_bb57_834323e9cc1c.slice/crio-7e4911100f248ef9fa08e1c4848b10bd5b08045bc6f5dd04185f19c510ff06ef WatchSource:0}: Error finding container 7e4911100f248ef9fa08e1c4848b10bd5b08045bc6f5dd04185f19c510ff06ef: Status 404 returned error can't find the container with id 7e4911100f248ef9fa08e1c4848b10bd5b08045bc6f5dd04185f19c510ff06ef Jul 07 18:50:52.227622 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:52.227543 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgw45" event={"ID":"6791c204-7828-4bd1-bb57-834323e9cc1c","Type":"ContainerStarted","Data":"7e4911100f248ef9fa08e1c4848b10bd5b08045bc6f5dd04185f19c510ff06ef"} Jul 07 18:50:56.241675 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:56.241600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgw45" event={"ID":"6791c204-7828-4bd1-bb57-834323e9cc1c","Type":"ContainerStarted","Data":"d010d17f32cd9290b785b21824798d5555c9985e4ed4530bfe05bfaf555a3b1d"} Jul 07 18:50:56.242002 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:56.241679 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgw45" event={"ID":"6791c204-7828-4bd1-bb57-834323e9cc1c","Type":"ContainerStarted","Data":"01142d7df8bd1ba6217ca2d83a6b9d0a55471303179c10c89b013c0b7b890f0b"} Jul 07 18:50:58.503218 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.503187 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw"] Jul 07 18:50:58.518148 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.518125 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.526552 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.526528 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 18:50:58.527353 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.527329 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 18:50:58.527469 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.527358 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 18:50:58.527527 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.527502 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 18:50:58.528013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.527992 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 18:50:58.528118 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.528050 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 18:50:58.528174 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.527995 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 18:50:58.536682 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.536662 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw"] Jul 07 18:50:58.676067 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.676046 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.676149 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.676073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.676149 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.676113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-ca\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.676214 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.676158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.676214 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.676173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-hub\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.676275 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.676258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p47j6\" (UniqueName: \"kubernetes.io/projected/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-kube-api-access-p47j6\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.777436 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.777333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.777436 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.777367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.777628 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.777464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-ca\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.777628 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.777487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.777628 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.777503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-hub\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.777628 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.777553 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p47j6\" (UniqueName: \"kubernetes.io/projected/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-kube-api-access-p47j6\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.778295 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.778236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.779933 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.779913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-hub\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.780020 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.779949 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-ca\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.780221 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.780203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.780273 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.780248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.798575 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.798549 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p47j6\" (UniqueName: \"kubernetes.io/projected/7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c-kube-api-access-p47j6\") pod \"cluster-proxy-proxy-agent-574c86666c-lgrxw\" (UID: \"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.835336 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.835318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" Jul 07 18:50:58.963981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:58.963953 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw"] Jul 07 18:50:58.967127 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:50:58.967106 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7537f670_06f5_4f2a_b9d4_0a2f2ba7f53c.slice/crio-5d502a976eddca4a2ea0681f86d260c7c9785015c0cc4171991223fff5e3043c WatchSource:0}: Error finding container 5d502a976eddca4a2ea0681f86d260c7c9785015c0cc4171991223fff5e3043c: Status 404 returned error can't find the container with id 5d502a976eddca4a2ea0681f86d260c7c9785015c0cc4171991223fff5e3043c Jul 07 18:50:59.253098 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:59.253067 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgw45" event={"ID":"6791c204-7828-4bd1-bb57-834323e9cc1c","Type":"ContainerStarted","Data":"15fc144e4aaea1345fbbc14231311c94e2a31ec1c352b6f13ef4467c740c4b24"} Jul 07 18:50:59.254118 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:59.254096 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" event={"ID":"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c","Type":"ContainerStarted","Data":"5d502a976eddca4a2ea0681f86d260c7c9785015c0cc4171991223fff5e3043c"} Jul 07 18:50:59.278358 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:50:59.278311 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cgw45" podStartSLOduration=17.474518156 podStartE2EDuration="24.278298522s" totalImagesPullingTime="6.803780366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:59.276141609 +0000 UTC m=+90.911918078" watchObservedRunningTime="2026-07-07 18:50:59.278298522 +0000 UTC m=+90.914074989" Jul 07 18:51:05.273550 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:05.273511 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" event={"ID":"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c","Type":"ContainerStarted","Data":"0de4e8bc8b5215eb0b82e8c33037495093b16fa8e53c9d85491f35c66890bcdf"} Jul 07 18:51:05.273550 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:05.273556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" event={"ID":"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c","Type":"ContainerStarted","Data":"e1519a2f69bb2679fceb00ebd314c9140519f553a8d8e4c8875a908f7eda460a"} Jul 07 18:51:05.274064 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:05.273568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" event={"ID":"7537f670-06f5-4f2a-b9d4-0a2f2ba7f53c","Type":"ContainerStarted","Data":"bfc0db44a53bec8aea81d0950101f52142adec080fbef768880657eb1baa0652"} Jul 07 18:51:05.296947 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:05.296904 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-574c86666c-lgrxw" podStartSLOduration=1.946101113 podStartE2EDuration="7.296889096s" totalImagesPullingTime="5.350787983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:05.294626528 +0000 UTC m=+96.930403008" watchObservedRunningTime="2026-07-07 18:51:05.296889096 +0000 UTC m=+96.932665582" Jul 07 18:51:06.171026 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:06.170994 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mpbmd" Jul 07 18:51:09.049286 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.049248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:51:09.049286 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.049276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:09.051482 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.051455 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e533e5dd-bc91-442c-9491-330b2995001e-metrics-tls\") pod \"dns-default-sr6gt\" (UID: \"e533e5dd-bc91-442c-9491-330b2995001e\") " pod="openshift-dns/dns-default-sr6gt" Jul 07 18:51:09.051800 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.051781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"image-registry-7bc75c54d8-q2x5w\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:09.141484 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.141460 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4c4xx\"" Jul 07 18:51:09.149833 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.149813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:09.183941 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.183911 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krxdw\"" Jul 07 18:51:09.192288 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.192253 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sr6gt" Jul 07 18:51:09.283721 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.283694 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc75c54d8-q2x5w"] Jul 07 18:51:09.285003 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:51:09.284981 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9b63bc_02be_456c_a702_044dd76e3420.slice/crio-a3f97bda6a46cbb9a8f36500e3d31c6b68f3df61e835f9669bbea0986df6babe WatchSource:0}: Error finding container a3f97bda6a46cbb9a8f36500e3d31c6b68f3df61e835f9669bbea0986df6babe: Status 404 returned error can't find the container with id a3f97bda6a46cbb9a8f36500e3d31c6b68f3df61e835f9669bbea0986df6babe Jul 07 18:51:09.326998 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:09.326975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sr6gt"] Jul 07 18:51:09.330954 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:51:09.330932 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode533e5dd_bc91_442c_9491_330b2995001e.slice/crio-526c473ba4b62376055baf630fa63e6d8b5dea6b9a401b9012dd5534fff000b4 WatchSource:0}: Error finding container 526c473ba4b62376055baf630fa63e6d8b5dea6b9a401b9012dd5534fff000b4: Status 404 returned error can't find the container with id 526c473ba4b62376055baf630fa63e6d8b5dea6b9a401b9012dd5534fff000b4 Jul 07 18:51:10.290702 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:10.290666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr6gt" event={"ID":"e533e5dd-bc91-442c-9491-330b2995001e","Type":"ContainerStarted","Data":"526c473ba4b62376055baf630fa63e6d8b5dea6b9a401b9012dd5534fff000b4"} Jul 07 18:51:10.291929 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:10.291911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" event={"ID":"5e9b63bc-02be-456c-a702-044dd76e3420","Type":"ContainerStarted","Data":"d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7"} Jul 07 18:51:10.292026 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:10.291942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" event={"ID":"5e9b63bc-02be-456c-a702-044dd76e3420","Type":"ContainerStarted","Data":"a3f97bda6a46cbb9a8f36500e3d31c6b68f3df61e835f9669bbea0986df6babe"} Jul 07 18:51:10.292079 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:10.292061 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:10.316246 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:10.316200 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" podStartSLOduration=101.3161845 podStartE2EDuration="1m41.3161845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:10.316083283 +0000 UTC m=+101.951859790" watchObservedRunningTime="2026-07-07 18:51:10.3161845 +0000 UTC m=+101.951960969" Jul 07 18:51:11.297139 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:11.297108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr6gt" event={"ID":"e533e5dd-bc91-442c-9491-330b2995001e","Type":"ContainerStarted","Data":"5d9b3ab92e4881a6add7656e9a4a0417a8e563a625e099bcf705ce50dfd452ff"} Jul 07 18:51:11.297487 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:11.297162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr6gt" event={"ID":"e533e5dd-bc91-442c-9491-330b2995001e","Type":"ContainerStarted","Data":"d8982186052eaf85f4ff5717aabe22a5516c83673599c8cdc38043aaa84ba2e6"} Jul 07 18:51:11.297487 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:11.297329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sr6gt" Jul 07 18:51:11.322087 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:11.322051 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sr6gt" podStartSLOduration=64.802431272 podStartE2EDuration="1m6.322038832s" totalImagesPullingTime="1.51960756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:11.321127914 +0000 UTC m=+102.956904381" watchObservedRunningTime="2026-07-07 18:51:11.322038832 +0000 UTC m=+102.957815309" Jul 07 18:51:17.937951 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.937922 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5k4k2"] Jul 07 18:51:17.940695 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.940679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:17.943170 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.943150 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 18:51:17.943809 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.943795 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 18:51:17.944991 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.944969 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 18:51:17.945084 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.945003 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 18:51:17.945084 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.945009 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 18:51:17.945084 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.945036 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fqp2b\"" Jul 07 18:51:17.945084 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:17.945041 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 18:51:18.108911 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.108888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109023 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.108920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-sys\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109023 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.108938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-root\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109023 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.108954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-metrics-client-ca\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109023 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.108971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109178 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.109064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6tqt\" (UniqueName: \"kubernetes.io/projected/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-kube-api-access-f6tqt\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109178 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.109090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-tls\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109178 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.109108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-wtmp\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.109178 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.109130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-textfile\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209602 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209602 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-sys\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209602 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-root\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-metrics-client-ca\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6tqt\" (UniqueName: \"kubernetes.io/projected/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-kube-api-access-f6tqt\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209677 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-sys\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209692 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-root\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-tls\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-wtmp\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:51:18.209759 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 18:51:18.209786 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-textfile\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.210172 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:51:18.209807 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-tls podName:e9a85040-b0dd-48ab-b09c-30a1ef0bcf93 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:18.709790684 +0000 UTC m=+110.345567133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-tls") pod "node-exporter-5k4k2" (UID: "e9a85040-b0dd-48ab-b09c-30a1ef0bcf93") : secret "node-exporter-tls" not found Jul 07 18:51:18.210172 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.209954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-wtmp\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.210172 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.210128 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-textfile\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.210271 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.210198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-metrics-client-ca\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.210271 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.210242 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-accelerators-collector-config\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.211621 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.211603 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.218611 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.218594 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6tqt\" (UniqueName: \"kubernetes.io/projected/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-kube-api-access-f6tqt\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.712025 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.711996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-tls\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.713948 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.713927 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9a85040-b0dd-48ab-b09c-30a1ef0bcf93-node-exporter-tls\") pod \"node-exporter-5k4k2\" (UID: \"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93\") " pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.849911 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:18.849889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5k4k2" Jul 07 18:51:18.859381 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:51:18.859358 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a85040_b0dd_48ab_b09c_30a1ef0bcf93.slice/crio-b4f72cfa691919ec4c4eb3a13671546f9a0120c4836831d8a2acf9c3bbca7005 WatchSource:0}: Error finding container b4f72cfa691919ec4c4eb3a13671546f9a0120c4836831d8a2acf9c3bbca7005: Status 404 returned error can't find the container with id b4f72cfa691919ec4c4eb3a13671546f9a0120c4836831d8a2acf9c3bbca7005 Jul 07 18:51:19.323489 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:19.323455 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k4k2" event={"ID":"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93","Type":"ContainerStarted","Data":"b4f72cfa691919ec4c4eb3a13671546f9a0120c4836831d8a2acf9c3bbca7005"} Jul 07 18:51:20.328127 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:20.328094 2560 generic.go:356] "Generic (PLEG): container finished" podID="e9a85040-b0dd-48ab-b09c-30a1ef0bcf93" containerID="24d6f3b426aa928261dfd9091ac910908371ee46df22fa88e7c57f289f3670a9" exitCode=0 Jul 07 18:51:20.328568 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:20.328143 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k4k2" event={"ID":"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93","Type":"ContainerDied","Data":"24d6f3b426aa928261dfd9091ac910908371ee46df22fa88e7c57f289f3670a9"} Jul 07 18:51:20.898411 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:20.898369 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc75c54d8-q2x5w"] Jul 07 18:51:21.305089 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:21.305018 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sr6gt" Jul 07 18:51:21.332762 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:21.332723 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k4k2" event={"ID":"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93","Type":"ContainerStarted","Data":"cb9a70ab3e6c8b1f023d43927fa9b57386a7da50bf3dd28b03834e967424db2c"} Jul 07 18:51:21.333099 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:21.332777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5k4k2" event={"ID":"e9a85040-b0dd-48ab-b09c-30a1ef0bcf93","Type":"ContainerStarted","Data":"f162ce9b3fe16d095251dec41985cf0ee7b475117819776b9e6674fd2354840c"} Jul 07 18:51:21.360936 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:21.360890 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5k4k2" podStartSLOduration=3.446379595 podStartE2EDuration="4.360876458s" totalImagesPullingTime="856.030487ms" totalInitContainerRuntime="58.466376ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:21.359601299 +0000 UTC m=+112.995377766" watchObservedRunningTime="2026-07-07 18:51:21.360876458 +0000 UTC m=+112.996652927" Jul 07 18:51:30.904411 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:30.904361 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:38.640670 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:38.640639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:51:38.642683 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:38.642657 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ceee22-2927-405a-9290-903c611272f4-metrics-certs\") pod \"network-metrics-daemon-wj5hl\" (UID: \"90ceee22-2927-405a-9290-903c611272f4\") " pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:51:38.943573 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:38.943549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x88g7\"" Jul 07 18:51:38.950894 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:38.950872 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5hl" Jul 07 18:51:39.192805 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:39.192777 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj5hl"] Jul 07 18:51:39.194886 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:51:39.194830 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ceee22_2927_405a_9290_903c611272f4.slice/crio-470b2b32a8d8ed483de6f60c5db25751fdd931680ae81171d521e0799d8d01f7 WatchSource:0}: Error finding container 470b2b32a8d8ed483de6f60c5db25751fdd931680ae81171d521e0799d8d01f7: Status 404 returned error can't find the container with id 470b2b32a8d8ed483de6f60c5db25751fdd931680ae81171d521e0799d8d01f7 Jul 07 18:51:39.388159 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:39.388135 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj5hl" event={"ID":"90ceee22-2927-405a-9290-903c611272f4","Type":"ContainerStarted","Data":"470b2b32a8d8ed483de6f60c5db25751fdd931680ae81171d521e0799d8d01f7"} Jul 07 18:51:40.393366 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:40.393334 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj5hl" event={"ID":"90ceee22-2927-405a-9290-903c611272f4","Type":"ContainerStarted","Data":"9df19c106989ec62cd5ac03b8760cc21c8c7b2616e53faa6d817f6815af3238d"} Jul 07 18:51:40.393804 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:40.393416 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj5hl" event={"ID":"90ceee22-2927-405a-9290-903c611272f4","Type":"ContainerStarted","Data":"71e789514a4170610fea58ed4552ecddfe4ce37146a0d7ff875ad0039cdbf903"} Jul 07 18:51:40.412976 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:40.412935 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wj5hl" podStartSLOduration=130.525138654 podStartE2EDuration="2m11.412920668s" totalImagesPullingTime="887.782014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:40.412517028 +0000 UTC m=+132.048293496" watchObservedRunningTime="2026-07-07 18:51:40.412920668 +0000 UTC m=+132.048697132" Jul 07 18:51:45.916901 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:45.916866 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" podUID="5e9b63bc-02be-456c-a702-044dd76e3420" containerName="registry" containerID="cri-o://d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7" gracePeriod=30 Jul 07 18:51:46.149121 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.149097 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:46.188599 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188541 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2kjx\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-kube-api-access-l2kjx\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188599 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188585 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-trusted-ca\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188606 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-image-registry-private-configuration\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188630 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-bound-sa-token\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188672 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188702 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e9b63bc-02be-456c-a702-044dd76e3420-ca-trust-extracted\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188733 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-registry-certificates\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.188774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.188768 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-installation-pull-secrets\") pod \"5e9b63bc-02be-456c-a702-044dd76e3420\" (UID: \"5e9b63bc-02be-456c-a702-044dd76e3420\") " Jul 07 18:51:46.189092 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.189064 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:51:46.189475 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.189451 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:51:46.191082 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.191055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-kube-api-access-l2kjx" (OuterVolumeSpecName: "kube-api-access-l2kjx") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "kube-api-access-l2kjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:51:46.191197 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.191083 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:51:46.191197 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.191150 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:51:46.191288 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.191238 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:51:46.191324 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.191313 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:51:46.196893 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.196868 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e9b63bc-02be-456c-a702-044dd76e3420-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5e9b63bc-02be-456c-a702-044dd76e3420" (UID: "5e9b63bc-02be-456c-a702-044dd76e3420"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:51:46.289342 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289321 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-registry-tls\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289342 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289339 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e9b63bc-02be-456c-a702-044dd76e3420-ca-trust-extracted\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289488 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289349 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-registry-certificates\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289488 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289358 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-installation-pull-secrets\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289488 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289366 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2kjx\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-kube-api-access-l2kjx\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289488 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289374 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e9b63bc-02be-456c-a702-044dd76e3420-trusted-ca\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289488 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289382 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e9b63bc-02be-456c-a702-044dd76e3420-image-registry-private-configuration\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.289488 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.289401 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e9b63bc-02be-456c-a702-044dd76e3420-bound-sa-token\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:51:46.411932 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.411907 2560 generic.go:356] "Generic (PLEG): container finished" podID="5e9b63bc-02be-456c-a702-044dd76e3420" containerID="d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7" exitCode=0 Jul 07 18:51:46.411996 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.411960 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" Jul 07 18:51:46.411996 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.411973 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" event={"ID":"5e9b63bc-02be-456c-a702-044dd76e3420","Type":"ContainerDied","Data":"d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7"} Jul 07 18:51:46.412099 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.412030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc75c54d8-q2x5w" event={"ID":"5e9b63bc-02be-456c-a702-044dd76e3420","Type":"ContainerDied","Data":"a3f97bda6a46cbb9a8f36500e3d31c6b68f3df61e835f9669bbea0986df6babe"} Jul 07 18:51:46.412099 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.412049 2560 scope.go:117] "RemoveContainer" containerID="d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7" Jul 07 18:51:46.420161 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.420138 2560 scope.go:117] "RemoveContainer" containerID="d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7" Jul 07 18:51:46.420416 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:51:46.420378 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7\": container with ID starting with d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7 not found: ID does not exist" containerID="d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7" Jul 07 18:51:46.420478 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.420422 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7"} err="failed to get container status \"d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7\": rpc error: code = NotFound desc = could not find container \"d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7\": container with ID starting with d41e24ef026e7c9cb79cb206917f10eb9610d41fffb885f84cbd3e073211fdf7 not found: ID does not exist" Jul 07 18:51:46.435538 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.435516 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bc75c54d8-q2x5w"] Jul 07 18:51:46.437717 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.437699 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bc75c54d8-q2x5w"] Jul 07 18:51:46.925294 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:51:46.925265 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e9b63bc-02be-456c-a702-044dd76e3420" path="/var/lib/kubelet/pods/5e9b63bc-02be-456c-a702-044dd76e3420/volumes" Jul 07 18:53:25.980697 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.980666 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv"] Jul 07 18:53:25.981138 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.980891 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e9b63bc-02be-456c-a702-044dd76e3420" containerName="registry" Jul 07 18:53:25.981138 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.980901 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e9b63bc-02be-456c-a702-044dd76e3420" containerName="registry" Jul 07 18:53:25.981138 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.980947 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e9b63bc-02be-456c-a702-044dd76e3420" containerName="registry" Jul 07 18:53:25.983814 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.983798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:25.986664 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.986643 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xvrxp\"" Jul 07 18:53:25.986776 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.986690 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 18:53:25.988030 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.988014 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 18:53:25.995462 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:25.995443 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv"] Jul 07 18:53:26.133986 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.133958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.134143 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.133996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhx2\" (UniqueName: \"kubernetes.io/projected/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-kube-api-access-hjhx2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.134143 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.134019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.234615 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.234546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhx2\" (UniqueName: \"kubernetes.io/projected/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-kube-api-access-hjhx2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.234615 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.234588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.234791 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.234636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.234949 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.234930 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.235014 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.234973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.244272 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.244245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhx2\" (UniqueName: \"kubernetes.io/projected/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-kube-api-access-hjhx2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.292172 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.292153 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:26.411795 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.411764 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv"] Jul 07 18:53:26.414767 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:53:26.414741 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43dd6e0_81c6_4f9b_9635_378d9e5ef2b3.slice/crio-cb31b08ad666d142c5b3df85d89edf26741b13d3b76adc8ea667426190b1445f WatchSource:0}: Error finding container cb31b08ad666d142c5b3df85d89edf26741b13d3b76adc8ea667426190b1445f: Status 404 returned error can't find the container with id cb31b08ad666d142c5b3df85d89edf26741b13d3b76adc8ea667426190b1445f Jul 07 18:53:26.716037 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:26.716005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" event={"ID":"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3","Type":"ContainerStarted","Data":"cb31b08ad666d142c5b3df85d89edf26741b13d3b76adc8ea667426190b1445f"} Jul 07 18:53:32.738548 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:32.738490 2560 generic.go:356] "Generic (PLEG): container finished" podID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerID="00f0fa2ea3cab80ee38664ad4a3c7b2424f5de7275a14e35893f46ca8ca99f15" exitCode=0 Jul 07 18:53:32.738837 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:32.738564 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" event={"ID":"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3","Type":"ContainerDied","Data":"00f0fa2ea3cab80ee38664ad4a3c7b2424f5de7275a14e35893f46ca8ca99f15"} Jul 07 18:53:35.749556 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:35.749526 2560 generic.go:356] "Generic (PLEG): container finished" podID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerID="2343302b7d18ed218070cfa78dcbe8d3e9941185d0e234b559d992ffdf036d3b" exitCode=0 Jul 07 18:53:35.749986 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:35.749590 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" event={"ID":"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3","Type":"ContainerDied","Data":"2343302b7d18ed218070cfa78dcbe8d3e9941185d0e234b559d992ffdf036d3b"} Jul 07 18:53:42.777859 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:42.777824 2560 generic.go:356] "Generic (PLEG): container finished" podID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerID="4a3daf72c4e1257bbc4b44cb16c725db2f534064f0a4195cfa92ea3440ff37ce" exitCode=0 Jul 07 18:53:42.778190 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:42.777900 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" event={"ID":"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3","Type":"ContainerDied","Data":"4a3daf72c4e1257bbc4b44cb16c725db2f534064f0a4195cfa92ea3440ff37ce"} Jul 07 18:53:43.902838 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.902818 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:43.945899 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.945872 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhx2\" (UniqueName: \"kubernetes.io/projected/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-kube-api-access-hjhx2\") pod \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " Jul 07 18:53:43.946013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.945917 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-util\") pod \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " Jul 07 18:53:43.946013 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.945964 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-bundle\") pod \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\" (UID: \"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3\") " Jul 07 18:53:43.946631 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.946597 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-bundle" (OuterVolumeSpecName: "bundle") pod "a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" (UID: "a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:53:43.947940 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.947911 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-kube-api-access-hjhx2" (OuterVolumeSpecName: "kube-api-access-hjhx2") pod "a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" (UID: "a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3"). InnerVolumeSpecName "kube-api-access-hjhx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:53:43.949801 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:43.949780 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-util" (OuterVolumeSpecName: "util") pod "a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" (UID: "a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:53:44.046518 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:44.046459 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhx2\" (UniqueName: \"kubernetes.io/projected/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-kube-api-access-hjhx2\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:53:44.046518 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:44.046488 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:53:44.046518 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:44.046498 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:53:44.786277 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:44.786249 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" event={"ID":"a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3","Type":"ContainerDied","Data":"cb31b08ad666d142c5b3df85d89edf26741b13d3b76adc8ea667426190b1445f"} Jul 07 18:53:44.786277 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:44.786267 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hntcv" Jul 07 18:53:44.786484 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:44.786294 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb31b08ad666d142c5b3df85d89edf26741b13d3b76adc8ea667426190b1445f" Jul 07 18:53:49.029033 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029005 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2"] Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029206 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="util" Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029216 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="util" Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029222 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="pull" Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029228 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="pull" Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029239 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="extract" Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029244 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="extract" Jul 07 18:53:49.029372 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.029281 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a43dd6e0-81c6-4f9b-9635-378d9e5ef2b3" containerName="extract" Jul 07 18:53:49.071861 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.071838 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2"] Jul 07 18:53:49.071984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.071921 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.075166 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.075138 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-sx2tb\"" Jul 07 18:53:49.075288 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.075172 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:53:49.075288 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.075172 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 18:53:49.075423 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.075386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8dc6bdb-ff3d-4df7-b0ad-532606640213-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bm7d2\" (UID: \"c8dc6bdb-ff3d-4df7-b0ad-532606640213\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.075467 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.075453 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnh8\" (UniqueName: \"kubernetes.io/projected/c8dc6bdb-ff3d-4df7-b0ad-532606640213-kube-api-access-7jnh8\") pod \"cert-manager-operator-controller-manager-55c444bf86-bm7d2\" (UID: \"c8dc6bdb-ff3d-4df7-b0ad-532606640213\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.176255 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.176232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnh8\" (UniqueName: \"kubernetes.io/projected/c8dc6bdb-ff3d-4df7-b0ad-532606640213-kube-api-access-7jnh8\") pod \"cert-manager-operator-controller-manager-55c444bf86-bm7d2\" (UID: \"c8dc6bdb-ff3d-4df7-b0ad-532606640213\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.176366 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.176272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8dc6bdb-ff3d-4df7-b0ad-532606640213-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bm7d2\" (UID: \"c8dc6bdb-ff3d-4df7-b0ad-532606640213\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.176640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.176624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8dc6bdb-ff3d-4df7-b0ad-532606640213-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bm7d2\" (UID: \"c8dc6bdb-ff3d-4df7-b0ad-532606640213\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.187986 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.187958 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnh8\" (UniqueName: \"kubernetes.io/projected/c8dc6bdb-ff3d-4df7-b0ad-532606640213-kube-api-access-7jnh8\") pod \"cert-manager-operator-controller-manager-55c444bf86-bm7d2\" (UID: \"c8dc6bdb-ff3d-4df7-b0ad-532606640213\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.379806 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.379756 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" Jul 07 18:53:49.534196 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.534166 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2"] Jul 07 18:53:49.537624 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:53:49.537599 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8dc6bdb_ff3d_4df7_b0ad_532606640213.slice/crio-a7b20107f5d07679d39e768c969117436739a8e34ac4dcc7f68c0f90d8ec42e7 WatchSource:0}: Error finding container a7b20107f5d07679d39e768c969117436739a8e34ac4dcc7f68c0f90d8ec42e7: Status 404 returned error can't find the container with id a7b20107f5d07679d39e768c969117436739a8e34ac4dcc7f68c0f90d8ec42e7 Jul 07 18:53:49.803196 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:49.803166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" event={"ID":"c8dc6bdb-ff3d-4df7-b0ad-532606640213","Type":"ContainerStarted","Data":"a7b20107f5d07679d39e768c969117436739a8e34ac4dcc7f68c0f90d8ec42e7"} Jul 07 18:53:53.817544 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:53.817505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" event={"ID":"c8dc6bdb-ff3d-4df7-b0ad-532606640213","Type":"ContainerStarted","Data":"0f1406fbc985c94981a98c0b03c390e24659d9a5266dbb18f37e1f817a88f0a2"} Jul 07 18:53:53.858034 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:53.857472 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bm7d2" podStartSLOduration=1.762491468 podStartE2EDuration="5.857453665s" totalImagesPullingTime="4.094962197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:53:53.854735319 +0000 UTC m=+265.490511781" watchObservedRunningTime="2026-07-07 18:53:53.857453665 +0000 UTC m=+265.493230133" Jul 07 18:53:54.412041 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.411999 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f"] Jul 07 18:53:54.434571 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.434542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.437178 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.437145 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f"] Jul 07 18:53:54.438238 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.437766 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xvrxp\"" Jul 07 18:53:54.438238 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.437891 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 18:53:54.438238 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.438169 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 18:53:54.512383 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.512362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.512517 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.512408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvhbg\" (UniqueName: \"kubernetes.io/projected/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-kube-api-access-pvhbg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.512517 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.512457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.613294 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.613274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.613413 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.613297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvhbg\" (UniqueName: \"kubernetes.io/projected/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-kube-api-access-pvhbg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.613413 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.613323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.613660 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.613642 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.613699 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.613662 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.645497 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.645476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvhbg\" (UniqueName: \"kubernetes.io/projected/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-kube-api-access-pvhbg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.746350 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.746301 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:53:54.907833 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:53:54.907806 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca83b50_261d_4cbb_bfdf_49d4c477ccf9.slice/crio-047f991b4a8802e5f1313d4cffbf78df3c3c0631da05d0d3e01fcea1a06394ce WatchSource:0}: Error finding container 047f991b4a8802e5f1313d4cffbf78df3c3c0631da05d0d3e01fcea1a06394ce: Status 404 returned error can't find the container with id 047f991b4a8802e5f1313d4cffbf78df3c3c0631da05d0d3e01fcea1a06394ce Jul 07 18:53:54.910914 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:54.910882 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f"] Jul 07 18:53:55.826517 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:55.826488 2560 generic.go:356] "Generic (PLEG): container finished" podID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerID="0cb770a55828c751cd105c2d7a8be7c8f35afc4ae25142c842d1324f1467892b" exitCode=0 Jul 07 18:53:55.826693 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:55.826528 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" event={"ID":"cca83b50-261d-4cbb-bfdf-49d4c477ccf9","Type":"ContainerDied","Data":"0cb770a55828c751cd105c2d7a8be7c8f35afc4ae25142c842d1324f1467892b"} Jul 07 18:53:55.826693 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:55.826562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" event={"ID":"cca83b50-261d-4cbb-bfdf-49d4c477ccf9","Type":"ContainerStarted","Data":"047f991b4a8802e5f1313d4cffbf78df3c3c0631da05d0d3e01fcea1a06394ce"} Jul 07 18:53:58.061327 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.061301 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w"] Jul 07 18:53:58.063353 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.063336 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.066210 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.066192 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4jjkj\"" Jul 07 18:53:58.066291 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.066220 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 18:53:58.067614 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.067595 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 18:53:58.074466 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.074446 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w"] Jul 07 18:53:58.136106 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.136083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/effe2a4b-76db-4774-91cf-6ef256138e6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jvm5w\" (UID: \"effe2a4b-76db-4774-91cf-6ef256138e6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.136210 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.136114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cj2p\" (UniqueName: \"kubernetes.io/projected/effe2a4b-76db-4774-91cf-6ef256138e6d-kube-api-access-4cj2p\") pod \"cert-manager-cainjector-559cdd8c87-jvm5w\" (UID: \"effe2a4b-76db-4774-91cf-6ef256138e6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.236519 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.236497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/effe2a4b-76db-4774-91cf-6ef256138e6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jvm5w\" (UID: \"effe2a4b-76db-4774-91cf-6ef256138e6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.236629 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.236527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cj2p\" (UniqueName: \"kubernetes.io/projected/effe2a4b-76db-4774-91cf-6ef256138e6d-kube-api-access-4cj2p\") pod \"cert-manager-cainjector-559cdd8c87-jvm5w\" (UID: \"effe2a4b-76db-4774-91cf-6ef256138e6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.247582 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.247564 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/effe2a4b-76db-4774-91cf-6ef256138e6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jvm5w\" (UID: \"effe2a4b-76db-4774-91cf-6ef256138e6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.247687 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.247672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cj2p\" (UniqueName: \"kubernetes.io/projected/effe2a4b-76db-4774-91cf-6ef256138e6d-kube-api-access-4cj2p\") pod \"cert-manager-cainjector-559cdd8c87-jvm5w\" (UID: \"effe2a4b-76db-4774-91cf-6ef256138e6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.371822 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.371794 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" Jul 07 18:53:58.492949 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.492877 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w"] Jul 07 18:53:58.495197 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:53:58.495172 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeffe2a4b_76db_4774_91cf_6ef256138e6d.slice/crio-bc1829967c900f462b5c511613464b07ca3f30d2866c3f0560b3209d2c4b6e7b WatchSource:0}: Error finding container bc1829967c900f462b5c511613464b07ca3f30d2866c3f0560b3209d2c4b6e7b: Status 404 returned error can't find the container with id bc1829967c900f462b5c511613464b07ca3f30d2866c3f0560b3209d2c4b6e7b Jul 07 18:53:58.838780 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.838705 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" event={"ID":"effe2a4b-76db-4774-91cf-6ef256138e6d","Type":"ContainerStarted","Data":"bc1829967c900f462b5c511613464b07ca3f30d2866c3f0560b3209d2c4b6e7b"} Jul 07 18:53:58.840275 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.840251 2560 generic.go:356] "Generic (PLEG): container finished" podID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerID="4d2d3df7a0009e35f8310a3f6a80c9917830e2722ad7e12634d8be7120c9f833" exitCode=0 Jul 07 18:53:58.840410 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:58.840295 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" event={"ID":"cca83b50-261d-4cbb-bfdf-49d4c477ccf9","Type":"ContainerDied","Data":"4d2d3df7a0009e35f8310a3f6a80c9917830e2722ad7e12634d8be7120c9f833"} Jul 07 18:53:59.847155 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:59.847119 2560 generic.go:356] "Generic (PLEG): container finished" podID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerID="4fc37faeebd3b3af60872e709b1fe57a5ef43ed1b99b434eaca09af75161a052" exitCode=0 Jul 07 18:53:59.847593 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:53:59.847213 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" event={"ID":"cca83b50-261d-4cbb-bfdf-49d4c477ccf9","Type":"ContainerDied","Data":"4fc37faeebd3b3af60872e709b1fe57a5ef43ed1b99b434eaca09af75161a052"} Jul 07 18:54:00.857365 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:00.853544 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" event={"ID":"effe2a4b-76db-4774-91cf-6ef256138e6d","Type":"ContainerStarted","Data":"dfbf01865903782d294b29aa7afca240b23667ef53454dc3e19d277d281c0d8f"} Jul 07 18:54:00.879992 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:00.879743 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jvm5w" podStartSLOduration=0.576792575 podStartE2EDuration="2.879727447s" totalImagesPullingTime="2.302934872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:00.879074152 +0000 UTC m=+272.514850647" watchObservedRunningTime="2026-07-07 18:54:00.879727447 +0000 UTC m=+272.515503915" Jul 07 18:54:00.990141 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:00.990115 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:54:01.060812 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.060750 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-util\") pod \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " Jul 07 18:54:01.060812 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.060796 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvhbg\" (UniqueName: \"kubernetes.io/projected/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-kube-api-access-pvhbg\") pod \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " Jul 07 18:54:01.060968 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.060817 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-bundle\") pod \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\" (UID: \"cca83b50-261d-4cbb-bfdf-49d4c477ccf9\") " Jul 07 18:54:01.061245 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.061218 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-bundle" (OuterVolumeSpecName: "bundle") pod "cca83b50-261d-4cbb-bfdf-49d4c477ccf9" (UID: "cca83b50-261d-4cbb-bfdf-49d4c477ccf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:54:01.062738 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.062712 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-kube-api-access-pvhbg" (OuterVolumeSpecName: "kube-api-access-pvhbg") pod "cca83b50-261d-4cbb-bfdf-49d4c477ccf9" (UID: "cca83b50-261d-4cbb-bfdf-49d4c477ccf9"). InnerVolumeSpecName "kube-api-access-pvhbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:54:01.066529 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.066502 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-util" (OuterVolumeSpecName: "util") pod "cca83b50-261d-4cbb-bfdf-49d4c477ccf9" (UID: "cca83b50-261d-4cbb-bfdf-49d4c477ccf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:54:01.162188 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.162161 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:54:01.162188 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.162185 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvhbg\" (UniqueName: \"kubernetes.io/projected/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-kube-api-access-pvhbg\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:54:01.162332 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.162195 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca83b50-261d-4cbb-bfdf-49d4c477ccf9-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:54:01.858796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.858773 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" Jul 07 18:54:01.858796 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.858776 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f59l4f" event={"ID":"cca83b50-261d-4cbb-bfdf-49d4c477ccf9","Type":"ContainerDied","Data":"047f991b4a8802e5f1313d4cffbf78df3c3c0631da05d0d3e01fcea1a06394ce"} Jul 07 18:54:01.859208 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:01.858822 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="047f991b4a8802e5f1313d4cffbf78df3c3c0631da05d0d3e01fcea1a06394ce" Jul 07 18:54:05.826880 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.826850 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-64bbm"] Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827070 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="pull" Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827081 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="pull" Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827090 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="util" Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827096 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="util" Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827101 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="extract" Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827107 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="extract" Jul 07 18:54:05.827248 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.827154 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca83b50-261d-4cbb-bfdf-49d4c477ccf9" containerName="extract" Jul 07 18:54:05.830042 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.830027 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:05.832956 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.832938 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xpsh4\"" Jul 07 18:54:05.846062 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.846042 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-64bbm"] Jul 07 18:54:05.893253 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.893230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057c49dc-8a96-4f15-9ad8-531c0963f77f-bound-sa-token\") pod \"cert-manager-55b4d954d5-64bbm\" (UID: \"057c49dc-8a96-4f15-9ad8-531c0963f77f\") " pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:05.893352 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.893279 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7n5n\" (UniqueName: \"kubernetes.io/projected/057c49dc-8a96-4f15-9ad8-531c0963f77f-kube-api-access-j7n5n\") pod \"cert-manager-55b4d954d5-64bbm\" (UID: \"057c49dc-8a96-4f15-9ad8-531c0963f77f\") " pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:05.994010 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.993974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057c49dc-8a96-4f15-9ad8-531c0963f77f-bound-sa-token\") pod \"cert-manager-55b4d954d5-64bbm\" (UID: \"057c49dc-8a96-4f15-9ad8-531c0963f77f\") " pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:05.994133 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:05.994108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7n5n\" (UniqueName: \"kubernetes.io/projected/057c49dc-8a96-4f15-9ad8-531c0963f77f-kube-api-access-j7n5n\") pod \"cert-manager-55b4d954d5-64bbm\" (UID: \"057c49dc-8a96-4f15-9ad8-531c0963f77f\") " pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:06.004755 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.004728 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/057c49dc-8a96-4f15-9ad8-531c0963f77f-bound-sa-token\") pod \"cert-manager-55b4d954d5-64bbm\" (UID: \"057c49dc-8a96-4f15-9ad8-531c0963f77f\") " pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:06.004755 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.004752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7n5n\" (UniqueName: \"kubernetes.io/projected/057c49dc-8a96-4f15-9ad8-531c0963f77f-kube-api-access-j7n5n\") pod \"cert-manager-55b4d954d5-64bbm\" (UID: \"057c49dc-8a96-4f15-9ad8-531c0963f77f\") " pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:06.138770 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.138687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-64bbm" Jul 07 18:54:06.265071 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.265024 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-64bbm"] Jul 07 18:54:06.267207 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:54:06.267176 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod057c49dc_8a96_4f15_9ad8_531c0963f77f.slice/crio-6878119b79b468a8eda45ff78cd7c417f66b063049f06bdaeac9781ffbf3fa6e WatchSource:0}: Error finding container 6878119b79b468a8eda45ff78cd7c417f66b063049f06bdaeac9781ffbf3fa6e: Status 404 returned error can't find the container with id 6878119b79b468a8eda45ff78cd7c417f66b063049f06bdaeac9781ffbf3fa6e Jul 07 18:54:06.878037 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.878005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-64bbm" event={"ID":"057c49dc-8a96-4f15-9ad8-531c0963f77f","Type":"ContainerStarted","Data":"ebeea219c9b0ea36c1811d6125e4262e6026dce77441142abb0d5ff8888c4b3b"} Jul 07 18:54:06.878440 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.878046 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-64bbm" event={"ID":"057c49dc-8a96-4f15-9ad8-531c0963f77f","Type":"ContainerStarted","Data":"6878119b79b468a8eda45ff78cd7c417f66b063049f06bdaeac9781ffbf3fa6e"} Jul 07 18:54:06.906306 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:06.906257 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-64bbm" podStartSLOduration=1.906241716 podStartE2EDuration="1.906241716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:06.905557461 +0000 UTC m=+278.541333927" watchObservedRunningTime="2026-07-07 18:54:06.906241716 +0000 UTC m=+278.542018182" Jul 07 18:54:12.860233 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.860198 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms"] Jul 07 18:54:12.863503 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.863488 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:12.866528 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.866507 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 18:54:12.867852 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.867831 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 18:54:12.867944 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.867850 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xvrxp\"" Jul 07 18:54:12.876877 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.876855 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms"] Jul 07 18:54:12.940654 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.940614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:12.940654 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.940654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwnd\" (UniqueName: \"kubernetes.io/projected/805f6715-4974-4b99-84e5-308dec232f8d-kube-api-access-vkwnd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:12.940850 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:12.940731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.041457 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.041428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.041625 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.041477 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.041625 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.041506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwnd\" (UniqueName: \"kubernetes.io/projected/805f6715-4974-4b99-84e5-308dec232f8d-kube-api-access-vkwnd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.041881 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.041860 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.041881 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.041875 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.052652 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.052626 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwnd\" (UniqueName: \"kubernetes.io/projected/805f6715-4974-4b99-84e5-308dec232f8d-kube-api-access-vkwnd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.172075 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.172045 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:13.294528 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.294506 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms"] Jul 07 18:54:13.297020 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:54:13.296993 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805f6715_4974_4b99_84e5_308dec232f8d.slice/crio-1ee3d2c3e243b7671bcbf49a14b956575892532c62b07fa477d095f3d6ac473c WatchSource:0}: Error finding container 1ee3d2c3e243b7671bcbf49a14b956575892532c62b07fa477d095f3d6ac473c: Status 404 returned error can't find the container with id 1ee3d2c3e243b7671bcbf49a14b956575892532c62b07fa477d095f3d6ac473c Jul 07 18:54:13.903726 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.903693 2560 generic.go:356] "Generic (PLEG): container finished" podID="805f6715-4974-4b99-84e5-308dec232f8d" containerID="5693830abce29db37ec16289bd799f401dc78676afb53bd3597ab25b9771612e" exitCode=0 Jul 07 18:54:13.904124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.903768 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" event={"ID":"805f6715-4974-4b99-84e5-308dec232f8d","Type":"ContainerDied","Data":"5693830abce29db37ec16289bd799f401dc78676afb53bd3597ab25b9771612e"} Jul 07 18:54:13.904124 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:13.903804 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" event={"ID":"805f6715-4974-4b99-84e5-308dec232f8d","Type":"ContainerStarted","Data":"1ee3d2c3e243b7671bcbf49a14b956575892532c62b07fa477d095f3d6ac473c"} Jul 07 18:54:14.908924 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:14.908892 2560 generic.go:356] "Generic (PLEG): container finished" podID="805f6715-4974-4b99-84e5-308dec232f8d" containerID="f8a993d8143df77da6e90e8f73147a0a68ae4978f53f55a8debd1ded8048758b" exitCode=0 Jul 07 18:54:14.909263 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:14.908972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" event={"ID":"805f6715-4974-4b99-84e5-308dec232f8d","Type":"ContainerDied","Data":"f8a993d8143df77da6e90e8f73147a0a68ae4978f53f55a8debd1ded8048758b"} Jul 07 18:54:15.914164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:15.914134 2560 generic.go:356] "Generic (PLEG): container finished" podID="805f6715-4974-4b99-84e5-308dec232f8d" containerID="7f254a30f4063a85ce6d7e302ae8956e93f8e773ec82854fb9dc449d0a076396" exitCode=0 Jul 07 18:54:15.914543 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:15.914181 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" event={"ID":"805f6715-4974-4b99-84e5-308dec232f8d","Type":"ContainerDied","Data":"7f254a30f4063a85ce6d7e302ae8956e93f8e773ec82854fb9dc449d0a076396"} Jul 07 18:54:17.037848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.037826 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:17.067089 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.067063 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkwnd\" (UniqueName: \"kubernetes.io/projected/805f6715-4974-4b99-84e5-308dec232f8d-kube-api-access-vkwnd\") pod \"805f6715-4974-4b99-84e5-308dec232f8d\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " Jul 07 18:54:17.067210 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.067108 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-util\") pod \"805f6715-4974-4b99-84e5-308dec232f8d\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " Jul 07 18:54:17.067210 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.067163 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-bundle\") pod \"805f6715-4974-4b99-84e5-308dec232f8d\" (UID: \"805f6715-4974-4b99-84e5-308dec232f8d\") " Jul 07 18:54:17.068274 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.068245 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-bundle" (OuterVolumeSpecName: "bundle") pod "805f6715-4974-4b99-84e5-308dec232f8d" (UID: "805f6715-4974-4b99-84e5-308dec232f8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:54:17.069311 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.069281 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805f6715-4974-4b99-84e5-308dec232f8d-kube-api-access-vkwnd" (OuterVolumeSpecName: "kube-api-access-vkwnd") pod "805f6715-4974-4b99-84e5-308dec232f8d" (UID: "805f6715-4974-4b99-84e5-308dec232f8d"). InnerVolumeSpecName "kube-api-access-vkwnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:54:17.073766 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.073738 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-util" (OuterVolumeSpecName: "util") pod "805f6715-4974-4b99-84e5-308dec232f8d" (UID: "805f6715-4974-4b99-84e5-308dec232f8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:54:17.167891 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.167831 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkwnd\" (UniqueName: \"kubernetes.io/projected/805f6715-4974-4b99-84e5-308dec232f8d-kube-api-access-vkwnd\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:54:17.167891 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.167854 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:54:17.167891 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.167863 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805f6715-4974-4b99-84e5-308dec232f8d-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:54:17.923226 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.923195 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" event={"ID":"805f6715-4974-4b99-84e5-308dec232f8d","Type":"ContainerDied","Data":"1ee3d2c3e243b7671bcbf49a14b956575892532c62b07fa477d095f3d6ac473c"} Jul 07 18:54:17.923386 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.923235 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ee3d2c3e243b7671bcbf49a14b956575892532c62b07fa477d095f3d6ac473c" Jul 07 18:54:17.923386 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:17.923244 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrzsms" Jul 07 18:54:28.802483 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:28.802459 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 18:54:29.996774 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.996737 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc"] Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997108 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="util" Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997124 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="util" Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997143 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="extract" Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997151 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="extract" Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997161 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="pull" Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997169 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="pull" Jul 07 18:54:29.999164 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:29.997221 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="805f6715-4974-4b99-84e5-308dec232f8d" containerName="extract" Jul 07 18:54:30.000036 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.000019 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.004177 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.004156 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 18:54:30.005819 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.005796 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 18:54:30.005819 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.005814 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 18:54:30.005967 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.005795 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 18:54:30.006026 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.005972 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:54:30.006119 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.006086 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9sm6b\"" Jul 07 18:54:30.016319 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.016296 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc"] Jul 07 18:54:30.052597 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.052572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f82208ed-d786-4ee0-9922-809f51186b67-manager-config\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.052724 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.052622 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblqt\" (UniqueName: \"kubernetes.io/projected/f82208ed-d786-4ee0-9922-809f51186b67-kube-api-access-bblqt\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.052724 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.052648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f82208ed-d786-4ee0-9922-809f51186b67-metrics-cert\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.052830 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.052730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f82208ed-d786-4ee0-9922-809f51186b67-cert\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.153771 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.153739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblqt\" (UniqueName: \"kubernetes.io/projected/f82208ed-d786-4ee0-9922-809f51186b67-kube-api-access-bblqt\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.153888 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.153771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f82208ed-d786-4ee0-9922-809f51186b67-metrics-cert\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.153888 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.153807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f82208ed-d786-4ee0-9922-809f51186b67-cert\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.153888 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.153842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f82208ed-d786-4ee0-9922-809f51186b67-manager-config\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.154493 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.154473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f82208ed-d786-4ee0-9922-809f51186b67-manager-config\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.155910 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.155893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f82208ed-d786-4ee0-9922-809f51186b67-cert\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.156094 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.156075 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f82208ed-d786-4ee0-9922-809f51186b67-metrics-cert\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.164298 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.164274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblqt\" (UniqueName: \"kubernetes.io/projected/f82208ed-d786-4ee0-9922-809f51186b67-kube-api-access-bblqt\") pod \"lws-controller-manager-6d5b9d7dd9-9tgjc\" (UID: \"f82208ed-d786-4ee0-9922-809f51186b67\") " pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.309377 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.309310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:30.445316 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.445289 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc"] Jul 07 18:54:30.447003 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:54:30.446974 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82208ed_d786_4ee0_9922_809f51186b67.slice/crio-39980787658f1c83f54834b01fb66ceaffc735f07ad0d76bbabcf5ddf9675f65 WatchSource:0}: Error finding container 39980787658f1c83f54834b01fb66ceaffc735f07ad0d76bbabcf5ddf9675f65: Status 404 returned error can't find the container with id 39980787658f1c83f54834b01fb66ceaffc735f07ad0d76bbabcf5ddf9675f65 Jul 07 18:54:30.448901 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.448885 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:54:30.484236 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.484211 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8"] Jul 07 18:54:30.488347 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.488332 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.492830 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.492808 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 18:54:30.493820 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.493804 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 18:54:30.494254 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.494235 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 18:54:30.494683 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.494671 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 18:54:30.494905 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.494887 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8s9r\"" Jul 07 18:54:30.521147 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.521129 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8"] Jul 07 18:54:30.557166 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.557137 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.557258 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.557172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-manifests\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.557258 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.557238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.557353 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.557276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-tmp\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.557353 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.557301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjtf\" (UniqueName: \"kubernetes.io/projected/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-kube-api-access-dgjtf\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.658053 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.658032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-tmp\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.658158 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.658061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjtf\" (UniqueName: \"kubernetes.io/projected/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-kube-api-access-dgjtf\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.658158 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.658082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.658158 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.658108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-manifests\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.658314 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.658186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.658585 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.658559 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-manifests\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.660229 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.660211 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-tmp\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.660325 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.660311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.660365 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.660343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.670614 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.670590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjtf\" (UniqueName: \"kubernetes.io/projected/f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778-kube-api-access-dgjtf\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8\" (UID: \"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.798214 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.798188 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:30.926788 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.926704 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8"] Jul 07 18:54:30.930376 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:54:30.930346 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b0a2cc_2bcf_490e_9e9f_f73d9a35f778.slice/crio-05955498f9569237b046dda3670f58758c45159df75be3fd633649355ee71c4a WatchSource:0}: Error finding container 05955498f9569237b046dda3670f58758c45159df75be3fd633649355ee71c4a: Status 404 returned error can't find the container with id 05955498f9569237b046dda3670f58758c45159df75be3fd633649355ee71c4a Jul 07 18:54:30.979897 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.979863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" event={"ID":"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778","Type":"ContainerStarted","Data":"05955498f9569237b046dda3670f58758c45159df75be3fd633649355ee71c4a"} Jul 07 18:54:30.981249 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:30.981225 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" event={"ID":"f82208ed-d786-4ee0-9922-809f51186b67","Type":"ContainerStarted","Data":"39980787658f1c83f54834b01fb66ceaffc735f07ad0d76bbabcf5ddf9675f65"} Jul 07 18:54:35.000082 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:35.000041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" event={"ID":"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778","Type":"ContainerStarted","Data":"1c9da54ed3b7eef5437e166a7bc29f9a10330e79feac83e6d1be3107cca00cac"} Jul 07 18:54:35.001694 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:35.001668 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" event={"ID":"f82208ed-d786-4ee0-9922-809f51186b67","Type":"ContainerStarted","Data":"a3d4e923cd699dda30bf46f4b05a4e9c195475c887eba50006b471b2da43626e"} Jul 07 18:54:35.001807 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:35.001796 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:35.052489 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:35.052444 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" podStartSLOduration=2.347778219 podStartE2EDuration="6.052429891s" totalImagesPullingTime="3.704651672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:35.051747685 +0000 UTC m=+306.687524154" watchObservedRunningTime="2026-07-07 18:54:35.052429891 +0000 UTC m=+306.688206362" Jul 07 18:54:36.007282 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:36.007252 2560 generic.go:356] "Generic (PLEG): container finished" podID="f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778" containerID="1c9da54ed3b7eef5437e166a7bc29f9a10330e79feac83e6d1be3107cca00cac" exitCode=0 Jul 07 18:54:36.007751 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:36.007314 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" event={"ID":"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778","Type":"ContainerDied","Data":"1c9da54ed3b7eef5437e166a7bc29f9a10330e79feac83e6d1be3107cca00cac"} Jul 07 18:54:37.013677 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:37.013645 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" event={"ID":"f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778","Type":"ContainerStarted","Data":"7bd4635e1ae1166890ae8d31b8928aa356c8415fbbb9f618bb346de58a3d0138"} Jul 07 18:54:37.014025 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:37.013743 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:37.043118 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:37.043078 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" podStartSLOduration=2.119682835 podStartE2EDuration="7.043066572s" totalImagesPullingTime="3.843173281s" totalInitContainerRuntime="1.080210456s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:37.040531172 +0000 UTC m=+308.676307642" watchObservedRunningTime="2026-07-07 18:54:37.043066572 +0000 UTC m=+308.678843040" Jul 07 18:54:46.009932 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:46.009900 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d5b9d7dd9-9tgjc" Jul 07 18:54:48.020713 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:48.020681 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8" Jul 07 18:54:58.988368 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:58.988333 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv"] Jul 07 18:54:58.990904 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:58.990880 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:58.995739 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:58.995715 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 18:54:58.995906 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:58.995890 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 18:54:58.995984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:58.995935 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tnx9l\"" Jul 07 18:54:58.995984 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:58.995935 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 18:54:59.013761 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.013736 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv"] Jul 07 18:54:59.152148 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152265 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152265 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152265 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152265 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr5z6\" (UniqueName: \"kubernetes.io/projected/f90d9ae9-6fdf-47b2-84c2-a155805713bd-kube-api-access-fr5z6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152405 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152405 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152405 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152320 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.152505 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.152379 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253663 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253663 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253663 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr5z6\" (UniqueName: \"kubernetes.io/projected/f90d9ae9-6fdf-47b2-84c2-a155805713bd-kube-api-access-fr5z6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.253848 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.254132 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.253943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.254178 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.254147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.254300 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.254281 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.254356 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.254290 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.254525 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.254506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.255876 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.255853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.256095 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.256079 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.266120 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.266099 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90d9ae9-6fdf-47b2-84c2-a155805713bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.278803 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.278776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr5z6\" (UniqueName: \"kubernetes.io/projected/f90d9ae9-6fdf-47b2-84c2-a155805713bd-kube-api-access-fr5z6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c5wmv\" (UID: \"f90d9ae9-6fdf-47b2-84c2-a155805713bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.307230 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.307210 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:54:59.445205 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.445178 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv"] Jul 07 18:54:59.447225 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:54:59.447198 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90d9ae9_6fdf_47b2_84c2_a155805713bd.slice/crio-b3e7b01c4db76cf292bd689e211d01e10bea7b304085c63092877f19fb65c349 WatchSource:0}: Error finding container b3e7b01c4db76cf292bd689e211d01e10bea7b304085c63092877f19fb65c349: Status 404 returned error can't find the container with id b3e7b01c4db76cf292bd689e211d01e10bea7b304085c63092877f19fb65c349 Jul 07 18:54:59.741805 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.741784 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s"] Jul 07 18:54:59.744241 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.744225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.747163 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.747132 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 18:54:59.747259 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.747135 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 18:54:59.747259 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.747241 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xrpc2\"" Jul 07 18:54:59.747520 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.747506 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 18:54:59.774611 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.774587 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s"] Jul 07 18:54:59.857333 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857313 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.857445 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.857445 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d244d\" (UniqueName: \"kubernetes.io/projected/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-kube-api-access-d244d\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.857445 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.857571 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857454 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.857571 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.857571 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.857517 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958029 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958118 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958118 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958118 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958241 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958241 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d244d\" (UniqueName: \"kubernetes.io/projected/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-kube-api-access-d244d\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958241 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.958934 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.958907 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.960319 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.960295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.960466 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.960450 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.960581 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.960564 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.960620 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.960576 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.972602 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.972581 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:54:59.972824 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:54:59.972807 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d244d\" (UniqueName: \"kubernetes.io/projected/d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62-kube-api-access-d244d\") pod \"istiod-openshift-gateway-94bb8fbfd-qgl8s\" (UID: \"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:55:00.053789 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:00.053716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:55:00.108809 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:00.108767 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" event={"ID":"f90d9ae9-6fdf-47b2-84c2-a155805713bd","Type":"ContainerStarted","Data":"b3e7b01c4db76cf292bd689e211d01e10bea7b304085c63092877f19fb65c349"} Jul 07 18:55:00.191383 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:00.191358 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s"] Jul 07 18:55:00.193127 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:55:00.193100 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd078dcdb_7b8e_4fac_8a3e_84bdfa5c9b62.slice/crio-28209fffa33ebae6fba948bd5d43f44f952a347baf2fc838e4f539081b09a921 WatchSource:0}: Error finding container 28209fffa33ebae6fba948bd5d43f44f952a347baf2fc838e4f539081b09a921: Status 404 returned error can't find the container with id 28209fffa33ebae6fba948bd5d43f44f952a347baf2fc838e4f539081b09a921 Jul 07 18:55:01.114807 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:01.114770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" event={"ID":"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62","Type":"ContainerStarted","Data":"28209fffa33ebae6fba948bd5d43f44f952a347baf2fc838e4f539081b09a921"} Jul 07 18:55:02.733048 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:02.733004 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 18:55:02.733314 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:02.733086 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 18:55:02.733314 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:02.733114 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 18:55:03.126842 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:03.126746 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" event={"ID":"f90d9ae9-6fdf-47b2-84c2-a155805713bd","Type":"ContainerStarted","Data":"13155176dd06c8009e9c0948f92ec93f5523bbd74e2c237a83ee101ec1fa45e9"} Jul 07 18:55:03.177668 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:03.177603 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" podStartSLOduration=1.89389479 podStartE2EDuration="5.177582474s" totalImagesPullingTime="3.283687684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:03.176382396 +0000 UTC m=+334.812158864" watchObservedRunningTime="2026-07-07 18:55:03.177582474 +0000 UTC m=+334.813358945" Jul 07 18:55:03.307543 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:03.307512 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:55:03.312460 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:03.312434 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:55:04.131238 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:04.131197 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:55:04.132357 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:04.132335 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c5wmv" Jul 07 18:55:04.877295 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:04.877264 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 18:55:04.877418 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:04.877334 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 18:55:05.137069 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:05.136993 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" event={"ID":"d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62","Type":"ContainerStarted","Data":"5c24fbbce15b51a34476289d5c9441bc2c3982e7230b2c9846b662796c7fdffe"} Jul 07 18:55:05.165846 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:05.165803 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" podStartSLOduration=1.4838091 podStartE2EDuration="6.165786188s" totalImagesPullingTime="4.681977088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:05.162580049 +0000 UTC m=+336.798356519" watchObservedRunningTime="2026-07-07 18:55:05.165786188 +0000 UTC m=+336.801562656" Jul 07 18:55:06.141356 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:06.141325 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:55:06.142643 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:55:06.142624 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgl8s" Jul 07 18:56:07.345733 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.345700 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx"] Jul 07 18:56:07.347982 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.347965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.350981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.350951 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 18:56:07.350981 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.350951 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gpj4b\"" Jul 07 18:56:07.352317 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.352291 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 18:56:07.359084 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.359058 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx"] Jul 07 18:56:07.445233 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.445212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.445335 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.445243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.445335 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.445284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqrs\" (UniqueName: \"kubernetes.io/projected/f5014522-b10e-45bf-9d38-91475cddb9e9-kube-api-access-xfqrs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.546168 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.546136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqrs\" (UniqueName: \"kubernetes.io/projected/f5014522-b10e-45bf-9d38-91475cddb9e9-kube-api-access-xfqrs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.546269 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.546185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.546269 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.546208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.546541 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.546527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.546583 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.546571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.555527 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.555501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqrs\" (UniqueName: \"kubernetes.io/projected/f5014522-b10e-45bf-9d38-91475cddb9e9-kube-api-access-xfqrs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.657677 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.657657 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:07.791357 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.791281 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx"] Jul 07 18:56:07.793445 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:56:07.793418 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5014522_b10e_45bf_9d38_91475cddb9e9.slice/crio-98ef6311f7a13f5e905228b5d26dcbb87a10a02356a830ec725625b831f43924 WatchSource:0}: Error finding container 98ef6311f7a13f5e905228b5d26dcbb87a10a02356a830ec725625b831f43924: Status 404 returned error can't find the container with id 98ef6311f7a13f5e905228b5d26dcbb87a10a02356a830ec725625b831f43924 Jul 07 18:56:07.936683 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.936627 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc"] Jul 07 18:56:07.938722 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.938704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:07.953100 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:07.953068 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc"] Jul 07 18:56:08.049639 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.049617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.049746 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.049666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxs4\" (UniqueName: \"kubernetes.io/projected/25030d75-1ec9-400f-95f7-8d0d9718ad31-kube-api-access-fbxs4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.049746 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.049722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.151066 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.151041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxs4\" (UniqueName: \"kubernetes.io/projected/25030d75-1ec9-400f-95f7-8d0d9718ad31-kube-api-access-fbxs4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.151158 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.151087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.151158 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.151122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.151463 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.151448 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.151512 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.151494 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.160455 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.160430 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxs4\" (UniqueName: \"kubernetes.io/projected/25030d75-1ec9-400f-95f7-8d0d9718ad31-kube-api-access-fbxs4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.262869 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.262819 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:08.388783 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.388760 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc"] Jul 07 18:56:08.391284 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:56:08.391259 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25030d75_1ec9_400f_95f7_8d0d9718ad31.slice/crio-b4e3db70f4e3ea7bd3c0163624715542bcf492d1b8f3681063323cdd357c2c97 WatchSource:0}: Error finding container b4e3db70f4e3ea7bd3c0163624715542bcf492d1b8f3681063323cdd357c2c97: Status 404 returned error can't find the container with id b4e3db70f4e3ea7bd3c0163624715542bcf492d1b8f3681063323cdd357c2c97 Jul 07 18:56:08.410189 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.410163 2560 generic.go:356] "Generic (PLEG): container finished" podID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerID="b5d0dd76105cdf665af718f087691b4809a77db9313b1718ab61ca730a1f6ee4" exitCode=0 Jul 07 18:56:08.410274 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.410250 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" event={"ID":"f5014522-b10e-45bf-9d38-91475cddb9e9","Type":"ContainerDied","Data":"b5d0dd76105cdf665af718f087691b4809a77db9313b1718ab61ca730a1f6ee4"} Jul 07 18:56:08.410313 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.410292 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" event={"ID":"f5014522-b10e-45bf-9d38-91475cddb9e9","Type":"ContainerStarted","Data":"98ef6311f7a13f5e905228b5d26dcbb87a10a02356a830ec725625b831f43924"} Jul 07 18:56:08.411555 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.411536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" event={"ID":"25030d75-1ec9-400f-95f7-8d0d9718ad31","Type":"ContainerStarted","Data":"b4e3db70f4e3ea7bd3c0163624715542bcf492d1b8f3681063323cdd357c2c97"} Jul 07 18:56:08.538494 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.538444 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p"] Jul 07 18:56:08.540464 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.540449 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.552674 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.552652 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p"] Jul 07 18:56:08.655564 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.655545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.655678 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.655577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nmht\" (UniqueName: \"kubernetes.io/projected/cc656729-46ea-4bc8-ad5b-c8e35d646b95-kube-api-access-6nmht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.655678 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.655598 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.757989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.756861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.757989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.756925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nmht\" (UniqueName: \"kubernetes.io/projected/cc656729-46ea-4bc8-ad5b-c8e35d646b95-kube-api-access-6nmht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.757989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.757034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.757989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.757456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.757989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.757691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.772912 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.772884 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nmht\" (UniqueName: \"kubernetes.io/projected/cc656729-46ea-4bc8-ad5b-c8e35d646b95-kube-api-access-6nmht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.851935 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.851890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:08.975747 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:08.975683 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p"] Jul 07 18:56:08.978136 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:56:08.978112 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc656729_46ea_4bc8_ad5b_c8e35d646b95.slice/crio-d0cf85206cbcc51f9fc5d1e65406e9ff9cedce8dbd97171def056cb7be62b8a9 WatchSource:0}: Error finding container d0cf85206cbcc51f9fc5d1e65406e9ff9cedce8dbd97171def056cb7be62b8a9: Status 404 returned error can't find the container with id d0cf85206cbcc51f9fc5d1e65406e9ff9cedce8dbd97171def056cb7be62b8a9 Jul 07 18:56:09.143701 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.143673 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml"] Jul 07 18:56:09.147260 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.147241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.160255 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.160228 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml"] Jul 07 18:56:09.259588 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.259567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.259678 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.259610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.259678 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.259666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55kzc\" (UniqueName: \"kubernetes.io/projected/71d2d672-dea8-47c2-95a8-546cf6591193-kube-api-access-55kzc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.360377 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.360354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.360495 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.360409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55kzc\" (UniqueName: \"kubernetes.io/projected/71d2d672-dea8-47c2-95a8-546cf6591193-kube-api-access-55kzc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.360495 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.360447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.360673 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.360657 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.360718 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.360702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.370500 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.370477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55kzc\" (UniqueName: \"kubernetes.io/projected/71d2d672-dea8-47c2-95a8-546cf6591193-kube-api-access-55kzc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.417640 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.417593 2560 generic.go:356] "Generic (PLEG): container finished" podID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerID="274b3dc0576dd780ed0094261034d2715b533064e2ece1a80465ff9a9f09d9b0" exitCode=0 Jul 07 18:56:09.417924 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.417676 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" event={"ID":"f5014522-b10e-45bf-9d38-91475cddb9e9","Type":"ContainerDied","Data":"274b3dc0576dd780ed0094261034d2715b533064e2ece1a80465ff9a9f09d9b0"} Jul 07 18:56:09.419196 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.419172 2560 generic.go:356] "Generic (PLEG): container finished" podID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerID="5f7bbb685d856b2c166193951c4ccad2ad65d0dfc5d7016437d51ca89e76890b" exitCode=0 Jul 07 18:56:09.419283 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.419259 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" event={"ID":"cc656729-46ea-4bc8-ad5b-c8e35d646b95","Type":"ContainerDied","Data":"5f7bbb685d856b2c166193951c4ccad2ad65d0dfc5d7016437d51ca89e76890b"} Jul 07 18:56:09.419332 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.419293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" event={"ID":"cc656729-46ea-4bc8-ad5b-c8e35d646b95","Type":"ContainerStarted","Data":"d0cf85206cbcc51f9fc5d1e65406e9ff9cedce8dbd97171def056cb7be62b8a9"} Jul 07 18:56:09.420782 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.420764 2560 generic.go:356] "Generic (PLEG): container finished" podID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerID="6635fe567639e1de7db6f8995242df3585cdea81327cccd1ded640ce4a9a43ba" exitCode=0 Jul 07 18:56:09.420854 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.420792 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" event={"ID":"25030d75-1ec9-400f-95f7-8d0d9718ad31","Type":"ContainerDied","Data":"6635fe567639e1de7db6f8995242df3585cdea81327cccd1ded640ce4a9a43ba"} Jul 07 18:56:09.455717 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.455699 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:09.590244 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:09.590222 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml"] Jul 07 18:56:09.626113 ip-10-0-140-153 kubenswrapper[2560]: W0707 18:56:09.626089 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d2d672_dea8_47c2_95a8_546cf6591193.slice/crio-883922e10cb0e720d9180dfc043699a1c917ed7ed7eb9a60d3cfc9b1f2981b7e WatchSource:0}: Error finding container 883922e10cb0e720d9180dfc043699a1c917ed7ed7eb9a60d3cfc9b1f2981b7e: Status 404 returned error can't find the container with id 883922e10cb0e720d9180dfc043699a1c917ed7ed7eb9a60d3cfc9b1f2981b7e Jul 07 18:56:09.738910 ip-10-0-140-153 kubenswrapper[2560]: E0707 18:56:09.738887 2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d2d672_dea8_47c2_95a8_546cf6591193.slice/crio-07e08ba9af7bf58bc9c240824a5ab55beefe9a14e6ef9981c4cf995cd92aa20a.scope\": RecentStats: unable to find data in memory cache]" Jul 07 18:56:10.431540 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.431510 2560 generic.go:356] "Generic (PLEG): container finished" podID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerID="24e4c211a8b18e24e7e1a23321cd32ae88181df51ca08bd962bfdb8dde393cc5" exitCode=0 Jul 07 18:56:10.431849 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.431597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" event={"ID":"f5014522-b10e-45bf-9d38-91475cddb9e9","Type":"ContainerDied","Data":"24e4c211a8b18e24e7e1a23321cd32ae88181df51ca08bd962bfdb8dde393cc5"} Jul 07 18:56:10.433157 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.433136 2560 generic.go:356] "Generic (PLEG): container finished" podID="71d2d672-dea8-47c2-95a8-546cf6591193" containerID="07e08ba9af7bf58bc9c240824a5ab55beefe9a14e6ef9981c4cf995cd92aa20a" exitCode=0 Jul 07 18:56:10.433270 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.433251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" event={"ID":"71d2d672-dea8-47c2-95a8-546cf6591193","Type":"ContainerDied","Data":"07e08ba9af7bf58bc9c240824a5ab55beefe9a14e6ef9981c4cf995cd92aa20a"} Jul 07 18:56:10.433317 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.433295 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" event={"ID":"71d2d672-dea8-47c2-95a8-546cf6591193","Type":"ContainerStarted","Data":"883922e10cb0e720d9180dfc043699a1c917ed7ed7eb9a60d3cfc9b1f2981b7e"} Jul 07 18:56:10.434946 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.434926 2560 generic.go:356] "Generic (PLEG): container finished" podID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerID="7efac31f127fc477c72058f716b69471e9ccfd1356c9f5ac3fefa504674efaf9" exitCode=0 Jul 07 18:56:10.435044 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.434999 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" event={"ID":"cc656729-46ea-4bc8-ad5b-c8e35d646b95","Type":"ContainerDied","Data":"7efac31f127fc477c72058f716b69471e9ccfd1356c9f5ac3fefa504674efaf9"} Jul 07 18:56:10.437012 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.436991 2560 generic.go:356] "Generic (PLEG): container finished" podID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerID="50aceb6bfc0b884cf8cf53b97f28712b4badf36ce6b430ccb41414790495d410" exitCode=0 Jul 07 18:56:10.437103 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:10.437018 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" event={"ID":"25030d75-1ec9-400f-95f7-8d0d9718ad31","Type":"ContainerDied","Data":"50aceb6bfc0b884cf8cf53b97f28712b4badf36ce6b430ccb41414790495d410"} Jul 07 18:56:11.446528 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.446499 2560 generic.go:356] "Generic (PLEG): container finished" podID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerID="3aa0cf2d57c25a962bfc9621470491950e3867ad65a2e3eb310f5c9382439c7d" exitCode=0 Jul 07 18:56:11.446941 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.446585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" event={"ID":"cc656729-46ea-4bc8-ad5b-c8e35d646b95","Type":"ContainerDied","Data":"3aa0cf2d57c25a962bfc9621470491950e3867ad65a2e3eb310f5c9382439c7d"} Jul 07 18:56:11.448781 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.448757 2560 generic.go:356] "Generic (PLEG): container finished" podID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerID="75fe431d6f6d00eba9b4ce818490f6ea60a47239fa9954707d146e7ff2490f53" exitCode=0 Jul 07 18:56:11.448908 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.448845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" event={"ID":"25030d75-1ec9-400f-95f7-8d0d9718ad31","Type":"ContainerDied","Data":"75fe431d6f6d00eba9b4ce818490f6ea60a47239fa9954707d146e7ff2490f53"} Jul 07 18:56:11.450606 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.450585 2560 generic.go:356] "Generic (PLEG): container finished" podID="71d2d672-dea8-47c2-95a8-546cf6591193" containerID="0f8afa2a0826140d23ee7eeed6f02890db36b79bc2a67ab909453bf23da20781" exitCode=0 Jul 07 18:56:11.450680 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.450654 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" event={"ID":"71d2d672-dea8-47c2-95a8-546cf6591193","Type":"ContainerDied","Data":"0f8afa2a0826140d23ee7eeed6f02890db36b79bc2a67ab909453bf23da20781"} Jul 07 18:56:11.576642 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.576611 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:11.676305 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.676281 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfqrs\" (UniqueName: \"kubernetes.io/projected/f5014522-b10e-45bf-9d38-91475cddb9e9-kube-api-access-xfqrs\") pod \"f5014522-b10e-45bf-9d38-91475cddb9e9\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " Jul 07 18:56:11.676453 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.676350 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-util\") pod \"f5014522-b10e-45bf-9d38-91475cddb9e9\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " Jul 07 18:56:11.676453 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.676407 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-bundle\") pod \"f5014522-b10e-45bf-9d38-91475cddb9e9\" (UID: \"f5014522-b10e-45bf-9d38-91475cddb9e9\") " Jul 07 18:56:11.677000 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.676971 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-bundle" (OuterVolumeSpecName: "bundle") pod "f5014522-b10e-45bf-9d38-91475cddb9e9" (UID: "f5014522-b10e-45bf-9d38-91475cddb9e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:11.678421 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.678402 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5014522-b10e-45bf-9d38-91475cddb9e9-kube-api-access-xfqrs" (OuterVolumeSpecName: "kube-api-access-xfqrs") pod "f5014522-b10e-45bf-9d38-91475cddb9e9" (UID: "f5014522-b10e-45bf-9d38-91475cddb9e9"). InnerVolumeSpecName "kube-api-access-xfqrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:56:11.681336 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.681305 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-util" (OuterVolumeSpecName: "util") pod "f5014522-b10e-45bf-9d38-91475cddb9e9" (UID: "f5014522-b10e-45bf-9d38-91475cddb9e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:11.777129 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.777082 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:11.777129 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.777102 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5014522-b10e-45bf-9d38-91475cddb9e9-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:11.777129 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:11.777111 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfqrs\" (UniqueName: \"kubernetes.io/projected/f5014522-b10e-45bf-9d38-91475cddb9e9-kube-api-access-xfqrs\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:12.458356 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.458326 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" Jul 07 18:56:12.458757 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.458321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx" event={"ID":"f5014522-b10e-45bf-9d38-91475cddb9e9","Type":"ContainerDied","Data":"98ef6311f7a13f5e905228b5d26dcbb87a10a02356a830ec725625b831f43924"} Jul 07 18:56:12.458757 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.458447 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98ef6311f7a13f5e905228b5d26dcbb87a10a02356a830ec725625b831f43924" Jul 07 18:56:12.460732 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.460703 2560 generic.go:356] "Generic (PLEG): container finished" podID="71d2d672-dea8-47c2-95a8-546cf6591193" containerID="4d3267b2256ee22a13fbef89f0b258a6b2e421c5ee458cef646c592ce2b1c3d8" exitCode=0 Jul 07 18:56:12.460868 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.460799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" event={"ID":"71d2d672-dea8-47c2-95a8-546cf6591193","Type":"ContainerDied","Data":"4d3267b2256ee22a13fbef89f0b258a6b2e421c5ee458cef646c592ce2b1c3d8"} Jul 07 18:56:12.588533 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.588512 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:12.614158 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.614140 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:12.682343 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682318 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-util\") pod \"25030d75-1ec9-400f-95f7-8d0d9718ad31\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " Jul 07 18:56:12.682485 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682435 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-bundle\") pod \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " Jul 07 18:56:12.682485 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682469 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-util\") pod \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " Jul 07 18:56:12.682562 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682498 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-bundle\") pod \"25030d75-1ec9-400f-95f7-8d0d9718ad31\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " Jul 07 18:56:12.682562 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682546 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbxs4\" (UniqueName: \"kubernetes.io/projected/25030d75-1ec9-400f-95f7-8d0d9718ad31-kube-api-access-fbxs4\") pod \"25030d75-1ec9-400f-95f7-8d0d9718ad31\" (UID: \"25030d75-1ec9-400f-95f7-8d0d9718ad31\") " Jul 07 18:56:12.682650 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682561 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nmht\" (UniqueName: \"kubernetes.io/projected/cc656729-46ea-4bc8-ad5b-c8e35d646b95-kube-api-access-6nmht\") pod \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\" (UID: \"cc656729-46ea-4bc8-ad5b-c8e35d646b95\") " Jul 07 18:56:12.682962 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682933 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-bundle" (OuterVolumeSpecName: "bundle") pod "25030d75-1ec9-400f-95f7-8d0d9718ad31" (UID: "25030d75-1ec9-400f-95f7-8d0d9718ad31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:12.683074 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.682963 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-bundle" (OuterVolumeSpecName: "bundle") pod "cc656729-46ea-4bc8-ad5b-c8e35d646b95" (UID: "cc656729-46ea-4bc8-ad5b-c8e35d646b95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:12.684554 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.684530 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc656729-46ea-4bc8-ad5b-c8e35d646b95-kube-api-access-6nmht" (OuterVolumeSpecName: "kube-api-access-6nmht") pod "cc656729-46ea-4bc8-ad5b-c8e35d646b95" (UID: "cc656729-46ea-4bc8-ad5b-c8e35d646b95"). InnerVolumeSpecName "kube-api-access-6nmht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:56:12.684645 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.684557 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25030d75-1ec9-400f-95f7-8d0d9718ad31-kube-api-access-fbxs4" (OuterVolumeSpecName: "kube-api-access-fbxs4") pod "25030d75-1ec9-400f-95f7-8d0d9718ad31" (UID: "25030d75-1ec9-400f-95f7-8d0d9718ad31"). InnerVolumeSpecName "kube-api-access-fbxs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:56:12.690526 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.690498 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-util" (OuterVolumeSpecName: "util") pod "25030d75-1ec9-400f-95f7-8d0d9718ad31" (UID: "25030d75-1ec9-400f-95f7-8d0d9718ad31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:12.690971 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.690945 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-util" (OuterVolumeSpecName: "util") pod "cc656729-46ea-4bc8-ad5b-c8e35d646b95" (UID: "cc656729-46ea-4bc8-ad5b-c8e35d646b95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:12.783321 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.783271 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbxs4\" (UniqueName: \"kubernetes.io/projected/25030d75-1ec9-400f-95f7-8d0d9718ad31-kube-api-access-fbxs4\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:12.783321 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.783290 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nmht\" (UniqueName: \"kubernetes.io/projected/cc656729-46ea-4bc8-ad5b-c8e35d646b95-kube-api-access-6nmht\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:12.783321 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.783300 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:12.783321 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.783309 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:12.783321 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.783316 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc656729-46ea-4bc8-ad5b-c8e35d646b95-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:12.783321 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:12.783323 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25030d75-1ec9-400f-95f7-8d0d9718ad31-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:13.467989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.467967 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" Jul 07 18:56:13.467989 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.467975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p" event={"ID":"cc656729-46ea-4bc8-ad5b-c8e35d646b95","Type":"ContainerDied","Data":"d0cf85206cbcc51f9fc5d1e65406e9ff9cedce8dbd97171def056cb7be62b8a9"} Jul 07 18:56:13.468411 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.468022 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0cf85206cbcc51f9fc5d1e65406e9ff9cedce8dbd97171def056cb7be62b8a9" Jul 07 18:56:13.470159 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.470137 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" Jul 07 18:56:13.470281 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.470141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc" event={"ID":"25030d75-1ec9-400f-95f7-8d0d9718ad31","Type":"ContainerDied","Data":"b4e3db70f4e3ea7bd3c0163624715542bcf492d1b8f3681063323cdd357c2c97"} Jul 07 18:56:13.470281 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.470249 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4e3db70f4e3ea7bd3c0163624715542bcf492d1b8f3681063323cdd357c2c97" Jul 07 18:56:13.594441 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.594418 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:13.690353 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.690329 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-util\") pod \"71d2d672-dea8-47c2-95a8-546cf6591193\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " Jul 07 18:56:13.690479 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.690370 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55kzc\" (UniqueName: \"kubernetes.io/projected/71d2d672-dea8-47c2-95a8-546cf6591193-kube-api-access-55kzc\") pod \"71d2d672-dea8-47c2-95a8-546cf6591193\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " Jul 07 18:56:13.690479 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.690440 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-bundle\") pod \"71d2d672-dea8-47c2-95a8-546cf6591193\" (UID: \"71d2d672-dea8-47c2-95a8-546cf6591193\") " Jul 07 18:56:13.690893 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.690870 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-bundle" (OuterVolumeSpecName: "bundle") pod "71d2d672-dea8-47c2-95a8-546cf6591193" (UID: "71d2d672-dea8-47c2-95a8-546cf6591193"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:13.692379 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.692352 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d2d672-dea8-47c2-95a8-546cf6591193-kube-api-access-55kzc" (OuterVolumeSpecName: "kube-api-access-55kzc") pod "71d2d672-dea8-47c2-95a8-546cf6591193" (UID: "71d2d672-dea8-47c2-95a8-546cf6591193"). InnerVolumeSpecName "kube-api-access-55kzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:56:13.695508 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.695479 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-util" (OuterVolumeSpecName: "util") pod "71d2d672-dea8-47c2-95a8-546cf6591193" (UID: "71d2d672-dea8-47c2-95a8-546cf6591193"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:56:13.791625 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.791577 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-util\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:13.791625 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.791597 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55kzc\" (UniqueName: \"kubernetes.io/projected/71d2d672-dea8-47c2-95a8-546cf6591193-kube-api-access-55kzc\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:13.791625 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:13.791606 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71d2d672-dea8-47c2-95a8-546cf6591193-bundle\") on node \"ip-10-0-140-153.ec2.internal\" DevicePath \"\"" Jul 07 18:56:14.477326 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:14.477298 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" Jul 07 18:56:14.477724 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:14.477330 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml" event={"ID":"71d2d672-dea8-47c2-95a8-546cf6591193","Type":"ContainerDied","Data":"883922e10cb0e720d9180dfc043699a1c917ed7ed7eb9a60d3cfc9b1f2981b7e"} Jul 07 18:56:14.477724 ip-10-0-140-153 kubenswrapper[2560]: I0707 18:56:14.477385 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="883922e10cb0e720d9180dfc043699a1c917ed7ed7eb9a60d3cfc9b1f2981b7e" Jul 07 19:08:50.116986 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:50.116952 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8_f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778/copy-manifests/0.log" Jul 07 19:08:50.125514 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:50.125488 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8_f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778/manager/0.log" Jul 07 19:08:56.188360 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.188278 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc_25030d75-1ec9-400f-95f7-8d0d9718ad31/util/0.log" Jul 07 19:08:56.195523 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.195494 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc_25030d75-1ec9-400f-95f7-8d0d9718ad31/pull/0.log" Jul 07 19:08:56.203293 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.203265 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc_25030d75-1ec9-400f-95f7-8d0d9718ad31/extract/0.log" Jul 07 19:08:56.319910 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.319887 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml_71d2d672-dea8-47c2-95a8-546cf6591193/util/0.log" Jul 07 19:08:56.327697 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.327672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml_71d2d672-dea8-47c2-95a8-546cf6591193/pull/0.log" Jul 07 19:08:56.335070 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.335048 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml_71d2d672-dea8-47c2-95a8-546cf6591193/extract/0.log" Jul 07 19:08:56.443857 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.443806 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx_f5014522-b10e-45bf-9d38-91475cddb9e9/util/0.log" Jul 07 19:08:56.451905 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.451890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx_f5014522-b10e-45bf-9d38-91475cddb9e9/pull/0.log" Jul 07 19:08:56.459163 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.459142 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx_f5014522-b10e-45bf-9d38-91475cddb9e9/extract/0.log" Jul 07 19:08:56.568371 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.568345 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p_cc656729-46ea-4bc8-ad5b-c8e35d646b95/util/0.log" Jul 07 19:08:56.575425 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.575406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p_cc656729-46ea-4bc8-ad5b-c8e35d646b95/pull/0.log" Jul 07 19:08:56.582448 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:56.582431 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p_cc656729-46ea-4bc8-ad5b-c8e35d646b95/extract/0.log" Jul 07 19:08:57.898835 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:57.898807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c5wmv_f90d9ae9-6fdf-47b2-84c2-a155805713bd/istio-proxy/0.log" Jul 07 19:08:58.022372 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:08:58.022344 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgl8s_d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62/discovery/0.log" Jul 07 19:09:05.726534 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:05.726491 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xwfcb_5d5900cf-f5bd-413e-aa33-3bac0738f6fe/global-pull-secret-syncer/0.log" Jul 07 19:09:05.869203 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:05.869178 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-znvdp_66e88745-ee8f-4836-8732-f9fd7511c5d5/konnectivity-agent/0.log" Jul 07 19:09:05.979177 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:05.979114 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-153.ec2.internal_407ab6e563598eecc05b9012141a51c0/haproxy/0.log" Jul 07 19:09:10.381358 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.381323 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc_25030d75-1ec9-400f-95f7-8d0d9718ad31/extract/0.log" Jul 07 19:09:10.414379 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.414352 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc_25030d75-1ec9-400f-95f7-8d0d9718ad31/util/0.log" Jul 07 19:09:10.442771 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.442752 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gthkc_25030d75-1ec9-400f-95f7-8d0d9718ad31/pull/0.log" Jul 07 19:09:10.484290 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.484270 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml_71d2d672-dea8-47c2-95a8-546cf6591193/extract/0.log" Jul 07 19:09:10.511693 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.511668 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml_71d2d672-dea8-47c2-95a8-546cf6591193/util/0.log" Jul 07 19:09:10.543781 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.543763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w2jml_71d2d672-dea8-47c2-95a8-546cf6591193/pull/0.log" Jul 07 19:09:10.575948 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.575929 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx_f5014522-b10e-45bf-9d38-91475cddb9e9/extract/0.log" Jul 07 19:09:10.603156 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.603134 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx_f5014522-b10e-45bf-9d38-91475cddb9e9/util/0.log" Jul 07 19:09:10.627517 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.627501 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rzzjx_f5014522-b10e-45bf-9d38-91475cddb9e9/pull/0.log" Jul 07 19:09:10.655478 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.655462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p_cc656729-46ea-4bc8-ad5b-c8e35d646b95/extract/0.log" Jul 07 19:09:10.677627 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.677606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p_cc656729-46ea-4bc8-ad5b-c8e35d646b95/util/0.log" Jul 07 19:09:10.699512 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:10.699490 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rbk4p_cc656729-46ea-4bc8-ad5b-c8e35d646b95/pull/0.log" Jul 07 19:09:12.952323 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:12.952293 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k4k2_e9a85040-b0dd-48ab-b09c-30a1ef0bcf93/node-exporter/0.log" Jul 07 19:09:12.982433 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:12.982410 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k4k2_e9a85040-b0dd-48ab-b09c-30a1ef0bcf93/kube-rbac-proxy/0.log" Jul 07 19:09:13.011895 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:13.011869 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5k4k2_e9a85040-b0dd-48ab-b09c-30a1ef0bcf93/init-textfile/0.log" Jul 07 19:09:15.679847 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.679816 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc"] Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680083 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680094 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680105 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680111 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680118 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680124 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680136 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680141 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680148 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680153 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680159 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680164 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680174 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680179 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680185 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680190 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680195 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680200 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680206 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680211 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="util" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680216 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680222 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="pull" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680227 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="extract" Jul 07 19:09:15.680226 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680234 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="extract" Jul 07 19:09:15.681002 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680283 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d2d672-dea8-47c2-95a8-546cf6591193" containerName="extract" Jul 07 19:09:15.681002 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680291 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc656729-46ea-4bc8-ad5b-c8e35d646b95" containerName="extract" Jul 07 19:09:15.681002 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680297 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25030d75-1ec9-400f-95f7-8d0d9718ad31" containerName="extract" Jul 07 19:09:15.681002 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.680303 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5014522-b10e-45bf-9d38-91475cddb9e9" containerName="extract" Jul 07 19:09:15.683137 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.683120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.685853 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.685828 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqqk9\"/\"openshift-service-ca.crt\"" Jul 07 19:09:15.687205 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.687186 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zqqk9\"/\"default-dockercfg-jfdgs\"" Jul 07 19:09:15.687310 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.687233 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqqk9\"/\"kube-root-ca.crt\"" Jul 07 19:09:15.696843 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.696819 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc"] Jul 07 19:09:15.870863 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.870838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-lib-modules\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.870977 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.870871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx9kr\" (UniqueName: \"kubernetes.io/projected/15a05852-7b55-47ae-b9d2-5ecf688bba81-kube-api-access-rx9kr\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.870977 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.870917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-podres\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.871083 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.871013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-proc\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.871083 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.871055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-sys\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972138 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972080 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-podres\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972138 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-proc\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972138 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-sys\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972321 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-lib-modules\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972321 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx9kr\" (UniqueName: \"kubernetes.io/projected/15a05852-7b55-47ae-b9d2-5ecf688bba81-kube-api-access-rx9kr\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972321 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-proc\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972321 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-sys\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972321 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972253 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-podres\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.972542 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.972326 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15a05852-7b55-47ae-b9d2-5ecf688bba81-lib-modules\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.982194 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.982172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx9kr\" (UniqueName: \"kubernetes.io/projected/15a05852-7b55-47ae-b9d2-5ecf688bba81-kube-api-access-rx9kr\") pod \"perf-node-gather-daemonset-vtzqc\" (UID: \"15a05852-7b55-47ae-b9d2-5ecf688bba81\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:15.993076 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:15.993046 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:16.123343 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:16.123320 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc"] Jul 07 19:09:16.125007 ip-10-0-140-153 kubenswrapper[2560]: W0707 19:09:16.124980 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15a05852_7b55_47ae_b9d2_5ecf688bba81.slice/crio-c47b8d4249145af169c8df414b425a957da69f26649b2a093da88a93d0176155 WatchSource:0}: Error finding container c47b8d4249145af169c8df414b425a957da69f26649b2a093da88a93d0176155: Status 404 returned error can't find the container with id c47b8d4249145af169c8df414b425a957da69f26649b2a093da88a93d0176155 Jul 07 19:09:16.979510 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:16.979465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" event={"ID":"15a05852-7b55-47ae-b9d2-5ecf688bba81","Type":"ContainerStarted","Data":"1a8aff4385466f8245636c247f39d257c74ea42be821f409bc859082327bcd09"} Jul 07 19:09:16.979942 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:16.979558 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" event={"ID":"15a05852-7b55-47ae-b9d2-5ecf688bba81","Type":"ContainerStarted","Data":"c47b8d4249145af169c8df414b425a957da69f26649b2a093da88a93d0176155"} Jul 07 19:09:16.979942 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:16.979618 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:16.998227 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:16.998185 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" podStartSLOduration=1.9981708409999999 podStartE2EDuration="1.998170841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:16.997516261 +0000 UTC m=+1188.633292733" watchObservedRunningTime="2026-07-07 19:09:16.998170841 +0000 UTC m=+1188.633947311" Jul 07 19:09:18.074265 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:18.074229 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr6gt_e533e5dd-bc91-442c-9491-330b2995001e/dns/0.log" Jul 07 19:09:18.096944 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:18.096923 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr6gt_e533e5dd-bc91-442c-9491-330b2995001e/kube-rbac-proxy/0.log" Jul 07 19:09:18.221307 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:18.221284 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbww7_68221979-c421-4004-986c-6443df47fb5d/dns-node-resolver/0.log" Jul 07 19:09:18.802114 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:18.802084 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cjbzs_6a49a9ba-a493-4e64-aa74-d27f0c1b123e/node-ca/0.log" Jul 07 19:09:19.906785 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:19.906705 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c5wmv_f90d9ae9-6fdf-47b2-84c2-a155805713bd/istio-proxy/0.log" Jul 07 19:09:19.979350 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:19.979327 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgl8s_d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62/discovery/0.log" Jul 07 19:09:20.705948 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:20.705919 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d6vd8_593a4b8e-01db-4a92-9efc-cf12c51b91d0/serve-healthcheck-canary/0.log" Jul 07 19:09:21.311848 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:21.311817 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgw45_6791c204-7828-4bd1-bb57-834323e9cc1c/kube-rbac-proxy/0.log" Jul 07 19:09:21.334066 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:21.334040 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgw45_6791c204-7828-4bd1-bb57-834323e9cc1c/exporter/0.log" Jul 07 19:09:21.360422 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:21.360379 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgw45_6791c204-7828-4bd1-bb57-834323e9cc1c/extractor/0.log" Jul 07 19:09:22.994086 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:22.994060 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-vtzqc" Jul 07 19:09:23.831963 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:23.831933 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8_f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778/manager/0.log" Jul 07 19:09:23.851974 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:23.851954 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-txqz8_f7b0a2cc-2bcf-490e-9e9f-f73d9a35f778/copy-manifests/0.log" Jul 07 19:09:25.155994 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:25.155960 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d5b9d7dd9-9tgjc_f82208ed-d786-4ee0-9922-809f51186b67/manager/0.log" Jul 07 19:09:25.336993 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:25.336964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c5wmv_f90d9ae9-6fdf-47b2-84c2-a155805713bd/istio-proxy/0.log" Jul 07 19:09:25.381928 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:25.381905 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgl8s_d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62/discovery/0.log" Jul 07 19:09:26.684727 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:26.684694 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c5wmv_f90d9ae9-6fdf-47b2-84c2-a155805713bd/istio-proxy/0.log" Jul 07 19:09:26.734363 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:26.734336 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgl8s_d078dcdb-7b8e-4fac-8a3e-84bdfa5c9b62/discovery/0.log" Jul 07 19:09:30.507009 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:30.506964 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-h8z96_0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c/migrator/0.log" Jul 07 19:09:30.530378 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:30.530353 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-h8z96_0cea0f9e-7e8e-42e3-96e8-29c1e06d8a8c/graceful-termination/0.log" Jul 07 19:09:32.333632 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.333607 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/kube-multus-additional-cni-plugins/0.log" Jul 07 19:09:32.362338 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.362312 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/egress-router-binary-copy/0.log" Jul 07 19:09:32.385680 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.385602 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/cni-plugins/0.log" Jul 07 19:09:32.409207 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.409189 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/bond-cni-plugin/0.log" Jul 07 19:09:32.430706 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.430684 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/routeoverride-cni/0.log" Jul 07 19:09:32.452757 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.452738 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/whereabouts-cni-bincopy/0.log" Jul 07 19:09:32.475356 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.475333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2s5k_1d6235bb-dc33-41d2-8bcd-eef24101eebc/whereabouts-cni/0.log" Jul 07 19:09:32.541897 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.541874 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rrqsp_8a7c790b-769a-475f-ae5c-537bcbb37592/kube-multus/0.log" Jul 07 19:09:32.693116 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.693097 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj5hl_90ceee22-2927-405a-9290-903c611272f4/network-metrics-daemon/0.log" Jul 07 19:09:32.716478 ip-10-0-140-153 kubenswrapper[2560]: I0707 19:09:32.716453 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj5hl_90ceee22-2927-405a-9290-903c611272f4/kube-rbac-proxy/0.log"