Jul 01 19:32:49.041309 ip-10-0-128-74 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 19:32:49.041318 ip-10-0-128-74 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 19:32:49.041327 ip-10-0-128-74 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 19:32:49.041547 ip-10-0-128-74 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 19:32:59.059557 ip-10-0-128-74 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 01 19:32:59.059571 ip-10-0-128-74 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2a6c5b42302848febccaf9d7cb47f695 -- Jul 01 19:34:48.241881 ip-10-0-128-74 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:34:48.679100 ip-10-0-128-74 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:34:48.679100 ip-10-0-128-74 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:34:48.679100 ip-10-0-128-74 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:34:48.679100 ip-10-0-128-74 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:34:48.679100 ip-10-0-128-74 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:34:48.680465 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.680370 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:34:48.686117 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686095 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:34:48.686117 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686115 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:34:48.686117 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686120 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686124 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686127 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686130 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686132 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686135 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686138 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686140 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686144 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686148 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686152 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686155 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686158 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686161 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686164 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686167 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686170 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686172 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686175 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:34:48.686240 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686178 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686181 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686183 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686186 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686188 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686191 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686193 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686197 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686201 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686204 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686207 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686210 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686212 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686215 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686217 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686220 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686224 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686226 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686229 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:34:48.686709 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686232 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686234 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686236 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686238 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686241 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686244 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686247 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686250 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686252 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686255 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686258 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686261 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686264 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686266 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686269 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686271 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686274 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686276 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686279 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686281 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:34:48.687166 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686283 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686286 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686289 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686291 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686294 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686297 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686300 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686303 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686306 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686310 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686312 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686315 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686318 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686320 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686323 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686325 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686327 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686330 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686334 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:34:48.687763 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686336 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686339 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686341 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686344 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686346 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686348 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686351 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686353 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686356 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686358 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686360 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686363 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686365 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686368 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686371 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686373 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686375 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686378 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686381 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.686383 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687128 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:34:48.688497 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687138 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687141 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687146 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687150 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687152 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687155 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687157 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687160 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687163 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687165 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687168 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687172 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687174 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687177 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687180 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687183 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687185 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687188 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687190 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687192 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:34:48.689137 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687195 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687197 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687200 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687202 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687205 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687207 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687210 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687212 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687215 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687217 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687220 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687222 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687227 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687230 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687233 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687235 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687240 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687243 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687246 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687249 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:34:48.689643 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687252 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687254 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687257 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687259 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687262 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687265 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687267 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687270 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687272 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687275 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687277 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687279 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687282 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687284 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687286 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687289 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687291 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687293 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687297 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:34:48.690230 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687300 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687303 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687306 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687308 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687311 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687318 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687321 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687324 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687326 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687329 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687331 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687334 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687336 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687339 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687341 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687344 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687347 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687349 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687352 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687355 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:34:48.690745 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687358 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687360 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687363 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687365 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687367 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687370 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687372 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687376 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687378 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687381 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687383 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687386 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687388 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687391 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687393 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687396 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687399 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687403 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.687406 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:34:48.691226 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690455 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690469 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690472 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690475 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690478 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690481 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690484 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690487 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690489 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690492 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690494 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690497 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690499 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690501 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690504 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690507 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690510 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690512 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690515 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690530 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:34:48.691704 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690534 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690539 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690542 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690544 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690548 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690550 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690553 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690556 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690559 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690561 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690564 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690567 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690589 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690592 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690596 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690601 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690604 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690609 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690613 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:34:48.692221 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690616 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690618 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690621 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690624 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690627 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690630 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690633 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690635 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690638 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690641 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690644 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690646 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690649 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690652 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690655 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690658 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690661 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690663 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690666 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690669 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:34:48.692710 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690672 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690674 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690677 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690679 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690682 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690685 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690688 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690691 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690693 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690696 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690698 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690701 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690703 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690706 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690709 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690711 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690714 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690718 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690720 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690722 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:34:48.693198 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690725 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690727 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690730 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690734 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690736 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690739 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690742 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690744 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690747 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690750 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690752 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690756 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690759 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690761 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690765 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690767 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690770 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690772 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690775 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.690777 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:34:48.693731 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690854 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690863 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690870 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690874 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690879 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690882 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690886 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690891 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690894 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690897 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690900 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690903 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690906 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690909 2563 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690912 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690915 2563 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690918 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690921 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690926 2563 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690928 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690931 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690934 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690938 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690942 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:34:48.694204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690944 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690947 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690951 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690954 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690957 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690960 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690963 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690966 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690970 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690973 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690976 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690979 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690981 2563 flags.go:64] FLAG: --enable-server="true" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690984 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690988 2563 flags.go:64] FLAG: --event-burst="100" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690991 2563 flags.go:64] FLAG: --event-qps="50" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690994 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.690997 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691000 2563 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691004 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691006 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691009 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691012 2563 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691015 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691018 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:34:48.694777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691025 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691028 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691031 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691034 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691037 2563 flags.go:64] FLAG: --feature-gates="" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691045 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691048 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691052 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691054 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691057 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691061 2563 flags.go:64] FLAG: --help="false" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691063 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691066 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691069 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691072 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691075 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691079 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691082 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691084 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691087 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691089 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691092 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691095 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691099 2563 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:34:48.695379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691101 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691104 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691107 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691110 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691113 2563 flags.go:64] FLAG: --lock-file="" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691115 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691118 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691121 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691133 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691138 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691141 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691144 2563 flags.go:64] FLAG: --logging-format="text" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691147 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691150 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691153 2563 flags.go:64] FLAG: --manifest-url="" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691156 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691161 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691164 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691168 2563 flags.go:64] FLAG: --max-pods="110" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691171 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691173 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691176 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691179 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691182 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691185 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:34:48.696000 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691188 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691195 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691198 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691201 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691204 2563 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691206 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691212 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691215 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691218 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691220 2563 flags.go:64] FLAG: --port="10250" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691223 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691226 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07381cc11b5de716e" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691230 2563 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691233 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691236 2563 flags.go:64] FLAG: --register-node="true" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691239 2563 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691243 2563 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691246 2563 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691249 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691252 2563 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691258 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691260 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691263 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691267 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691270 2563 flags.go:64] FLAG: --runonce="false" Jul 01 19:34:48.696631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691274 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691278 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691281 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691283 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691286 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691289 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691292 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691295 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691298 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691301 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691304 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691306 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691309 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691312 2563 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691315 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691321 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691324 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691326 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691331 2563 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691334 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691336 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691339 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691342 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691345 2563 flags.go:64] FLAG: --v="2" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691349 2563 flags.go:64] FLAG: --version="false" Jul 01 19:34:48.697261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691354 2563 flags.go:64] FLAG: --vmodule="" Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691357 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.691362 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691479 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691484 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691487 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691489 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691494 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691496 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691499 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691502 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691504 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691507 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691509 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691521 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691524 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691526 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691529 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691531 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691534 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:34:48.697965 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691536 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691539 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691541 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691544 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691546 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691549 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691552 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691554 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691557 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691559 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691562 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691565 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691567 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691587 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691592 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691596 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691599 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691602 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691604 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691608 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:34:48.698454 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691610 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691613 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691616 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691618 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691621 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691623 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691626 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691628 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691631 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691633 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691636 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691638 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691641 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691643 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691646 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691648 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691651 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691654 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691656 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691658 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:34:48.698970 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691661 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691663 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691666 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691669 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691671 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691673 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691678 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691681 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691685 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691688 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691691 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691695 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691699 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691701 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691704 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691706 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691709 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691711 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691714 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:34:48.699446 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691717 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691720 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691722 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691726 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691729 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691732 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691735 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691737 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691739 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691742 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691744 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691747 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691749 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691752 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691754 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691756 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691759 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691762 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691765 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:34:48.699940 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691768 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691772 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691774 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.691777 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.692427 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.699738 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.699758 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.699781 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.699787 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699860 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699865 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699869 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699873 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699878 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:34:48.700433 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699882 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699885 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699890 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699894 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699897 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699900 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699903 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699906 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699909 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699912 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699915 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699918 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699921 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699924 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699926 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699929 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699932 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699934 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699936 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699939 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:34:48.700808 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699942 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699945 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699948 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699952 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699956 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699959 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699962 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699964 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699967 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699970 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699973 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699975 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699978 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699980 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699982 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699985 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699988 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699990 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699992 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:34:48.701282 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699995 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.699997 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700000 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700003 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700005 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700008 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700010 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700013 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700015 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700018 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700020 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700023 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700026 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700029 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700031 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700034 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700036 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700039 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700043 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700046 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:34:48.701741 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700049 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700051 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700053 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700056 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700058 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700061 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700064 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700066 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700068 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700071 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700073 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700076 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700078 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700081 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700084 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700086 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700089 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700092 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700094 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700097 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:34:48.702218 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700100 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700102 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700105 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700107 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700109 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700112 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700116 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700118 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700121 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700124 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700126 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700129 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700132 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700135 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700137 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:34:48.702705 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.700142 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700280 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700284 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700287 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700290 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700293 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700296 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700299 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700302 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700305 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700308 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700312 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700315 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700318 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700321 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700325 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700328 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700330 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700333 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:34:48.703069 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700335 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700338 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700340 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700343 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700346 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700349 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700352 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700354 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700357 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700359 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700362 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700365 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700367 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700370 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700372 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700375 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700377 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700380 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700382 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700385 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:34:48.703530 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700387 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700390 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700392 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700395 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700398 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700400 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700403 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700406 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700408 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700411 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700413 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700416 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700418 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700421 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700423 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700426 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700429 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700431 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700434 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:34:48.704041 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700436 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700439 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700442 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700444 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700447 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700449 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700452 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700455 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700457 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700459 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700462 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700464 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700467 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700469 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700472 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700474 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700477 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700479 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700482 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700485 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:34:48.704481 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700487 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700490 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700492 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700495 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700497 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700500 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700502 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700505 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700507 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700510 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700512 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700516 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700520 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700522 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700525 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700528 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700530 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700535 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700538 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:34:48.705087 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700541 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700544 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:48.700546 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.700551 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.701444 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.703499 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.705363 2563 server.go:1019] "Starting client certificate rotation" Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.705469 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:34:48.705564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.705513 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:34:48.707964 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.707949 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:34:48.709253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.709236 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:34:48.722143 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.722126 2563 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:34:48.725985 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.725970 2563 log.go:25] "Validated CRI v1 image API" Jul 01 19:34:48.726711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.726696 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:34:48.730160 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.730141 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 80a1d8c4-44d4-49e4-b14e-4a746115f9c9:/dev/nvme0n1p4 f32106b2-8479-490d-bb26-a9d27541a589:/dev/nvme0n1p3] Jul 01 19:34:48.730227 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.730159 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:34:48.736051 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.735942 2563 manager.go:216] Machine: {Timestamp:2026-07-01 19:34:48.7345891 +0000 UTC m=+0.368852510 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098698 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2beabd08ffa4f2a710cd678e79578a SystemUUID:ec2beabd-08ff-a4f2-a710-cd678e79578a BootID:2a6c5b42-3028-48fe-bcca-f9d7cb47f695 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:74:e2:78:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:74:e2:78:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:30:4d:94:dc:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:34:48.736138 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.736051 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:34:48.736138 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.736130 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:34:48.739107 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.739086 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:34:48.739252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.739110 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:34:48.740412 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.740401 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:34:48.740444 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.740414 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:34:48.740444 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.740422 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:34:48.741117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.741107 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:34:48.742071 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.742061 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:34:48.742623 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.742608 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:34:48.745733 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745720 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:34:48.745846 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745837 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:34:48.745885 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745869 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:34:48.745885 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745880 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:34:48.745957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745898 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:34:48.745957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745908 2563 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:34:48.745957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.745917 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:34:48.746296 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.746273 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:34:48.746296 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.746293 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:34:48.748496 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.748475 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:34:48.749899 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.749885 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:34:48.749953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.749916 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:34:48.750646 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750635 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750651 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750658 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750663 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750672 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750677 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750685 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:34:48.750694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750691 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:34:48.750870 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750699 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:34:48.750870 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750705 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:34:48.750870 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750713 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:34:48.750870 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.750718 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:34:48.751477 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.751467 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:34:48.751477 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.751476 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:34:48.755120 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.755102 2563 server.go:1268] "Started kubelet" Jul 01 19:34:48.755239 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.755211 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:34:48.755300 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.755208 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:34:48.755300 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.755294 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:34:48.756059 ip-10-0-128-74 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:34:48.757451 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.757427 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:34:48.757969 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.757938 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:34:48.757969 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.757938 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:34:48.758125 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.758034 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:34:48.758960 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.758941 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:34:48.763419 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.763399 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:34:48.764165 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764152 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:34:48.764235 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764175 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:34:48.764235 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.764227 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:48.764843 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764820 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:34:48.764953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764833 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:34:48.764953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764875 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:34:48.765042 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764988 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:34:48.765042 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.764996 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:34:48.765042 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.763300 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18be41789c09e952 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-01 19:34:48.755071314 +0000 UTC m=+0.389334724,LastTimestamp:2026-07-01 19:34:48.755071314 +0000 UTC m=+0.389334724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}" Jul 01 19:34:48.765444 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765425 2563 factory.go:55] Registering systemd factory Jul 01 19:34:48.765510 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765448 2563 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:34:48.765725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765713 2563 factory.go:153] Registering CRI-O factory Jul 01 19:34:48.765769 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765729 2563 factory.go:223] Registration of the crio container factory successfully Jul 01 19:34:48.765796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765782 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:34:48.765826 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765803 2563 factory.go:103] Registering Raw factory Jul 01 19:34:48.765826 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.765814 2563 manager.go:1196] Started watching for new ooms in manager Jul 01 19:34:48.766303 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.766283 2563 manager.go:349] Starting recovery of all containers Jul 01 19:34:48.773086 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.773057 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:34:48.773086 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.773076 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:34:48.776294 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.776111 2563 manager.go:354] Recovery completed Jul 01 19:34:48.781116 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.781103 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.783016 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.782995 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.783088 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.783028 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.783088 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.783040 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.783782 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.783675 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:34:48.783782 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.783682 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.783782 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.783689 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:34:48.783782 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.783708 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:34:48.784413 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.784373 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.784413 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.784405 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.784500 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.784418 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.785079 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.785066 2563 policy_none.go:49] "None policy: Start" Jul 01 19:34:48.785117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.785084 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:34:48.785117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.785094 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:34:48.786210 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.786200 2563 policy_none.go:47] "Start" Jul 01 19:34:48.793087 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.793021 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18be41789db443b6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-01 19:34:48.78301279 +0000 UTC m=+0.417276199,LastTimestamp:2026-07-01 19:34:48.78301279 +0000 UTC m=+0.417276199,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}" Jul 01 19:34:48.802829 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.802807 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rh8vr" Jul 01 19:34:48.805010 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.804942 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18be41789db49291 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-01 19:34:48.783032977 +0000 UTC m=+0.417296387,LastTimestamp:2026-07-01 19:34:48.783032977 +0000 UTC m=+0.417296387,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}" Jul 01 19:34:48.811915 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.811896 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rh8vr" Jul 01 19:34:48.816704 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.816641 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18be41789db4bcc0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-01 19:34:48.783043776 +0000 UTC m=+0.417307186,LastTimestamp:2026-07-01 19:34:48.783043776 +0000 UTC m=+0.417307186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}" Jul 01 19:34:48.827202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827184 2563 manager.go:337] "Starting Device Plugin manager" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.827223 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827235 2563 server.go:87] "Starting device plugin registration server" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827490 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827503 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827655 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827733 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.827742 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.828274 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.828329 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.834496 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.835711 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.835742 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.835760 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.835788 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:34:48.839237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.838097 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:34:48.928352 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.928303 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.929403 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.929339 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.929403 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.929375 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.929403 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.929387 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.929599 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.929411 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.936627 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.936608 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"] Jul 01 19:34:48.936705 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.936683 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.938293 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.938276 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.938389 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.938308 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.938389 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.938324 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.939738 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.939725 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.939866 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.939852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.939933 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.939891 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.940615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.940597 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.940725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.940631 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.940725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.940643 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.940725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.940597 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.940725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.940710 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.940725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.940724 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.941295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.941267 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.941397 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.941299 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-74.ec2.internal\": node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:48.942020 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.942004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.942108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.942032 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:34:48.943012 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.942996 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:34:48.943075 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.943021 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:34:48.943075 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:48.943038 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:34:48.974553 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.974519 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-74.ec2.internal\" not found" node="ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.979190 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.979175 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-74.ec2.internal\" not found" node="ip-10-0-128-74.ec2.internal" Jul 01 19:34:48.979927 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:48.979911 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:49.066742 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.066698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44273a2957acd8ea192aab670ff15c5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"44273a2957acd8ea192aab670ff15c5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.066742 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.066736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44273a2957acd8ea192aab670ff15c5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"44273a2957acd8ea192aab670ff15c5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.066957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.066754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b82385543037b0c098fe29c9728bddc9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-74.ec2.internal\" (UID: \"b82385543037b0c098fe29c9728bddc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.080700 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:49.080675 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:49.167831 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.167787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44273a2957acd8ea192aab670ff15c5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"44273a2957acd8ea192aab670ff15c5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.167831 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.167834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44273a2957acd8ea192aab670ff15c5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"44273a2957acd8ea192aab670ff15c5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.167957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.167853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b82385543037b0c098fe29c9728bddc9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-74.ec2.internal\" (UID: \"b82385543037b0c098fe29c9728bddc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.167957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.167898 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b82385543037b0c098fe29c9728bddc9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-74.ec2.internal\" (UID: \"b82385543037b0c098fe29c9728bddc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.167957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.167915 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44273a2957acd8ea192aab670ff15c5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"44273a2957acd8ea192aab670ff15c5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:49.167957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:49.167915 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44273a2957acd8ea192aab670ff15c5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"44273a2957acd8ea192aab670ff15c5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:50.545231 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:50.545169 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:50.641960 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:50.641935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:50.646242 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:50.646225 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:50.647340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:50.647323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" Jul 01 19:34:50.746490 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:50.746442 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:50.847065 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:50.846968 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:50.947644 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:50.947603 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:50.978290 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:50.978259 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:34:51.048568 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:51.048536 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found" Jul 01 19:34:51.068732 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.068704 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:34:51.068912 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.068892 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:34:51.068982 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.068911 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:34:51.147363 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.147270 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:34:51.179527 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.179482 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:29:50 +0000 UTC" deadline="2028-03-27 15:45:22.436580574 +0000 UTC" Jul 01 19:34:51.179527 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.179525 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15236h10m31.257058841s" Jul 01 19:34:51.229629 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.229583 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" Jul 01 19:34:51.243398 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.243378 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:34:51.245404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.245388 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" Jul 01 19:34:51.254946 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.254914 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:34:51.680466 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:51.680429 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82385543037b0c098fe29c9728bddc9.slice/crio-7e2866edc1ae3488f9b9912e67adfb733bc7be0ea41cc91c96c6a34a9ba92d26 WatchSource:0}: Error finding container 7e2866edc1ae3488f9b9912e67adfb733bc7be0ea41cc91c96c6a34a9ba92d26: Status 404 returned error can't find the container with id 7e2866edc1ae3488f9b9912e67adfb733bc7be0ea41cc91c96c6a34a9ba92d26 Jul 01 19:34:51.685520 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.685509 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:34:51.731033 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:51.730149 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:34:51.995290 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:51.995257 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44273a2957acd8ea192aab670ff15c5e.slice/crio-40aba927e82f5f35f876e495fcbc3b1ba4c040f7f9c72c750e7635049f75f38d WatchSource:0}: Error finding container 40aba927e82f5f35f876e495fcbc3b1ba4c040f7f9c72c750e7635049f75f38d: Status 404 returned error can't find the container with id 40aba927e82f5f35f876e495fcbc3b1ba4c040f7f9c72c750e7635049f75f38d Jul 01 19:34:52.111336 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.111309 2563 apiserver.go:52] "Watching apiserver" Jul 01 19:34:52.118172 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.118148 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:34:52.118508 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.118487 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-2btc5","kube-system/global-pull-secret-syncer-m5f64","kube-system/konnectivity-agent-hjmmg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r","openshift-dns/node-resolver-fp5fb","openshift-image-registry/node-ca-lphcd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal","openshift-multus/multus-f6bht","openshift-network-operator/iptables-alerter-t5l2g","kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dzlw2","openshift-multus/multus-additional-cni-plugins-z4fhr","openshift-multus/network-metrics-daemon-9hnc7","openshift-network-diagnostics/network-check-target-zs4qs"] Jul 01 19:34:52.120586 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.120573 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.120664 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.120645 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:34:52.121924 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.121907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.121983 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.121964 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:34:52.123120 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.123108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.124363 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.124343 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.125551 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.125532 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.125670 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.125549 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:34:52.125670 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.125616 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gtz8p\"" Jul 01 19:34:52.125782 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.125539 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:34:52.126564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.126545 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.126564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.126554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2k4xb\"" Jul 01 19:34:52.126726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.126651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.126872 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.126833 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.127114 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.127099 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:34:52.128115 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.128096 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.128214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.128200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.128586 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.128567 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:34:52.130486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.129727 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:34:52.130486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.129784 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.130486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.129727 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.130486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.129987 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.130486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.129790 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.130486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.130391 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhpsx\"" Jul 01 19:34:52.130926 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.130695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:34:52.131004 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.130926 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:34:52.131067 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.131018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:34:52.131124 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.131075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.132257 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.131535 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wwgl\"" Jul 01 19:34:52.132257 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.131547 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-55q9g\"" Jul 01 19:34:52.132257 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.131555 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.132626 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.132604 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:34:52.132687 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.132653 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.133469 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.133046 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.133469 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.133106 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:34:52.133469 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.133192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhpnh\"" Jul 01 19:34:52.133469 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.133304 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:34:52.133469 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.133396 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.135180 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.134960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:52.135180 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.135016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sqxhl\"" Jul 01 19:34:52.135180 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.135027 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:34:52.135180 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.135052 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.135403 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.135271 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.135622 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.135607 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:34:52.136912 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.136897 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.138285 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.138268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.139239 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.139222 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:34:52.139362 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.139256 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:34:52.139362 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.139277 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p5vsv\"" Jul 01 19:34:52.140193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-multus-certs\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140285 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb6effec-d569-4525-b675-4fbed5d1de09-agent-certs\") pod \"konnectivity-agent-hjmmg\" (UID: \"bb6effec-d569-4525-b675-4fbed5d1de09\") " pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.140285 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llmfr\" (UniqueName: \"kubernetes.io/projected/e76f1b88-9a0a-487e-9e15-341aa91d99cc-kube-api-access-llmfr\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.140285 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-env-overrides\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140408 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-node-log\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140408 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1366a458-5728-4592-90d7-1e72adfdd230-multus-daemon-config\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140408 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-var-lib-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140408 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-cni-bin\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140408 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9thpk\" (UniqueName: \"kubernetes.io/projected/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-kube-api-access-9thpk\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovn-node-metrics-cert\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovnkube-script-lib\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-netns\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-ovn\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-sys-fs\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-systemd\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb6effec-d569-4525-b675-4fbed5d1de09-konnectivity-ca\") pod \"konnectivity-agent-hjmmg\" (UID: \"bb6effec-d569-4525-b675-4fbed5d1de09\") " pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.140613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-cni-netd\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140628 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1366a458-5728-4592-90d7-1e72adfdd230-cni-binary-copy\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/787908ec-fa30-4a1e-9780-422791191981-dbus\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-device-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/258d8ce3-b66c-4974-bbe2-983e951cbb8b-hosts-file\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-kubelet\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-run-netns\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-etc-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-os-release\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-etc-kubernetes\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258d8ce3-b66c-4974-bbe2-983e951cbb8b-tmp-dir\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-systemd-units\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-hostroot\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-cni-bin\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da278ba8-5895-428d-80cb-a70a14546f9a-host\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-log-socket\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.140999 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-system-cni-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-k8s-cni-cncf-io\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.140988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7w6\" (UniqueName: \"kubernetes.io/projected/1366a458-5728-4592-90d7-1e72adfdd230-kube-api-access-dq7w6\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z96gj\" (UniqueName: \"kubernetes.io/projected/258d8ce3-b66c-4974-bbe2-983e951cbb8b-kube-api-access-z96gj\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-kubelet\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-slash\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-socket-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-registration-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wn5j\" (UniqueName: \"kubernetes.io/projected/da278ba8-5895-428d-80cb-a70a14546f9a-kube-api-access-4wn5j\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovnkube-config\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-cnibin\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbk5b\" (UniqueName: \"kubernetes.io/projected/d1426157-278d-400e-b2fb-5bddea2931a5-kube-api-access-wbk5b\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da278ba8-5895-428d-80cb-a70a14546f9a-serviceca\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.141708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-socket-dir-parent\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/787908ec-fa30-4a1e-9780-422791191981-kubelet-config\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-cni-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-cni-multus\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-conf-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141450 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141460 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:34:52.142193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.141545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7vs2h\"" Jul 01 19:34:52.149550 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.149531 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:34:52.172408 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.172387 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxlcb" Jul 01 19:34:52.180800 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.180784 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxlcb" Jul 01 19:34:52.203661 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.203619 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" event={"ID":"44273a2957acd8ea192aab670ff15c5e","Type":"ContainerStarted","Data":"40aba927e82f5f35f876e495fcbc3b1ba4c040f7f9c72c750e7635049f75f38d"} Jul 01 19:34:52.204644 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.204621 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" event={"ID":"b82385543037b0c098fe29c9728bddc9","Type":"ContainerStarted","Data":"7e2866edc1ae3488f9b9912e67adfb733bc7be0ea41cc91c96c6a34a9ba92d26"} Jul 01 19:34:52.230712 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.230677 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:34:52.241609 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c501dee8-d105-42d6-ab83-27d6b05658e9-tmp\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.241736 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-system-cni-dir\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.241736 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltcv\" (UniqueName: \"kubernetes.io/projected/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-kube-api-access-wltcv\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.241736 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.241736 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-cni-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-cni-multus\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-conf-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-cni-multus\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-multus-certs\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-conf-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-tuned\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-multus-certs\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241898 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-cni-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.241919 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb6effec-d569-4525-b675-4fbed5d1de09-agent-certs\") pod \"konnectivity-agent-hjmmg\" (UID: \"bb6effec-d569-4525-b675-4fbed5d1de09\") " pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llmfr\" (UniqueName: \"kubernetes.io/projected/e76f1b88-9a0a-487e-9e15-341aa91d99cc-kube-api-access-llmfr\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.241974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-env-overrides\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-lib-modules\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-os-release\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-node-log\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1366a458-5728-4592-90d7-1e72adfdd230-multus-daemon-config\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-run\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-var-lib-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-node-log\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-cni-bin\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-var-lib-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thpk\" (UniqueName: \"kubernetes.io/projected/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-kube-api-access-9thpk\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-cni-bin\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-sys\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242550 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-env-overrides\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242600 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovn-node-metrics-cert\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.242818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.242709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1366a458-5728-4592-90d7-1e72adfdd230-multus-daemon-config\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.243266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovnkube-script-lib\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.243266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-netns\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.243266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-ovn\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.243427 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.243268 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:52.243427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-sys-fs\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.243427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-systemd\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.243427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysctl-d\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.243598 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-systemd\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.243652 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.243705 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-iptables-alerter-script\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.243757 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.243707 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:52.743679857 +0000 UTC m=+3.013664543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:52.243757 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-ovn\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.243918 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.243759 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:52.243918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb6effec-d569-4525-b675-4fbed5d1de09-konnectivity-ca\") pod \"konnectivity-agent-hjmmg\" (UID: \"bb6effec-d569-4525-b675-4fbed5d1de09\") " pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.243918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-sys-fs\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.243918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-cni-netd\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.244117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-run-systemd\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.244117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1366a458-5728-4592-90d7-1e72adfdd230-cni-binary-copy\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.244117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.243985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/787908ec-fa30-4a1e-9780-422791191981-dbus\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.244117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysconfig\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.244117 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.244079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:52.744041833 +0000 UTC m=+3.014026507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:52.244354 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/787908ec-fa30-4a1e-9780-422791191981-dbus\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.244354 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-cni-netd\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1366a458-5728-4592-90d7-1e72adfdd230-cni-binary-copy\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp627\" (UniqueName: \"kubernetes.io/projected/c501dee8-d105-42d6-ab83-27d6b05658e9-kube-api-access-xp627\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb6effec-d569-4525-b675-4fbed5d1de09-konnectivity-ca\") pod \"konnectivity-agent-hjmmg\" (UID: \"bb6effec-d569-4525-b675-4fbed5d1de09\") " pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cnibin\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-netns\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-device-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/258d8ce3-b66c-4974-bbe2-983e951cbb8b-hosts-file\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-kubelet\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244700 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqkxx\" (UniqueName: \"kubernetes.io/projected/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-kube-api-access-kqkxx\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-run-netns\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-etc-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovnkube-script-lib\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-os-release\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-etc-kubernetes\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-host\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258d8ce3-b66c-4974-bbe2-983e951cbb8b-tmp-dir\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.245266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.244959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-device-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-systemd-units\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-run-netns\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/258d8ce3-b66c-4974-bbe2-983e951cbb8b-hosts-file\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-systemd-units\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-hostroot\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-etc-kubernetes\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-etc-openvswitch\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-kubelet\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-os-release\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-cni-bin\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-host-slash\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da278ba8-5895-428d-80cb-a70a14546f9a-host\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258d8ce3-b66c-4974-bbe2-983e951cbb8b-tmp-dir\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-log-socket\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da278ba8-5895-428d-80cb-a70a14546f9a-host\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-var-lib-cni-bin\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-system-cni-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245752 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-log-socket\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-hostroot\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-k8s-cni-cncf-io\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-system-cni-dir\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7w6\" (UniqueName: \"kubernetes.io/projected/1366a458-5728-4592-90d7-1e72adfdd230-kube-api-access-dq7w6\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.245923 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-modprobe-d\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-host-run-k8s-cni-cncf-io\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-kubernetes\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z96gj\" (UniqueName: \"kubernetes.io/projected/258d8ce3-b66c-4974-bbe2-983e951cbb8b-kube-api-access-z96gj\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-kubelet\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-slash\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-var-lib-kubelet\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.246917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-socket-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-registration-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wn5j\" (UniqueName: \"kubernetes.io/projected/da278ba8-5895-428d-80cb-a70a14546f9a-kube-api-access-4wn5j\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.246932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovnkube-config\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-registration-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-cnibin\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbk5b\" (UniqueName: \"kubernetes.io/projected/d1426157-278d-400e-b2fb-5bddea2931a5-kube-api-access-wbk5b\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247359 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da278ba8-5895-428d-80cb-a70a14546f9a-serviceca\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-socket-dir-parent\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/787908ec-fa30-4a1e-9780-422791191981-kubelet-config\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.247689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247645 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovn-node-metrics-cert\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247757 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-ovnkube-config\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysctl-conf\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-multus-socket-dir-parent\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.247816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb6effec-d569-4525-b675-4fbed5d1de09-agent-certs\") pod \"konnectivity-agent-hjmmg\" (UID: \"bb6effec-d569-4525-b675-4fbed5d1de09\") " pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1366a458-5728-4592-90d7-1e72adfdd230-cnibin\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248060 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-slash\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.248214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/787908ec-fa30-4a1e-9780-422791191981-kubelet-config\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.248615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.248615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-host-kubelet\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.248615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da278ba8-5895-428d-80cb-a70a14546f9a-serviceca\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.248615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.248505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e76f1b88-9a0a-487e-9e15-341aa91d99cc-socket-dir\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.251725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.251705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9thpk\" (UniqueName: \"kubernetes.io/projected/e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9-kube-api-access-9thpk\") pod \"ovnkube-node-2btc5\" (UID: \"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.257501 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.257478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llmfr\" (UniqueName: \"kubernetes.io/projected/e76f1b88-9a0a-487e-9e15-341aa91d99cc-kube-api-access-llmfr\") pod \"aws-ebs-csi-driver-node-rb57r\" (UID: \"e76f1b88-9a0a-487e-9e15-341aa91d99cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.260214 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.260192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbk5b\" (UniqueName: \"kubernetes.io/projected/d1426157-278d-400e-b2fb-5bddea2931a5-kube-api-access-wbk5b\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.260399 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.260380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z96gj\" (UniqueName: \"kubernetes.io/projected/258d8ce3-b66c-4974-bbe2-983e951cbb8b-kube-api-access-z96gj\") pod \"node-resolver-fp5fb\" (UID: \"258d8ce3-b66c-4974-bbe2-983e951cbb8b\") " pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.261244 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.261226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wn5j\" (UniqueName: \"kubernetes.io/projected/da278ba8-5895-428d-80cb-a70a14546f9a-kube-api-access-4wn5j\") pod \"node-ca-lphcd\" (UID: \"da278ba8-5895-428d-80cb-a70a14546f9a\") " pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.261992 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.261975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7w6\" (UniqueName: \"kubernetes.io/projected/1366a458-5728-4592-90d7-1e72adfdd230-kube-api-access-dq7w6\") pod \"multus-f6bht\" (UID: \"1366a458-5728-4592-90d7-1e72adfdd230\") " pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.349202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-host-slash\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-modprobe-d\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-kubernetes\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-var-lib-kubelet\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysctl-conf\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c501dee8-d105-42d6-ab83-27d6b05658e9-tmp\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-system-cni-dir\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wltcv\" (UniqueName: \"kubernetes.io/projected/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-kube-api-access-wltcv\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-tuned\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.349453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-lib-modules\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-os-release\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-run\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-sys\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysctl-d\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-systemd\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-iptables-alerter-script\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysconfig\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp627\" (UniqueName: \"kubernetes.io/projected/c501dee8-d105-42d6-ab83-27d6b05658e9-kube-api-access-xp627\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.349798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-lib-modules\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-host-slash\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-os-release\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-run\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-modprobe-d\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350210 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-kubernetes\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-sys\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350249 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-var-lib-kubelet\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysctl-d\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.350583 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-systemd\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.351111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.351111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysctl-conf\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.351111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.350938 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.351256 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-sysconfig\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.351362 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-system-cni-dir\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.351470 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cnibin\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.351470 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqkxx\" (UniqueName: \"kubernetes.io/projected/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-kube-api-access-kqkxx\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.351470 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-host\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.351613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-cnibin\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.351613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351481 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-iptables-alerter-script\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.351698 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.351612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c501dee8-d105-42d6-ab83-27d6b05658e9-host\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.353555 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.353532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c501dee8-d105-42d6-ab83-27d6b05658e9-tmp\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.356481 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.356456 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:34:52.356481 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.356485 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:34:52.356655 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.356500 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:52.356655 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.356584 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:34:52.856564306 +0000 UTC m=+3.126548991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:52.357504 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.357476 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c501dee8-d105-42d6-ab83-27d6b05658e9-etc-tuned\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.360107 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.360062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltcv\" (UniqueName: \"kubernetes.io/projected/ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851-kube-api-access-wltcv\") pod \"iptables-alerter-t5l2g\" (UID: \"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851\") " pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.360377 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.360348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqkxx\" (UniqueName: \"kubernetes.io/projected/d0537be0-fe7b-49e7-b048-3b7a553bd4c2-kube-api-access-kqkxx\") pod \"multus-additional-cni-plugins-z4fhr\" (UID: \"d0537be0-fe7b-49e7-b048-3b7a553bd4c2\") " pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.361111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.361086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp627\" (UniqueName: \"kubernetes.io/projected/c501dee8-d105-42d6-ab83-27d6b05658e9-kube-api-access-xp627\") pod \"tuned-dzlw2\" (UID: \"c501dee8-d105-42d6-ab83-27d6b05658e9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.436448 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.436409 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:34:52.441753 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.441713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" Jul 01 19:34:52.449757 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.449551 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fp5fb" Jul 01 19:34:52.453205 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.453180 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lphcd" Jul 01 19:34:52.453798 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.453767 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6effec_d569_4525_b675_4fbed5d1de09.slice/crio-41deb6b11e4d3647acce91a25974480175db81ee66384e6079b13f6ec458ff4e WatchSource:0}: Error finding container 41deb6b11e4d3647acce91a25974480175db81ee66384e6079b13f6ec458ff4e: Status 404 returned error can't find the container with id 41deb6b11e4d3647acce91a25974480175db81ee66384e6079b13f6ec458ff4e Jul 01 19:34:52.459222 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.459196 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76f1b88_9a0a_487e_9e15_341aa91d99cc.slice/crio-2fed86ebc112d3335b202e767298aac3d591a30b00d5d1166a449ac21e5a888a WatchSource:0}: Error finding container 2fed86ebc112d3335b202e767298aac3d591a30b00d5d1166a449ac21e5a888a: Status 404 returned error can't find the container with id 2fed86ebc112d3335b202e767298aac3d591a30b00d5d1166a449ac21e5a888a Jul 01 19:34:52.459404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.459371 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:34:52.464364 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.464337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f6bht" Jul 01 19:34:52.468089 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.468052 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda278ba8_5895_428d_80cb_a70a14546f9a.slice/crio-7d4dd09c304caf09c8dae80248a0645627cab0f022881102bae6fa97a8d21c97 WatchSource:0}: Error finding container 7d4dd09c304caf09c8dae80248a0645627cab0f022881102bae6fa97a8d21c97: Status 404 returned error can't find the container with id 7d4dd09c304caf09c8dae80248a0645627cab0f022881102bae6fa97a8d21c97 Jul 01 19:34:52.470339 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.469997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t5l2g" Jul 01 19:34:52.476696 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.475285 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:34:52.476696 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.476529 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" Jul 01 19:34:52.479470 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.479421 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" Jul 01 19:34:52.484924 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.484896 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1366a458_5728_4592_90d7_1e72adfdd230.slice/crio-d395ba3f4b615acbcfbab5fe7005d35c135856b302270ce6358e4f25dbef8fad WatchSource:0}: Error finding container d395ba3f4b615acbcfbab5fe7005d35c135856b302270ce6358e4f25dbef8fad: Status 404 returned error can't find the container with id d395ba3f4b615acbcfbab5fe7005d35c135856b302270ce6358e4f25dbef8fad Jul 01 19:34:52.485921 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.485896 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded105e33_44a8_4dc1_bdbd_bc0f1e6bc851.slice/crio-d30a2c8f08eaf69e99c959d74ba73b14d854373fcd60837a7528b8520dfd6b5f WatchSource:0}: Error finding container d30a2c8f08eaf69e99c959d74ba73b14d854373fcd60837a7528b8520dfd6b5f: Status 404 returned error can't find the container with id d30a2c8f08eaf69e99c959d74ba73b14d854373fcd60837a7528b8520dfd6b5f Jul 01 19:34:52.495972 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.495950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc501dee8_d105_42d6_ab83_27d6b05658e9.slice/crio-00e894ade4e80f068d02e3dd742adf8d650bf7eef03dba948b5798b3a6227e08 WatchSource:0}: Error finding container 00e894ade4e80f068d02e3dd742adf8d650bf7eef03dba948b5798b3a6227e08: Status 404 returned error can't find the container with id 00e894ade4e80f068d02e3dd742adf8d650bf7eef03dba948b5798b3a6227e08 Jul 01 19:34:52.501657 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:34:52.501631 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0537be0_fe7b_49e7_b048_3b7a553bd4c2.slice/crio-4171bbfb5b205da7e5248803483022442478c6ecb9abe2537aef13b677bc7458 WatchSource:0}: Error finding container 4171bbfb5b205da7e5248803483022442478c6ecb9abe2537aef13b677bc7458: Status 404 returned error can't find the container with id 4171bbfb5b205da7e5248803483022442478c6ecb9abe2537aef13b677bc7458 Jul 01 19:34:52.755075 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.754983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:52.755075 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.755040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:52.755291 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.755158 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:52.755291 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.755183 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:52.755291 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.755233 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:53.755216696 +0000 UTC m=+4.025201364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:52.755291 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.755252 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:53.755242171 +0000 UTC m=+4.025226843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:52.956817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:52.956780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:52.957025 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.956980 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:34:52.957025 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.957005 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:34:52.957025 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.957016 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:52.957169 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:52.957089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:34:53.957066108 +0000 UTC m=+4.227050790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:53.097145 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.097073 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:34:53.182958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.182886 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:29:52 +0000 UTC" deadline="2027-11-30 07:09:59.626736949 +0000 UTC" Jul 01 19:34:53.182958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.182955 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12395h35m6.443787062s" Jul 01 19:34:53.200372 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.200347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:53.200533 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.200452 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:34:53.207767 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.207741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" event={"ID":"c501dee8-d105-42d6-ab83-27d6b05658e9","Type":"ContainerStarted","Data":"00e894ade4e80f068d02e3dd742adf8d650bf7eef03dba948b5798b3a6227e08"} Jul 01 19:34:53.209040 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.209013 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"2aeb43c2beacfbfcbb5a75ce62ab0d18162b915ee52bd359a67bd05eb077a548"} Jul 01 19:34:53.210212 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.210188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lphcd" event={"ID":"da278ba8-5895-428d-80cb-a70a14546f9a","Type":"ContainerStarted","Data":"7d4dd09c304caf09c8dae80248a0645627cab0f022881102bae6fa97a8d21c97"} Jul 01 19:34:53.211352 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.211333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fp5fb" event={"ID":"258d8ce3-b66c-4974-bbe2-983e951cbb8b","Type":"ContainerStarted","Data":"dd802efd3d04fb1c6d62ca2380baec1637d3ca15838240dc1baf1f5785fdcb0f"} Jul 01 19:34:53.212565 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.212538 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hjmmg" event={"ID":"bb6effec-d569-4525-b675-4fbed5d1de09","Type":"ContainerStarted","Data":"41deb6b11e4d3647acce91a25974480175db81ee66384e6079b13f6ec458ff4e"} Jul 01 19:34:53.213660 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.213637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerStarted","Data":"4171bbfb5b205da7e5248803483022442478c6ecb9abe2537aef13b677bc7458"} Jul 01 19:34:53.214728 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.214710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t5l2g" event={"ID":"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851","Type":"ContainerStarted","Data":"d30a2c8f08eaf69e99c959d74ba73b14d854373fcd60837a7528b8520dfd6b5f"} Jul 01 19:34:53.215947 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.215924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f6bht" event={"ID":"1366a458-5728-4592-90d7-1e72adfdd230","Type":"ContainerStarted","Data":"d395ba3f4b615acbcfbab5fe7005d35c135856b302270ce6358e4f25dbef8fad"} Jul 01 19:34:53.217066 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.217044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" event={"ID":"e76f1b88-9a0a-487e-9e15-341aa91d99cc","Type":"ContainerStarted","Data":"2fed86ebc112d3335b202e767298aac3d591a30b00d5d1166a449ac21e5a888a"} Jul 01 19:34:53.764513 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.763884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:53.764513 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.763936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:53.764513 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.764061 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:53.764513 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.764112 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:55.764097974 +0000 UTC m=+6.034082642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:53.764513 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.764423 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:53.764513 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.764455 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:55.764444687 +0000 UTC m=+6.034429355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:53.965601 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:53.965562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:53.965790 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.965763 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:34:53.965790 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.965781 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:34:53.965938 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.965796 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:53.965938 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:53.965874 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:34:55.965834414 +0000 UTC m=+6.235819096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:54.184074 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:54.183982 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:29:52 +0000 UTC" deadline="2027-12-11 18:29:58.064597381 +0000 UTC" Jul 01 19:34:54.184074 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:54.184027 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12670h55m3.880575518s" Jul 01 19:34:54.203099 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:54.203067 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:54.203259 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:54.203218 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:34:54.203624 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:54.203603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:54.203734 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:54.203714 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:34:55.200645 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:55.200401 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:55.201135 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.200745 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:34:55.236584 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:55.236544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" event={"ID":"b82385543037b0c098fe29c9728bddc9","Type":"ContainerStarted","Data":"c1f6dbc2c7d2490c4a67ad429cbd98c21896d12520bc0dd4a8be740bd9b2db3e"} Jul 01 19:34:55.786738 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:55.786698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:55.786955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:55.786757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:55.787021 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.786959 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:55.787087 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.787025 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:59.787006432 +0000 UTC m=+10.056991105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:55.787424 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.787404 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:55.787498 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.787461 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:34:59.787447209 +0000 UTC m=+10.057431900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:55.988235 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:55.988196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:55.988423 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.988406 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:34:55.988489 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.988428 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:34:55.988489 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.988468 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:55.988593 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:55.988523 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:34:59.988510769 +0000 UTC m=+10.258495436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:34:56.201076 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:56.200996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:56.201523 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:56.201143 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:34:56.201668 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:56.201648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:56.201770 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:56.201750 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:34:56.242647 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:56.242600 2563 generic.go:356] "Generic (PLEG): container finished" podID="44273a2957acd8ea192aab670ff15c5e" containerID="0a68e4ca20ff4948771edb22720fa29e3c517e54fbe98dc2614bfe3a7022562c" exitCode=0 Jul 01 19:34:56.243200 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:56.243171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" event={"ID":"44273a2957acd8ea192aab670ff15c5e","Type":"ContainerDied","Data":"0a68e4ca20ff4948771edb22720fa29e3c517e54fbe98dc2614bfe3a7022562c"} Jul 01 19:34:56.263295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:56.263224 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" podStartSLOduration=5.263201058 podStartE2EDuration="5.263201058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:34:55.270391787 +0000 UTC m=+5.540376480" watchObservedRunningTime="2026-07-01 19:34:56.263201058 +0000 UTC m=+6.533185761" Jul 01 19:34:57.200867 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:57.200817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:57.201064 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:57.200972 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:34:58.203222 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:58.202538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:58.203222 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:58.202679 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:34:58.203222 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:58.203078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:58.203222 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:58.203166 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:34:59.200415 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:59.200381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:34:59.200584 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:59.200517 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:34:59.827091 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:59.827048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:34:59.827597 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:34:59.827103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:34:59.827597 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:59.827256 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:59.827597 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:59.827324 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:07.827305496 +0000 UTC m=+18.097290166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:34:59.827792 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:59.827686 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:34:59.827792 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:34:59.827725 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:07.827714492 +0000 UTC m=+18.097699160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:00.029288 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:00.029176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:00.029459 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:00.029379 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:00.029459 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:00.029407 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:00.029459 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:00.029420 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:00.029604 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:00.029488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:35:08.029467445 +0000 UTC m=+18.299452120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:00.204396 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:00.204332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:00.204568 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:00.204472 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:00.204759 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:00.204740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:00.204906 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:00.204882 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:01.200290 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:01.200254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:01.200717 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:01.200392 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:02.201983 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:02.201441 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:02.201983 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:02.201607 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:02.202509 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:02.202090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:02.202509 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:02.202185 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:03.200522 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:03.200481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:03.200732 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:03.200602 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:04.200745 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:04.200628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:04.200745 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:04.200639 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:04.201171 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:04.200744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:04.201171 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:04.200807 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:05.201037 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:05.200998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:05.201473 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:05.201127 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:06.200998 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:06.200963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:06.201167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:06.200963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:06.201167 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:06.201107 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:06.201543 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:06.201187 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:07.200225 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:07.200193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:07.200388 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:07.200309 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:07.891336 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:07.891295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:07.891336 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:07.891352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:07.891901 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:07.891464 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:07.891901 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:07.891527 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:07.891901 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:07.891559 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:23.891514902 +0000 UTC m=+34.161499583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:07.891901 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:07.891584 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:23.891570032 +0000 UTC m=+34.161554709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:08.093193 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:08.093156 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:08.093441 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:08.093303 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:08.093441 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:08.093321 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:08.093441 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:08.093330 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:08.093441 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:08.093386 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:35:24.093369733 +0000 UTC m=+34.363354402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:08.200943 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:08.200845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:08.201101 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:08.201007 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:08.201101 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:08.201033 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:08.201220 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:08.201160 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:09.200288 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:09.200255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:09.200719 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:09.200380 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:10.201833 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:10.201799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:10.202238 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:10.201940 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:10.202238 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:10.201991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:10.202238 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:10.202073 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:11.200508 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:11.200461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:11.200692 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:11.200582 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:12.200305 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:12.200228 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:12.200806 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:12.200373 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:12.200806 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:12.200434 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:12.200806 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:12.200539 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:13.201245 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.201068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:13.201895 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:13.201339 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:13.278699 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.278617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fp5fb" event={"ID":"258d8ce3-b66c-4974-bbe2-983e951cbb8b","Type":"ContainerStarted","Data":"e23a4c57e78737c17f1677395fd5d7250fc29228e9fc8d40787a83c508031960"} Jul 01 19:35:13.280274 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.280222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hjmmg" event={"ID":"bb6effec-d569-4525-b675-4fbed5d1de09","Type":"ContainerStarted","Data":"90a5be26b64ad32c1520aebeaa00ba9adb8ace833d253fdc3dcb73bfca6de912"} Jul 01 19:35:13.282302 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.282274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" event={"ID":"44273a2957acd8ea192aab670ff15c5e","Type":"ContainerStarted","Data":"833ce22f6c8c168f1e804145ae503e5ba33b18bd228585eafbb7444b118c4897"} Jul 01 19:35:13.283974 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.283948 2563 generic.go:356] "Generic (PLEG): container finished" podID="d0537be0-fe7b-49e7-b048-3b7a553bd4c2" containerID="9982fb405ef46cc13e488567cd59c22c85298a2d9b893422a85546b3b5810c1c" exitCode=0 Jul 01 19:35:13.284062 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.284042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerDied","Data":"9982fb405ef46cc13e488567cd59c22c85298a2d9b893422a85546b3b5810c1c"} Jul 01 19:35:13.287578 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.287552 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f6bht" event={"ID":"1366a458-5728-4592-90d7-1e72adfdd230","Type":"ContainerStarted","Data":"30a44ca2c1aa5c977c2970919987d246ee93ee4b84f3cf6368a949e5e3fbb9c1"} Jul 01 19:35:13.289490 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.289468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" event={"ID":"e76f1b88-9a0a-487e-9e15-341aa91d99cc","Type":"ContainerStarted","Data":"a16f8b933583b3f292ffe2bb768dc736d26d77bb21558a8e5a36a4f2f6499ef1"} Jul 01 19:35:13.291060 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.291037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" event={"ID":"c501dee8-d105-42d6-ab83-27d6b05658e9","Type":"ContainerStarted","Data":"8ec3007276bb0d2db0caf728aa64a46d14432c64f0b3f0f765f01f333f9bbc9c"} Jul 01 19:35:13.292522 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.292503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"1a2d2bf6966de3ccee71c846c52d6dce96103214a6bdfbb1d9aa60eb72248fca"} Jul 01 19:35:13.293976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.293955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lphcd" event={"ID":"da278ba8-5895-428d-80cb-a70a14546f9a","Type":"ContainerStarted","Data":"75d6249b4a1d440b3a22e62779488b672cc572c13ba93ebe0418704d843df6b4"} Jul 01 19:35:13.298628 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.298554 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fp5fb" podStartSLOduration=3.051076556 podStartE2EDuration="23.298536216s" totalImagesPullingTime="20.24745966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:13.29712811 +0000 UTC m=+23.567112800" watchObservedRunningTime="2026-07-01 19:35:13.298536216 +0000 UTC m=+23.568520909" Jul 01 19:35:13.324109 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.324056 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dzlw2" podStartSLOduration=3.098454023 podStartE2EDuration="23.324039643s" totalImagesPullingTime="20.22558562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:13.322561228 +0000 UTC m=+23.592545919" watchObservedRunningTime="2026-07-01 19:35:13.324039643 +0000 UTC m=+23.594024330" Jul 01 19:35:13.390595 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.390552 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hjmmg" podStartSLOduration=3.125644779 podStartE2EDuration="23.390537746s" totalImagesPullingTime="20.264892967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:13.389360163 +0000 UTC m=+23.659344853" watchObservedRunningTime="2026-07-01 19:35:13.390537746 +0000 UTC m=+23.660522435" Jul 01 19:35:13.420910 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.420684 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lphcd" podStartSLOduration=3.17565534 podStartE2EDuration="23.420667705s" totalImagesPullingTime="20.245012365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:13.420361612 +0000 UTC m=+23.690346302" watchObservedRunningTime="2026-07-01 19:35:13.420667705 +0000 UTC m=+23.690652391" Jul 01 19:35:13.461252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:13.461196 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" podStartSLOduration=22.461178538 podStartE2EDuration="22.461178538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:13.46115977 +0000 UTC m=+23.731144459" watchObservedRunningTime="2026-07-01 19:35:13.461178538 +0000 UTC m=+23.731163227" Jul 01 19:35:14.201012 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.200978 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:14.201012 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.201009 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:14.201274 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:14.201120 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:14.201274 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:14.201212 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:14.297878 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.297583 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t5l2g" event={"ID":"ed105e33-44a8-4dc1-bdbd-bc0f1e6bc851","Type":"ContainerStarted","Data":"16e076cb84beae16494c434142644ef51a7d57b407c70819a8688dae00fd0b66"} Jul 01 19:35:14.304345 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.304319 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:35:14.304695 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.304671 2563 generic.go:356] "Generic (PLEG): container finished" podID="e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9" containerID="77462a003c3936b1b930aa2f11d338ba25cc0735fce242abf7dc21ff6473dcde" exitCode=1 Jul 01 19:35:14.304789 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.304762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"e9c4bad953efb75b38e6933fe9b0b0638d87f1b64d104c140141f8fb4b25caa9"} Jul 01 19:35:14.304908 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.304892 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"cdfc9dd23e051dacf44acf4978c50233dad251486f4d54b162aa2f399209499f"} Jul 01 19:35:14.304990 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.304976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"bb5ed7f68cac2dda2874a82a42b898d28fd90bda02404bb6e914eda623d43d2b"} Jul 01 19:35:14.305048 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.305031 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"874f2de56125e7d8f117c28c3977af73df13c0eadb7ba3bec29fa21a17616731"} Jul 01 19:35:14.305105 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.305080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerDied","Data":"77462a003c3936b1b930aa2f11d338ba25cc0735fce242abf7dc21ff6473dcde"} Jul 01 19:35:14.321922 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.321867 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f6bht" podStartSLOduration=4.044358838 podStartE2EDuration="24.32182874s" totalImagesPullingTime="20.277469902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:13.493192099 +0000 UTC m=+23.763176807" watchObservedRunningTime="2026-07-01 19:35:14.32182874 +0000 UTC m=+24.591813431" Jul 01 19:35:14.656288 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:14.656249 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:35:15.200716 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:15.200685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:15.200999 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:15.200838 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:15.203828 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:15.203722 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:35:14.656272002Z","UUID":"c704fd41-27f0-4012-bdca-9d0fb0a3874b","Handler":null,"Name":"","Endpoint":""} Jul 01 19:35:15.205327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:15.205307 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:35:15.205442 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:15.205342 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:35:15.309430 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:15.309399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" event={"ID":"e76f1b88-9a0a-487e-9e15-341aa91d99cc","Type":"ContainerStarted","Data":"19f9d3be57719218d4606f498be746208a3a46a4c79c30c4e9178891970c4907"} Jul 01 19:35:16.201055 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:16.201024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:16.201242 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:16.201139 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:16.201242 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:16.201200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:16.201337 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:16.201289 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:16.315382 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:16.315356 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:35:16.315842 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:16.315749 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"f6b9dcc177111da6b491a9ddb18cbccf948b9f6fd751f88b6f4f788659ed0975"} Jul 01 19:35:17.201186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:17.200986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:17.201375 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:17.201281 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:17.894469 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:17.894435 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:35:17.895146 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:17.895131 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:35:17.919397 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:17.919355 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t5l2g" podStartSLOduration=7.687642571 podStartE2EDuration="27.919340903s" totalImagesPullingTime="20.231698332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:14.322116129 +0000 UTC m=+24.592100822" watchObservedRunningTime="2026-07-01 19:35:17.919340903 +0000 UTC m=+28.189325644" Jul 01 19:35:18.200250 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.200226 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:18.200397 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:18.200375 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:18.200471 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.200418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:18.200574 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:18.200552 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:18.324660 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.324634 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:35:18.325110 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.325085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"cf77d42528ba3aaec5eae75f6674b62d70383f01f0e0e4fd70fa23559e43ae6b"} Jul 01 19:35:18.325596 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.325581 2563 scope.go:117] "RemoveContainer" containerID="77462a003c3936b1b930aa2f11d338ba25cc0735fce242abf7dc21ff6473dcde" Jul 01 19:35:18.325669 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.325653 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:35:18.327459 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.327433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerStarted","Data":"a7469da13668ae0b8850c6cc34cf4114981873d816aec2a442bfdbb5221bc20f"} Jul 01 19:35:18.330909 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.330648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" event={"ID":"e76f1b88-9a0a-487e-9e15-341aa91d99cc","Type":"ContainerStarted","Data":"5b35848a42ae2a5e2e0df5247493b45d06fda1dd7677abbe0b2f9518ab6ebf1e"} Jul 01 19:35:18.330909 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.330877 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:35:18.332052 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.331945 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hjmmg" Jul 01 19:35:18.350125 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.350096 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:35:18.481663 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:18.480471 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb57r" podStartSLOduration=3.681029965 podStartE2EDuration="28.480451731s" totalImagesPullingTime="24.799421766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:18.437926685 +0000 UTC m=+28.707911374" watchObservedRunningTime="2026-07-01 19:35:18.480451731 +0000 UTC m=+28.750436423" Jul 01 19:35:19.201253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.201218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:19.201846 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:19.201320 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:19.336094 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.336063 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:35:19.336448 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.336423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" event={"ID":"e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9","Type":"ContainerStarted","Data":"5bb5751daa72f96ca5cd39f033e4bc664619b97b11a8d5dd48b5783f09c2fa8f"} Jul 01 19:35:19.336721 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.336700 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:35:19.336885 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.336777 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:35:19.338478 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.338454 2563 generic.go:356] "Generic (PLEG): container finished" podID="d0537be0-fe7b-49e7-b048-3b7a553bd4c2" containerID="a7469da13668ae0b8850c6cc34cf4114981873d816aec2a442bfdbb5221bc20f" exitCode=0 Jul 01 19:35:19.338684 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.338521 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerDied","Data":"a7469da13668ae0b8850c6cc34cf4114981873d816aec2a442bfdbb5221bc20f"} Jul 01 19:35:19.354361 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.354333 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:35:19.372005 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:19.371959 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" podStartSLOduration=8.853815398 podStartE2EDuration="29.371944086s" totalImagesPullingTime="20.518128688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:19.371745935 +0000 UTC m=+29.641730625" watchObservedRunningTime="2026-07-01 19:35:19.371944086 +0000 UTC m=+29.641928775" Jul 01 19:35:20.201520 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.201492 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:20.201520 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.201516 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:20.202026 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:20.201614 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:20.202026 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:20.201710 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:20.529705 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.529670 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m5f64"] Jul 01 19:35:20.529878 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.529814 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:20.529970 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:20.529944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:20.535263 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.535234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hnc7"] Jul 01 19:35:20.535390 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.535351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:20.535461 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:20.535439 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:20.540110 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.540084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zs4qs"] Jul 01 19:35:20.540238 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:20.540189 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:20.540320 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:20.540272 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:21.347419 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:21.347386 2563 generic.go:356] "Generic (PLEG): container finished" podID="d0537be0-fe7b-49e7-b048-3b7a553bd4c2" containerID="cc57d93d296ed286d6cc5592918da8f018481efdf11ac72827d4a83886d064c3" exitCode=0 Jul 01 19:35:21.347804 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:21.347474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerDied","Data":"cc57d93d296ed286d6cc5592918da8f018481efdf11ac72827d4a83886d064c3"} Jul 01 19:35:22.203804 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:22.203774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:22.203977 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:22.203896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:22.203977 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:22.203911 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:22.204109 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:22.203981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:22.204109 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:22.203979 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:22.204109 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:22.204062 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:23.354154 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:23.353969 2563 generic.go:356] "Generic (PLEG): container finished" podID="d0537be0-fe7b-49e7-b048-3b7a553bd4c2" containerID="1cd6a09031c348ab336e74b3cfcaeeb3fd1190ca0849f96019d1d5d49f910b92" exitCode=0 Jul 01 19:35:23.354154 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:23.354049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerDied","Data":"1cd6a09031c348ab336e74b3cfcaeeb3fd1190ca0849f96019d1d5d49f910b92"} Jul 01 19:35:23.908801 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:23.908765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:23.908989 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:23.908809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:23.908989 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:23.908955 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:23.909061 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:23.909030 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret podName:787908ec-fa30-4a1e-9780-422791191981 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:55.909009061 +0000 UTC m=+66.178993761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret") pod "global-pull-secret-syncer-m5f64" (UID: "787908ec-fa30-4a1e-9780-422791191981") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:35:23.909138 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:23.908958 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:23.909259 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:23.909176 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs podName:d1426157-278d-400e-b2fb-5bddea2931a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:55.909161344 +0000 UTC m=+66.179146011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs") pod "network-metrics-daemon-9hnc7" (UID: "d1426157-278d-400e-b2fb-5bddea2931a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:35:24.110632 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:24.110590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:24.110809 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.110785 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:35:24.110873 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.110814 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:35:24.110873 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.110828 2563 projected.go:196] Error preparing data for projected volume kube-api-access-prvjr for pod openshift-network-diagnostics/network-check-target-zs4qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:24.110973 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.110912 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr podName:14c884cc-c67e-437f-80d9-5ca3eb6e09ea nodeName:}" failed. No retries permitted until 2026-07-01 19:35:56.110892844 +0000 UTC m=+66.380877512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvjr" (UniqueName: "kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr") pod "network-check-target-zs4qs" (UID: "14c884cc-c67e-437f-80d9-5ca3eb6e09ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:35:24.201810 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:24.201279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:24.201810 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:24.201286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:24.201810 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:24.201291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:24.201810 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.201414 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zs4qs" podUID="14c884cc-c67e-437f-80d9-5ca3eb6e09ea" Jul 01 19:35:24.201810 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.201529 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m5f64" podUID="787908ec-fa30-4a1e-9780-422791191981" Jul 01 19:35:24.201810 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:24.201631 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hnc7" podUID="d1426157-278d-400e-b2fb-5bddea2931a5" Jul 01 19:35:25.548711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.548680 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeReady" Jul 01 19:35:25.549211 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.548835 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:35:25.588520 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.588481 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-954c97544-gnv5b"] Jul 01 19:35:25.590938 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.590913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.594144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.594120 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:35:25.594144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.594131 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:35:25.594506 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.594487 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdmnz\"" Jul 01 19:35:25.594600 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.594518 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:35:25.603841 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.603817 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:35:25.610379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.610359 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-954c97544-gnv5b"] Jul 01 19:35:25.612134 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.612115 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ptjvk"] Jul 01 19:35:25.614286 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.614269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.615318 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.615299 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xcrmt"] Jul 01 19:35:25.617727 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.617705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.617838 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.617799 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tq7c\"" Jul 01 19:35:25.618817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.618795 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:35:25.618934 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.618804 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:35:25.618934 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.618840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:35:25.620552 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.620533 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:35:25.620803 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.620786 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g9mcw\"" Jul 01 19:35:25.620903 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.620785 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:35:25.632936 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.632911 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xcrmt"] Jul 01 19:35:25.633664 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.633640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptjvk"] Jul 01 19:35:25.721532 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721532 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098ba5d-f584-4dce-9238-046613b16eee-ca-trust-extracted\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721532 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-bound-sa-token\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-registry-certificates\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-image-registry-private-configuration\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/287f889d-ee47-4ded-aeb7-8658f75ed31d-config-volume\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.721976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qffd4\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-kube-api-access-qffd4\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhgs\" (UniqueName: \"kubernetes.io/projected/ec602860-3dba-4d84-a58d-e392eb053e78-kube-api-access-dkhgs\") pod \"ingress-canary-ptjvk\" (UID: \"ec602860-3dba-4d84-a58d-e392eb053e78\") " pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.721976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.721976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-installation-pull-secrets\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.721976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec602860-3dba-4d84-a58d-e392eb053e78-cert\") pod \"ingress-canary-ptjvk\" (UID: \"ec602860-3dba-4d84-a58d-e392eb053e78\") " pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.722206 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.721976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7n6\" (UniqueName: \"kubernetes.io/projected/287f889d-ee47-4ded-aeb7-8658f75ed31d-kube-api-access-cw7n6\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.722206 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.722004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/287f889d-ee47-4ded-aeb7-8658f75ed31d-tmp-dir\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.722206 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.722089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-trusted-ca\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.822918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.822843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823105 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.822944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098ba5d-f584-4dce-9238-046613b16eee-ca-trust-extracted\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823105 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.822969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-bound-sa-token\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823105 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-registry-certificates\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823105 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:25.823032 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:35:25.823105 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:25.823059 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-954c97544-gnv5b: secret "image-registry-tls" not found Jul 01 19:35:25.823369 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:25.823126 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls podName:0098ba5d-f584-4dce-9238-046613b16eee nodeName:}" failed. No retries permitted until 2026-07-01 19:35:26.323103889 +0000 UTC m=+36.593088569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls") pod "image-registry-954c97544-gnv5b" (UID: "0098ba5d-f584-4dce-9238-046613b16eee") : secret "image-registry-tls" not found Jul 01 19:35:25.823369 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-image-registry-private-configuration\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823369 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/287f889d-ee47-4ded-aeb7-8658f75ed31d-config-volume\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.823369 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qffd4\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-kube-api-access-qffd4\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823369 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhgs\" (UniqueName: \"kubernetes.io/projected/ec602860-3dba-4d84-a58d-e392eb053e78-kube-api-access-dkhgs\") pod \"ingress-canary-ptjvk\" (UID: \"ec602860-3dba-4d84-a58d-e392eb053e78\") " pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.823593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.823593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823415 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098ba5d-f584-4dce-9238-046613b16eee-ca-trust-extracted\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-installation-pull-secrets\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.823593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec602860-3dba-4d84-a58d-e392eb053e78-cert\") pod \"ingress-canary-ptjvk\" (UID: \"ec602860-3dba-4d84-a58d-e392eb053e78\") " pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.823593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7n6\" (UniqueName: \"kubernetes.io/projected/287f889d-ee47-4ded-aeb7-8658f75ed31d-kube-api-access-cw7n6\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.823593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/287f889d-ee47-4ded-aeb7-8658f75ed31d-tmp-dir\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.823827 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.823631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-trusted-ca\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.824616 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.824536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-trusted-ca\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.825250 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.825227 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/287f889d-ee47-4ded-aeb7-8658f75ed31d-config-volume\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.825366 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.825253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/287f889d-ee47-4ded-aeb7-8658f75ed31d-tmp-dir\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.825881 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:25.825828 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:35:25.825991 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:25.825923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls podName:287f889d-ee47-4ded-aeb7-8658f75ed31d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:26.325903046 +0000 UTC m=+36.595887715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls") pod "dns-default-xcrmt" (UID: "287f889d-ee47-4ded-aeb7-8658f75ed31d") : secret "dns-default-metrics-tls" not found Jul 01 19:35:25.826132 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.826109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-registry-certificates\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.828610 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.828588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec602860-3dba-4d84-a58d-e392eb053e78-cert\") pod \"ingress-canary-ptjvk\" (UID: \"ec602860-3dba-4d84-a58d-e392eb053e78\") " pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.829560 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.829536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-installation-pull-secrets\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.831603 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.831581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-image-registry-private-configuration\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.835977 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.835946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-bound-sa-token\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.837246 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.837218 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qffd4\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-kube-api-access-qffd4\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:25.837864 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.837824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7n6\" (UniqueName: \"kubernetes.io/projected/287f889d-ee47-4ded-aeb7-8658f75ed31d-kube-api-access-cw7n6\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:25.840219 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.840193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhgs\" (UniqueName: \"kubernetes.io/projected/ec602860-3dba-4d84-a58d-e392eb053e78-kube-api-access-dkhgs\") pod \"ingress-canary-ptjvk\" (UID: \"ec602860-3dba-4d84-a58d-e392eb053e78\") " pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:25.927302 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:25.927265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptjvk" Jul 01 19:35:26.200471 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.200437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:26.200659 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.200447 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:26.200659 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.200578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:26.203837 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.203810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdstn\"" Jul 01 19:35:26.203988 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.203906 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:35:26.204133 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.204116 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:35:26.204334 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.204319 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8z2\"" Jul 01 19:35:26.204404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.204339 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:35:26.204404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.204347 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:35:26.327937 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.327898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:26.328133 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:26.327990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:26.328133 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:26.328110 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:35:26.328133 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:26.328114 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:35:26.328133 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:26.328134 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-954c97544-gnv5b: secret "image-registry-tls" not found Jul 01 19:35:26.328344 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:26.328173 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls podName:287f889d-ee47-4ded-aeb7-8658f75ed31d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:27.328155646 +0000 UTC m=+37.598140337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls") pod "dns-default-xcrmt" (UID: "287f889d-ee47-4ded-aeb7-8658f75ed31d") : secret "dns-default-metrics-tls" not found Jul 01 19:35:26.328344 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:26.328189 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls podName:0098ba5d-f584-4dce-9238-046613b16eee nodeName:}" failed. No retries permitted until 2026-07-01 19:35:27.3281811 +0000 UTC m=+37.598165776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls") pod "image-registry-954c97544-gnv5b" (UID: "0098ba5d-f584-4dce-9238-046613b16eee") : secret "image-registry-tls" not found Jul 01 19:35:27.334796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:27.334757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:27.335530 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:27.334819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:27.335530 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:27.334947 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:35:27.335530 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:27.334950 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:35:27.335530 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:27.334970 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-954c97544-gnv5b: secret "image-registry-tls" not found Jul 01 19:35:27.335530 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:27.335024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls podName:0098ba5d-f584-4dce-9238-046613b16eee nodeName:}" failed. No retries permitted until 2026-07-01 19:35:29.335010098 +0000 UTC m=+39.604994773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls") pod "image-registry-954c97544-gnv5b" (UID: "0098ba5d-f584-4dce-9238-046613b16eee") : secret "image-registry-tls" not found Jul 01 19:35:27.335530 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:27.335074 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls podName:287f889d-ee47-4ded-aeb7-8658f75ed31d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:29.335063375 +0000 UTC m=+39.605048055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls") pod "dns-default-xcrmt" (UID: "287f889d-ee47-4ded-aeb7-8658f75ed31d") : secret "dns-default-metrics-tls" not found Jul 01 19:35:27.527568 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:27.527409 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptjvk"] Jul 01 19:35:27.531072 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:27.531047 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec602860_3dba_4d84_a58d_e392eb053e78.slice/crio-caf2118c9466b16e7f8675836da90499ad46ca9b9ff23766ae882b1ffb30041a WatchSource:0}: Error finding container caf2118c9466b16e7f8675836da90499ad46ca9b9ff23766ae882b1ffb30041a: Status 404 returned error can't find the container with id caf2118c9466b16e7f8675836da90499ad46ca9b9ff23766ae882b1ffb30041a Jul 01 19:35:28.373215 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:28.373181 2563 generic.go:356] "Generic (PLEG): container finished" podID="d0537be0-fe7b-49e7-b048-3b7a553bd4c2" containerID="ca4a92eeb2fa34065cf6b1c7d80c8984cd207bc0ae300a4f56bd532b5459b12b" exitCode=0 Jul 01 19:35:28.373798 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:28.373275 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerDied","Data":"ca4a92eeb2fa34065cf6b1c7d80c8984cd207bc0ae300a4f56bd532b5459b12b"} Jul 01 19:35:28.374889 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:28.374835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptjvk" event={"ID":"ec602860-3dba-4d84-a58d-e392eb053e78","Type":"ContainerStarted","Data":"caf2118c9466b16e7f8675836da90499ad46ca9b9ff23766ae882b1ffb30041a"} Jul 01 19:35:29.305027 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.304992 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22"] Jul 01 19:35:29.309148 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.309126 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-qn2gb"] Jul 01 19:35:29.309270 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.309254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:29.312088 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.312063 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qgm9j"] Jul 01 19:35:29.312211 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.312168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.315577 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.315554 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss"] Jul 01 19:35:29.315687 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.315664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" Jul 01 19:35:29.319914 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.319894 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" Jul 01 19:35:29.325709 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.325687 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 19:35:29.326565 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.326541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 19:35:29.326973 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.326947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v7mmn\"" Jul 01 19:35:29.327276 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.327258 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.328156 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.328136 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cvsmt\"" Jul 01 19:35:29.328348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.328328 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.329892 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.329870 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.333494 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.333473 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2zq8g\"" Jul 01 19:35:29.333598 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.333536 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.334518 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.334501 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.334759 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.334742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-954vm\"" Jul 01 19:35:29.335786 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.335149 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 19:35:29.336132 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.336112 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.352353 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.351953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:29.352353 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.352059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:29.352353 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.352205 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:35:29.352353 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.352258 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls podName:287f889d-ee47-4ded-aeb7-8658f75ed31d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:33.352245731 +0000 UTC m=+43.622230403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls") pod "dns-default-xcrmt" (UID: "287f889d-ee47-4ded-aeb7-8658f75ed31d") : secret "dns-default-metrics-tls" not found Jul 01 19:35:29.353201 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.353177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22"] Jul 01 19:35:29.353343 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.353264 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:35:29.353343 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.353275 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-954c97544-gnv5b: secret "image-registry-tls" not found Jul 01 19:35:29.353343 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.353336 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls podName:0098ba5d-f584-4dce-9238-046613b16eee nodeName:}" failed. No retries permitted until 2026-07-01 19:35:33.353319007 +0000 UTC m=+43.623303681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls") pod "image-registry-954c97544-gnv5b" (UID: "0098ba5d-f584-4dce-9238-046613b16eee") : secret "image-registry-tls" not found Jul 01 19:35:29.354063 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.354038 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-qn2gb"] Jul 01 19:35:29.366753 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.366727 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qgm9j"] Jul 01 19:35:29.372830 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.372804 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 19:35:29.382295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.382270 2563 generic.go:356] "Generic (PLEG): container finished" podID="d0537be0-fe7b-49e7-b048-3b7a553bd4c2" containerID="8340278e1853fd26b465d2a870bdae5bdbffe14df58f014d490038018bf1acde" exitCode=0 Jul 01 19:35:29.382672 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.382318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerDied","Data":"8340278e1853fd26b465d2a870bdae5bdbffe14df58f014d490038018bf1acde"} Jul 01 19:35:29.405455 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.405426 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss"] Jul 01 19:35:29.422528 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.422491 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4"] Jul 01 19:35:29.429266 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.429232 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr"] Jul 01 19:35:29.429423 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.429360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.436108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.436076 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 19:35:29.436108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.436095 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 19:35:29.436320 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.436120 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.436320 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.436299 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.436448 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.436427 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nvql2\"" Jul 01 19:35:29.437067 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.436577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.439720 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.439702 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.439995 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.439974 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 19:35:29.440320 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.440219 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 19:35:29.442168 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.442140 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.442380 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.442361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w566z\"" Jul 01 19:35:29.442546 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.442531 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4"] Jul 01 19:35:29.443466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.443445 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr"] Jul 01 19:35:29.453360 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39c8ff20-44a0-4999-8b14-449cfd0cc093-snapshots\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.453506 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:29.453506 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6k5\" (UniqueName: \"kubernetes.io/projected/f262857e-88cd-438c-9884-da39c9ab2dc4-kube-api-access-ch6k5\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:29.453506 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39c8ff20-44a0-4999-8b14-449cfd0cc093-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.453506 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39c8ff20-44a0-4999-8b14-449cfd0cc093-service-ca-bundle\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.453719 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c8ff20-44a0-4999-8b14-449cfd0cc093-serving-cert\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.453719 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6xq\" (UniqueName: \"kubernetes.io/projected/30672345-743c-4dab-8d4d-b17ad77892f7-kube-api-access-sc6xq\") pod \"volume-data-source-validator-69d9f679db-nj5ss\" (UID: \"30672345-743c-4dab-8d4d-b17ad77892f7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" Jul 01 19:35:29.453719 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39c8ff20-44a0-4999-8b14-449cfd0cc093-tmp\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.453719 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn56g\" (UniqueName: \"kubernetes.io/projected/39c8ff20-44a0-4999-8b14-449cfd0cc093-kube-api-access-bn56g\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.453719 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.453664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghp4\" (UniqueName: \"kubernetes.io/projected/b8be953a-f47d-463b-a05e-eeaa5be99346-kube-api-access-cghp4\") pod \"network-check-source-56499946bc-qgm9j\" (UID: \"b8be953a-f47d-463b-a05e-eeaa5be99346\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" Jul 01 19:35:29.492575 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.492546 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5"] Jul 01 19:35:29.499221 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.499199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.499653 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.499555 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-pgw4w"] Jul 01 19:35:29.502110 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.502093 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.502222 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.502135 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 19:35:29.502222 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.502135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j8zjd\"" Jul 01 19:35:29.502344 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.502303 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.502602 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.502588 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 19:35:29.505648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.505616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.512184 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.512168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6tvlv\"" Jul 01 19:35:29.513008 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.512987 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 19:35:29.513110 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.513018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 19:35:29.513399 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.513382 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.513783 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.513764 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.519843 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.519817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5"] Jul 01 19:35:29.522565 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.522544 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 19:35:29.538256 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.538224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-pgw4w"] Jul 01 19:35:29.540798 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.540767 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c4496dc6f-dsxlr"] Jul 01 19:35:29.547395 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.547368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.550571 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.550547 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 19:35:29.550729 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.550611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 19:35:29.550729 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.550538 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 19:35:29.550864 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.550785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 19:35:29.551209 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.551186 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 19:35:29.551334 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.551223 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 19:35:29.551397 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.551336 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-88sm8\"" Jul 01 19:35:29.554125 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6xq\" (UniqueName: \"kubernetes.io/projected/30672345-743c-4dab-8d4d-b17ad77892f7-kube-api-access-sc6xq\") pod \"volume-data-source-validator-69d9f679db-nj5ss\" (UID: \"30672345-743c-4dab-8d4d-b17ad77892f7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" Jul 01 19:35:29.554253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:29.554253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39c8ff20-44a0-4999-8b14-449cfd0cc093-snapshots\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.554253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6k5\" (UniqueName: \"kubernetes.io/projected/f262857e-88cd-438c-9884-da39c9ab2dc4-kube-api-access-ch6k5\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:29.554253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e9dc957-b331-4959-b98b-72fd2150b1ea-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.554427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn56g\" (UniqueName: \"kubernetes.io/projected/39c8ff20-44a0-4999-8b14-449cfd0cc093-kube-api-access-bn56g\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.554427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghp4\" (UniqueName: \"kubernetes.io/projected/b8be953a-f47d-463b-a05e-eeaa5be99346-kube-api-access-cghp4\") pod \"network-check-source-56499946bc-qgm9j\" (UID: \"b8be953a-f47d-463b-a05e-eeaa5be99346\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" Jul 01 19:35:29.554427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554316 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e9dc957-b331-4959-b98b-72fd2150b1ea-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.554427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.554427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39c8ff20-44a0-4999-8b14-449cfd0cc093-service-ca-bundle\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.554427 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mb92\" (UniqueName: \"kubernetes.io/projected/5e9dc957-b331-4959-b98b-72fd2150b1ea-kube-api-access-7mb92\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.554676 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgvs\" (UniqueName: \"kubernetes.io/projected/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-kube-api-access-5wgvs\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.555218 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.554976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39c8ff20-44a0-4999-8b14-449cfd0cc093-snapshots\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.555682 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.555656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39c8ff20-44a0-4999-8b14-449cfd0cc093-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.555819 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.555694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c8ff20-44a0-4999-8b14-449cfd0cc093-serving-cert\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.555819 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.555662 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:35:29.555819 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.555791 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls podName:f262857e-88cd-438c-9884-da39c9ab2dc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:30.055768421 +0000 UTC m=+40.325753092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-psm22" (UID: "f262857e-88cd-438c-9884-da39c9ab2dc4") : secret "samples-operator-tls" not found Jul 01 19:35:29.556013 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.555840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.556013 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.555939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39c8ff20-44a0-4999-8b14-449cfd0cc093-tmp\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.556290 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.556270 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39c8ff20-44a0-4999-8b14-449cfd0cc093-tmp\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.556366 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.556278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39c8ff20-44a0-4999-8b14-449cfd0cc093-service-ca-bundle\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.556474 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.556452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39c8ff20-44a0-4999-8b14-449cfd0cc093-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.560439 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.560417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39c8ff20-44a0-4999-8b14-449cfd0cc093-serving-cert\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.565260 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.565235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c4496dc6f-dsxlr"] Jul 01 19:35:29.569931 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.569907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6xq\" (UniqueName: \"kubernetes.io/projected/30672345-743c-4dab-8d4d-b17ad77892f7-kube-api-access-sc6xq\") pod \"volume-data-source-validator-69d9f679db-nj5ss\" (UID: \"30672345-743c-4dab-8d4d-b17ad77892f7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" Jul 01 19:35:29.571703 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.571671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn56g\" (UniqueName: \"kubernetes.io/projected/39c8ff20-44a0-4999-8b14-449cfd0cc093-kube-api-access-bn56g\") pod \"insights-operator-5f67b55555-qn2gb\" (UID: \"39c8ff20-44a0-4999-8b14-449cfd0cc093\") " pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.571977 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.571959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghp4\" (UniqueName: \"kubernetes.io/projected/b8be953a-f47d-463b-a05e-eeaa5be99346-kube-api-access-cghp4\") pod \"network-check-source-56499946bc-qgm9j\" (UID: \"b8be953a-f47d-463b-a05e-eeaa5be99346\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" Jul 01 19:35:29.572308 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.572287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6k5\" (UniqueName: \"kubernetes.io/projected/f262857e-88cd-438c-9884-da39c9ab2dc4-kube-api-access-ch6k5\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:29.627886 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.627831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" Jul 01 19:35:29.636132 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.636092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" Jul 01 19:35:29.643298 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.643268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" Jul 01 19:35:29.656335 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f83142e-57df-4a86-ab83-16aab214cba1-trusted-ca\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.656335 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-stats-auth\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-default-certificate\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jd9z\" (UniqueName: \"kubernetes.io/projected/af70a0dd-0806-4d7c-a848-f54624ce5f30-kube-api-access-7jd9z\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e9dc957-b331-4959-b98b-72fd2150b1ea-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjqnz\" (UniqueName: \"kubernetes.io/projected/0f83142e-57df-4a86-ab83-16aab214cba1-kube-api-access-fjqnz\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e9dc957-b331-4959-b98b-72fd2150b1ea-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f83142e-57df-4a86-ab83-16aab214cba1-serving-cert\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.656557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f83142e-57df-4a86-ab83-16aab214cba1-config\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7ed238b-41a1-4f79-b2b8-621453417915-config\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mb92\" (UniqueName: \"kubernetes.io/projected/5e9dc957-b331-4959-b98b-72fd2150b1ea-kube-api-access-7mb92\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgvs\" (UniqueName: \"kubernetes.io/projected/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-kube-api-access-5wgvs\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.656918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.656782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khs4p\" (UniqueName: \"kubernetes.io/projected/e7ed238b-41a1-4f79-b2b8-621453417915-kube-api-access-khs4p\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.657610 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.657050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ed238b-41a1-4f79-b2b8-621453417915-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.657610 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.657078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e9dc957-b331-4959-b98b-72fd2150b1ea-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.657610 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.657095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.657610 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.657167 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:29.657610 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.657230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls podName:3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:30.157212934 +0000 UTC m=+40.427197619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-7ndg4" (UID: "3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:29.657610 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.657334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.659366 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.659342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e9dc957-b331-4959-b98b-72fd2150b1ea-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.673032 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.673004 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mb92\" (UniqueName: \"kubernetes.io/projected/5e9dc957-b331-4959-b98b-72fd2150b1ea-kube-api-access-7mb92\") pod \"kube-storage-version-migrator-operator-79964ff6f9-shvqr\" (UID: \"5e9dc957-b331-4959-b98b-72fd2150b1ea\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.675511 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.675484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgvs\" (UniqueName: \"kubernetes.io/projected/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-kube-api-access-5wgvs\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:29.752229 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.752194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" Jul 01 19:35:29.758182 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jd9z\" (UniqueName: \"kubernetes.io/projected/af70a0dd-0806-4d7c-a848-f54624ce5f30-kube-api-access-7jd9z\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.758340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjqnz\" (UniqueName: \"kubernetes.io/projected/0f83142e-57df-4a86-ab83-16aab214cba1-kube-api-access-fjqnz\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.758340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f83142e-57df-4a86-ab83-16aab214cba1-serving-cert\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.758340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.758507 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.758408 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:30.25838971 +0000 UTC m=+40.528374393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : configmap references non-existent config key: service-ca.crt Jul 01 19:35:29.758566 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.758566 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f83142e-57df-4a86-ab83-16aab214cba1-config\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.758566 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7ed238b-41a1-4f79-b2b8-621453417915-config\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.758716 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.758641 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:35:29.758716 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:29.758697 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:30.258680166 +0000 UTC m=+40.528664833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : secret "router-metrics-certs-default" not found Jul 01 19:35:29.758819 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khs4p\" (UniqueName: \"kubernetes.io/projected/e7ed238b-41a1-4f79-b2b8-621453417915-kube-api-access-khs4p\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.758819 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ed238b-41a1-4f79-b2b8-621453417915-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.758962 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f83142e-57df-4a86-ab83-16aab214cba1-trusted-ca\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.759107 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.758981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-stats-auth\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.759107 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.759007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-default-certificate\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.759107 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.759092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7ed238b-41a1-4f79-b2b8-621453417915-config\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.759319 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.759283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f83142e-57df-4a86-ab83-16aab214cba1-config\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.759885 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.759769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f83142e-57df-4a86-ab83-16aab214cba1-trusted-ca\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.762146 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.762121 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ed238b-41a1-4f79-b2b8-621453417915-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.762456 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.762416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f83142e-57df-4a86-ab83-16aab214cba1-serving-cert\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.762725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.762532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-stats-auth\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.762725 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.762573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-default-certificate\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.770666 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.770641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjqnz\" (UniqueName: \"kubernetes.io/projected/0f83142e-57df-4a86-ab83-16aab214cba1-kube-api-access-fjqnz\") pod \"console-operator-7fdbdf9c99-pgw4w\" (UID: \"0f83142e-57df-4a86-ab83-16aab214cba1\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.770924 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.770905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jd9z\" (UniqueName: \"kubernetes.io/projected/af70a0dd-0806-4d7c-a848-f54624ce5f30-kube-api-access-7jd9z\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:29.772347 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.772325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khs4p\" (UniqueName: \"kubernetes.io/projected/e7ed238b-41a1-4f79-b2b8-621453417915-kube-api-access-khs4p\") pod \"service-ca-operator-5d7b7dc95c-hztv5\" (UID: \"e7ed238b-41a1-4f79-b2b8-621453417915\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.811952 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.811415 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" Jul 01 19:35:29.821985 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.820099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:29.983231 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.983156 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qgm9j"] Jul 01 19:35:29.983394 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:29.983246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss"] Jul 01 19:35:30.007581 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.007433 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-qn2gb"] Jul 01 19:35:30.011753 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:30.011721 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c8ff20_44a0_4999_8b14_449cfd0cc093.slice/crio-3a8b79c9c55579f4c781c80eb415f3391d44164415b6fbf6872091a098e1c963 WatchSource:0}: Error finding container 3a8b79c9c55579f4c781c80eb415f3391d44164415b6fbf6872091a098e1c963: Status 404 returned error can't find the container with id 3a8b79c9c55579f4c781c80eb415f3391d44164415b6fbf6872091a098e1c963 Jul 01 19:35:30.027179 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.027128 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr"] Jul 01 19:35:30.065035 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.064952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:30.065201 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.065100 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:35:30.065201 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.065157 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls podName:f262857e-88cd-438c-9884-da39c9ab2dc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:31.065142555 +0000 UTC m=+41.335127223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-psm22" (UID: "f262857e-88cd-438c-9884-da39c9ab2dc4") : secret "samples-operator-tls" not found Jul 01 19:35:30.072414 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.072387 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5"] Jul 01 19:35:30.085283 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.085260 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-pgw4w"] Jul 01 19:35:30.165389 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.165358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:30.165544 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.165524 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:30.165607 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.165597 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls podName:3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:31.165580384 +0000 UTC m=+41.435565055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-7ndg4" (UID: "3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:30.191885 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:30.191836 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9dc957_b331_4959_b98b_72fd2150b1ea.slice/crio-5d3bbe9f4a8b93c885faba499936e4408da8a1a023c515fa2ca7effb07fca552 WatchSource:0}: Error finding container 5d3bbe9f4a8b93c885faba499936e4408da8a1a023c515fa2ca7effb07fca552: Status 404 returned error can't find the container with id 5d3bbe9f4a8b93c885faba499936e4408da8a1a023c515fa2ca7effb07fca552 Jul 01 19:35:30.192582 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:30.192565 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ed238b_41a1_4f79_b2b8_621453417915.slice/crio-035122fa53638cbefd618489f77361c00d928e3d17a0d6b1d8f4c1f966e0cb13 WatchSource:0}: Error finding container 035122fa53638cbefd618489f77361c00d928e3d17a0d6b1d8f4c1f966e0cb13: Status 404 returned error can't find the container with id 035122fa53638cbefd618489f77361c00d928e3d17a0d6b1d8f4c1f966e0cb13 Jul 01 19:35:30.203194 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:30.203169 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f83142e_57df_4a86_ab83_16aab214cba1.slice/crio-3c18870b954f2cfa8a3df4632409b7a849533f5b4d7a15c7dc30ccc787ce11c0 WatchSource:0}: Error finding container 3c18870b954f2cfa8a3df4632409b7a849533f5b4d7a15c7dc30ccc787ce11c0: Status 404 returned error can't find the container with id 3c18870b954f2cfa8a3df4632409b7a849533f5b4d7a15c7dc30ccc787ce11c0 Jul 01 19:35:30.266676 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.266651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:30.266676 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.266682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:30.266837 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.266779 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:35:30.266837 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.266808 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:31.266790814 +0000 UTC m=+41.536775481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : configmap references non-existent config key: service-ca.crt Jul 01 19:35:30.266837 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.266831 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:31.266822639 +0000 UTC m=+41.536807307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : secret "router-metrics-certs-default" not found Jul 01 19:35:30.386203 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.385944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" event={"ID":"b8be953a-f47d-463b-a05e-eeaa5be99346","Type":"ContainerStarted","Data":"7df07beea1373a66783fcee0a81588c68406bab352c9bc083847318cfdac33d8"} Jul 01 19:35:30.387231 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.387198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" event={"ID":"30672345-743c-4dab-8d4d-b17ad77892f7","Type":"ContainerStarted","Data":"699cd6c5e0ca4a5f137575e463341a6321702d7b420ecce7aec4b9a7edd76ff1"} Jul 01 19:35:30.390747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.390721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" event={"ID":"d0537be0-fe7b-49e7-b048-3b7a553bd4c2","Type":"ContainerStarted","Data":"051556c90e36fe968cdb2e301df953851ca392d8d194fe90e88d43cc3a95836c"} Jul 01 19:35:30.392296 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.392275 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptjvk" event={"ID":"ec602860-3dba-4d84-a58d-e392eb053e78","Type":"ContainerStarted","Data":"4e880ba4d5cea82e544ce5e78c44cb735c93c5fcfa85d47447e8ce309eda3d6e"} Jul 01 19:35:30.393329 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.393306 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" event={"ID":"0f83142e-57df-4a86-ab83-16aab214cba1","Type":"ContainerStarted","Data":"3c18870b954f2cfa8a3df4632409b7a849533f5b4d7a15c7dc30ccc787ce11c0"} Jul 01 19:35:30.398678 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.398649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" event={"ID":"5e9dc957-b331-4959-b98b-72fd2150b1ea","Type":"ContainerStarted","Data":"5d3bbe9f4a8b93c885faba499936e4408da8a1a023c515fa2ca7effb07fca552"} Jul 01 19:35:30.400040 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.400019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" event={"ID":"e7ed238b-41a1-4f79-b2b8-621453417915","Type":"ContainerStarted","Data":"035122fa53638cbefd618489f77361c00d928e3d17a0d6b1d8f4c1f966e0cb13"} Jul 01 19:35:30.401684 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.401662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" event={"ID":"39c8ff20-44a0-4999-8b14-449cfd0cc093","Type":"ContainerStarted","Data":"3a8b79c9c55579f4c781c80eb415f3391d44164415b6fbf6872091a098e1c963"} Jul 01 19:35:30.419364 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.419308 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4fhr" podStartSLOduration=9.243502236 podStartE2EDuration="40.419291665s" totalImagesPullingTime="31.175789429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:30.417884671 +0000 UTC m=+40.687869358" watchObservedRunningTime="2026-07-01 19:35:30.419291665 +0000 UTC m=+40.689276333" Jul 01 19:35:30.433516 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.433476 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps"] Jul 01 19:35:30.443527 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.443470 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ptjvk" podStartSLOduration=2.735749727 podStartE2EDuration="5.443451022s" totalImagesPullingTime="2.707701295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:30.442667363 +0000 UTC m=+40.712652053" watchObservedRunningTime="2026-07-01 19:35:30.443451022 +0000 UTC m=+40.713435694" Jul 01 19:35:30.448612 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.448584 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps"] Jul 01 19:35:30.448796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.448691 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:30.452167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.452143 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 19:35:30.452167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.452160 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mq7w8\"" Jul 01 19:35:30.452334 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.452201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 19:35:30.570625 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.570579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:30.570625 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.570627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4818e1a6-8504-4b15-82e1-9afcc0533aae-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:30.671263 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.671231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:30.671445 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.671271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4818e1a6-8504-4b15-82e1-9afcc0533aae-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:30.671445 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.671388 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:35:30.671559 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:30.671455 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert podName:4818e1a6-8504-4b15-82e1-9afcc0533aae nodeName:}" failed. No retries permitted until 2026-07-01 19:35:31.171434807 +0000 UTC m=+41.441419478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-qzbps" (UID: "4818e1a6-8504-4b15-82e1-9afcc0533aae") : secret "networking-console-plugin-cert" not found Jul 01 19:35:30.672265 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:30.672243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4818e1a6-8504-4b15-82e1-9afcc0533aae-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:31.076416 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:31.076328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:31.076637 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.076545 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:35:31.076637 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.076611 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls podName:f262857e-88cd-438c-9884-da39c9ab2dc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:33.076590876 +0000 UTC m=+43.346575567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-psm22" (UID: "f262857e-88cd-438c-9884-da39c9ab2dc4") : secret "samples-operator-tls" not found Jul 01 19:35:31.177341 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:31.177296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:31.177503 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:31.177447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:31.177650 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.177623 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:31.177718 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.177695 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls podName:3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:33.177675775 +0000 UTC m=+43.447660463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-7ndg4" (UID: "3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:31.178158 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.178132 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:35:31.178268 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.178199 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert podName:4818e1a6-8504-4b15-82e1-9afcc0533aae nodeName:}" failed. No retries permitted until 2026-07-01 19:35:32.178183868 +0000 UTC m=+42.448168557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-qzbps" (UID: "4818e1a6-8504-4b15-82e1-9afcc0533aae") : secret "networking-console-plugin-cert" not found Jul 01 19:35:31.279273 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:31.279230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:31.279431 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:31.279293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:31.279572 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.279554 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:35:31.279629 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.279621 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:33.279603501 +0000 UTC m=+43.549588183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : secret "router-metrics-certs-default" not found Jul 01 19:35:31.280064 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:31.280045 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:33.280032248 +0000 UTC m=+43.550016929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : configmap references non-existent config key: service-ca.crt Jul 01 19:35:32.189480 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:32.189439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:32.189915 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:32.189702 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:35:32.189915 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:32.189774 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert podName:4818e1a6-8504-4b15-82e1-9afcc0533aae nodeName:}" failed. No retries permitted until 2026-07-01 19:35:34.189754123 +0000 UTC m=+44.459738815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-qzbps" (UID: "4818e1a6-8504-4b15-82e1-9afcc0533aae") : secret "networking-console-plugin-cert" not found Jul 01 19:35:33.098983 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:33.098950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:33.099146 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.099120 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:35:33.099198 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.099183 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls podName:f262857e-88cd-438c-9884-da39c9ab2dc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:37.099166446 +0000 UTC m=+47.369151116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-psm22" (UID: "f262857e-88cd-438c-9884-da39c9ab2dc4") : secret "samples-operator-tls" not found Jul 01 19:35:33.200307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:33.200266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:33.200710 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.200420 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:33.200710 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.200475 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls podName:3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:37.200461746 +0000 UTC m=+47.470446414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-7ndg4" (UID: "3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:33.301297 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:33.301259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:33.301495 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:33.301312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:33.301495 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.301474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:37.301450821 +0000 UTC m=+47.571435512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : configmap references non-existent config key: service-ca.crt Jul 01 19:35:33.301619 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.301530 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:35:33.301619 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.301586 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:37.301569885 +0000 UTC m=+47.571554558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : secret "router-metrics-certs-default" not found Jul 01 19:35:33.402091 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:33.402062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:33.402250 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:33.402191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:33.402250 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.402230 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:35:33.402320 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.402299 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls podName:287f889d-ee47-4ded-aeb7-8658f75ed31d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:41.402280964 +0000 UTC m=+51.672265645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls") pod "dns-default-xcrmt" (UID: "287f889d-ee47-4ded-aeb7-8658f75ed31d") : secret "dns-default-metrics-tls" not found Jul 01 19:35:33.402320 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.402312 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:35:33.402388 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.402324 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-954c97544-gnv5b: secret "image-registry-tls" not found Jul 01 19:35:33.402388 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:33.402373 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls podName:0098ba5d-f584-4dce-9238-046613b16eee nodeName:}" failed. No retries permitted until 2026-07-01 19:35:41.402358566 +0000 UTC m=+51.672343261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls") pod "image-registry-954c97544-gnv5b" (UID: "0098ba5d-f584-4dce-9238-046613b16eee") : secret "image-registry-tls" not found Jul 01 19:35:34.209050 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:34.209011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:34.209483 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:34.209175 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:35:34.209483 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:34.209247 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert podName:4818e1a6-8504-4b15-82e1-9afcc0533aae nodeName:}" failed. No retries permitted until 2026-07-01 19:35:38.209226387 +0000 UTC m=+48.479211058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-qzbps" (UID: "4818e1a6-8504-4b15-82e1-9afcc0533aae") : secret "networking-console-plugin-cert" not found Jul 01 19:35:37.135122 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.135074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:37.135633 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.135250 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:35:37.135633 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.135335 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls podName:f262857e-88cd-438c-9884-da39c9ab2dc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.135314587 +0000 UTC m=+55.405299272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-psm22" (UID: "f262857e-88cd-438c-9884-da39c9ab2dc4") : secret "samples-operator-tls" not found Jul 01 19:35:37.236271 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.236223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:37.236466 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.236426 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:37.236549 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.236516 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls podName:3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.236492969 +0000 UTC m=+55.506477648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-7ndg4" (UID: "3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:37.337274 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.337236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:37.337274 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.337283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:37.337509 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.337436 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.337412766 +0000 UTC m=+55.607397439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : configmap references non-existent config key: service-ca.crt Jul 01 19:35:37.337509 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.337451 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:35:37.337509 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.337493 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.33748217 +0000 UTC m=+55.607466842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : secret "router-metrics-certs-default" not found Jul 01 19:35:37.425714 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.425680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/0.log" Jul 01 19:35:37.425905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.425733 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f83142e-57df-4a86-ab83-16aab214cba1" containerID="02809e2be6f3c5910a1a23e67c1dd110aa6ee2fc39acc6663b7b8e2b1270c44c" exitCode=255 Jul 01 19:35:37.425905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.425828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" event={"ID":"0f83142e-57df-4a86-ab83-16aab214cba1","Type":"ContainerDied","Data":"02809e2be6f3c5910a1a23e67c1dd110aa6ee2fc39acc6663b7b8e2b1270c44c"} Jul 01 19:35:37.426101 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.426085 2563 scope.go:117] "RemoveContainer" containerID="02809e2be6f3c5910a1a23e67c1dd110aa6ee2fc39acc6663b7b8e2b1270c44c" Jul 01 19:35:37.428166 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.428140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" event={"ID":"5e9dc957-b331-4959-b98b-72fd2150b1ea","Type":"ContainerStarted","Data":"ae209c226cf018c2de81ec49f089da1a6a8e79a2d0a4d16c44e2967b854d755a"} Jul 01 19:35:37.430574 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.430548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" event={"ID":"e7ed238b-41a1-4f79-b2b8-621453417915","Type":"ContainerStarted","Data":"56c090779699f2e7459ad15d3b479c556cf846f79129253aeb68200d023d8cd7"} Jul 01 19:35:37.432256 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.432225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" event={"ID":"39c8ff20-44a0-4999-8b14-449cfd0cc093","Type":"ContainerStarted","Data":"dfba03a7c9154fbca98ad045c9cb5c0dcc75be89f64236d892957b8c2640bf47"} Jul 01 19:35:37.434350 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.434325 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" event={"ID":"b8be953a-f47d-463b-a05e-eeaa5be99346","Type":"ContainerStarted","Data":"af0b78c5d2bc941e9bf0939827f26edab6ab6b53a0afb1f4efab5b1d9aa48327"} Jul 01 19:35:37.436370 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.436348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" event={"ID":"30672345-743c-4dab-8d4d-b17ad77892f7","Type":"ContainerStarted","Data":"faaf95b4ab1a1ccbbbd92634e90f8b4161d21fc1ae43df622e5e94a6cf7c79d7"} Jul 01 19:35:37.469743 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.469683 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" podStartSLOduration=2.288234106 podStartE2EDuration="8.469662654s" totalImagesPullingTime="6.181428548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:37.469058728 +0000 UTC m=+47.739043420" watchObservedRunningTime="2026-07-01 19:35:37.469662654 +0000 UTC m=+47.739647345" Jul 01 19:35:37.535612 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.535564 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-qgm9j" podStartSLOduration=2.155713376 podStartE2EDuration="8.535543377s" totalImagesPullingTime="6.379830001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:37.534410528 +0000 UTC m=+47.804395214" watchObservedRunningTime="2026-07-01 19:35:37.535543377 +0000 UTC m=+47.805528069" Jul 01 19:35:37.536377 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.536334 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" podStartSLOduration=2.176417141 podStartE2EDuration="8.536323219s" totalImagesPullingTime="6.359906078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:37.505335806 +0000 UTC m=+47.775320497" watchObservedRunningTime="2026-07-01 19:35:37.536323219 +0000 UTC m=+47.806307909" Jul 01 19:35:37.555470 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.555408 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-nj5ss" podStartSLOduration=2.178342027 podStartE2EDuration="8.555385921s" totalImagesPullingTime="6.377043894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:37.555074846 +0000 UTC m=+47.825059561" watchObservedRunningTime="2026-07-01 19:35:37.555385921 +0000 UTC m=+47.825370612" Jul 01 19:35:37.770087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.769965 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" podStartSLOduration=2.581952748 podStartE2EDuration="8.76994181s" totalImagesPullingTime="6.187989062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:37.574065861 +0000 UTC m=+47.844050553" watchObservedRunningTime="2026-07-01 19:35:37.76994181 +0000 UTC m=+48.039926501" Jul 01 19:35:37.771388 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.771365 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mm2t7"] Jul 01 19:35:37.786016 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.785982 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.789238 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.789215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdnb9\"" Jul 01 19:35:37.789453 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.789439 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:35:37.789884 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.789868 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:35:37.793194 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.793036 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mm2t7"] Jul 01 19:35:37.843760 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.843722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpvp5\" (UniqueName: \"kubernetes.io/projected/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-api-access-lpvp5\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.843965 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.843811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-crio-socket\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.843965 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.843916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.844076 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.843964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.844076 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.844022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-data-volume\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945188 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpvp5\" (UniqueName: \"kubernetes.io/projected/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-api-access-lpvp5\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945395 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-crio-socket\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945395 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945395 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945395 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-data-volume\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945634 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-crio-socket\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.945634 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.945549 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:35:37.945634 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.945606 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:38.445586941 +0000 UTC m=+48.715571615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : secret "insights-runtime-extractor-tls" not found Jul 01 19:35:37.945634 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.945612 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:35:37.945870 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:37.945678 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:38.445660695 +0000 UTC m=+48.715645367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : configmap "kube-rbac-proxy" not found Jul 01 19:35:37.945870 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.945755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-data-volume\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:37.961233 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:37.961199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpvp5\" (UniqueName: \"kubernetes.io/projected/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-api-access-lpvp5\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:38.248464 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.248410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:38.248837 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.248603 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:35:38.248837 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.248686 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert podName:4818e1a6-8504-4b15-82e1-9afcc0533aae nodeName:}" failed. No retries permitted until 2026-07-01 19:35:46.248665424 +0000 UTC m=+56.518650094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-qzbps" (UID: "4818e1a6-8504-4b15-82e1-9afcc0533aae") : secret "networking-console-plugin-cert" not found Jul 01 19:35:38.441069 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.441042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/1.log" Jul 01 19:35:38.441448 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.441433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/0.log" Jul 01 19:35:38.441573 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.441470 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f83142e-57df-4a86-ab83-16aab214cba1" containerID="ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669" exitCode=255 Jul 01 19:35:38.441573 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.441542 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" event={"ID":"0f83142e-57df-4a86-ab83-16aab214cba1","Type":"ContainerDied","Data":"ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669"} Jul 01 19:35:38.441776 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.441591 2563 scope.go:117] "RemoveContainer" containerID="02809e2be6f3c5910a1a23e67c1dd110aa6ee2fc39acc6663b7b8e2b1270c44c" Jul 01 19:35:38.441898 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.441820 2563 scope.go:117] "RemoveContainer" containerID="ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669" Jul 01 19:35:38.442096 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.442069 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-pgw4w_openshift-console-operator(0f83142e-57df-4a86-ab83-16aab214cba1)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" Jul 01 19:35:38.450698 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.450666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:38.450831 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:38.450708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:38.450831 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.450805 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:35:38.450932 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.450807 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:35:38.450932 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.450880 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:39.45084275 +0000 UTC m=+49.720827418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : secret "insights-runtime-extractor-tls" not found Jul 01 19:35:38.451012 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:38.450974 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:39.450961104 +0000 UTC m=+49.720945771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : configmap "kube-rbac-proxy" not found Jul 01 19:35:39.347485 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.347455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fp5fb_258d8ce3-b66c-4974-bbe2-983e951cbb8b/dns-node-resolver/0.log" Jul 01 19:35:39.447821 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.447794 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/1.log" Jul 01 19:35:39.448174 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.448150 2563 scope.go:117] "RemoveContainer" containerID="ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669" Jul 01 19:35:39.448318 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:39.448300 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-pgw4w_openshift-console-operator(0f83142e-57df-4a86-ab83-16aab214cba1)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" Jul 01 19:35:39.460486 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.460456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:39.460613 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:39.460583 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:35:39.460648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.460610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:39.460723 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:39.460647 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:41.4606296 +0000 UTC m=+51.730614271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : configmap "kube-rbac-proxy" not found Jul 01 19:35:39.460723 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:39.460698 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:35:39.460792 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:39.460742 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:41.460731122 +0000 UTC m=+51.730715789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : secret "insights-runtime-extractor-tls" not found Jul 01 19:35:39.820445 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.820404 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:39.820609 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:39.820472 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:40.451389 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:40.451356 2563 scope.go:117] "RemoveContainer" containerID="ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669" Jul 01 19:35:40.451765 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:40.451524 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-pgw4w_openshift-console-operator(0f83142e-57df-4a86-ab83-16aab214cba1)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" Jul 01 19:35:40.551943 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:40.551913 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lphcd_da278ba8-5895-428d-80cb-a70a14546f9a/node-ca/0.log" Jul 01 19:35:40.947162 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:40.947131 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptjvk_ec602860-3dba-4d84-a58d-e392eb053e78/serve-healthcheck-canary/0.log" Jul 01 19:35:41.478268 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:41.478227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478359 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:41.478370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478422 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.478405021 +0000 UTC m=+55.748389709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : configmap "kube-rbac-proxy" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:41.478472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478479 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478492 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-954c97544-gnv5b: secret "image-registry-tls" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:41.478511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478528 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls podName:0098ba5d-f584-4dce-9238-046613b16eee nodeName:}" failed. No retries permitted until 2026-07-01 19:35:57.478516591 +0000 UTC m=+67.748501263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls") pod "image-registry-954c97544-gnv5b" (UID: "0098ba5d-f584-4dce-9238-046613b16eee") : secret "image-registry-tls" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478574 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478605 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478609 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:45.478598487 +0000 UTC m=+55.748583156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : secret "insights-runtime-extractor-tls" not found Jul 01 19:35:41.478696 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:41.478683 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls podName:287f889d-ee47-4ded-aeb7-8658f75ed31d nodeName:}" failed. No retries permitted until 2026-07-01 19:35:57.478669275 +0000 UTC m=+67.748653943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls") pod "dns-default-xcrmt" (UID: "287f889d-ee47-4ded-aeb7-8658f75ed31d") : secret "dns-default-metrics-tls" not found Jul 01 19:35:45.212774 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.212730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:35:45.213268 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.212880 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:35:45.213268 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.212934 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls podName:f262857e-88cd-438c-9884-da39c9ab2dc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:01.212918837 +0000 UTC m=+71.482903505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-psm22" (UID: "f262857e-88cd-438c-9884-da39c9ab2dc4") : secret "samples-operator-tls" not found Jul 01 19:35:45.313520 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.313479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:35:45.313685 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.313647 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:45.313723 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.313718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls podName:3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:01.313700811 +0000 UTC m=+71.583685479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-7ndg4" (UID: "3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:35:45.414151 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.414113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:45.414151 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.414165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:35:45.414378 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.414290 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:01.414272519 +0000 UTC m=+71.684257190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : configmap references non-existent config key: service-ca.crt Jul 01 19:35:45.414378 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.414334 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 19:35:45.414452 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.414385 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs podName:af70a0dd-0806-4d7c-a848-f54624ce5f30 nodeName:}" failed. No retries permitted until 2026-07-01 19:36:01.414373092 +0000 UTC m=+71.684357759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs") pod "router-default-5c4496dc6f-dsxlr" (UID: "af70a0dd-0806-4d7c-a848-f54624ce5f30") : secret "router-metrics-certs-default" not found Jul 01 19:35:45.515736 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.515642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:45.515736 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.515683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:45.515949 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.515809 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:35:45.515949 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:45.515899 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls podName:7e7f522e-5b27-42bc-bb66-b05fc3285ec7 nodeName:}" failed. No retries permitted until 2026-07-01 19:35:53.515881774 +0000 UTC m=+63.785866443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mm2t7" (UID: "7e7f522e-5b27-42bc-bb66-b05fc3285ec7") : secret "insights-runtime-extractor-tls" not found Jul 01 19:35:45.516208 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:45.516193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:46.323158 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:46.323116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:35:46.323547 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:46.323281 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:35:46.323547 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:46.323353 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert podName:4818e1a6-8504-4b15-82e1-9afcc0533aae nodeName:}" failed. No retries permitted until 2026-07-01 19:36:02.323334903 +0000 UTC m=+72.593319582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-qzbps" (UID: "4818e1a6-8504-4b15-82e1-9afcc0533aae") : secret "networking-console-plugin-cert" not found Jul 01 19:35:51.367128 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:51.367097 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2btc5" Jul 01 19:35:53.592173 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:53.592135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:53.594585 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:53.594566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e7f522e-5b27-42bc-bb66-b05fc3285ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm2t7\" (UID: \"7e7f522e-5b27-42bc-bb66-b05fc3285ec7\") " pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:53.699178 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:53.699147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdnb9\"" Jul 01 19:35:53.706404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:53.706385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mm2t7" Jul 01 19:35:53.839459 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:53.839418 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mm2t7"] Jul 01 19:35:53.841984 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:53.841962 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7f522e_5b27_42bc_bb66_b05fc3285ec7.slice/crio-f73563637f5571fcd55f80f906478cb9932eb9cb0860eecbc4a285978a0d9f05 WatchSource:0}: Error finding container f73563637f5571fcd55f80f906478cb9932eb9cb0860eecbc4a285978a0d9f05: Status 404 returned error can't find the container with id f73563637f5571fcd55f80f906478cb9932eb9cb0860eecbc4a285978a0d9f05 Jul 01 19:35:54.498347 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:54.498305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm2t7" event={"ID":"7e7f522e-5b27-42bc-bb66-b05fc3285ec7","Type":"ContainerStarted","Data":"f73563637f5571fcd55f80f906478cb9932eb9cb0860eecbc4a285978a0d9f05"} Jul 01 19:35:55.201217 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.201188 2563 scope.go:117] "RemoveContainer" containerID="ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669" Jul 01 19:35:55.504340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.504269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/1.log" Jul 01 19:35:55.504340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.504329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" event={"ID":"0f83142e-57df-4a86-ab83-16aab214cba1","Type":"ContainerStarted","Data":"155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496"} Jul 01 19:35:55.504615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.504594 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:55.506144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.506113 2563 patch_prober.go:28] interesting pod/console-operator-7fdbdf9c99-pgw4w container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 01 19:35:55.506248 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.506163 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 01 19:35:55.522144 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.522089 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podStartSLOduration=20.379003857 podStartE2EDuration="26.52207441s" totalImagesPullingTime="6.143070553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:55.520438228 +0000 UTC m=+65.790422930" watchObservedRunningTime="2026-07-01 19:35:55.52207441 +0000 UTC m=+65.792059098" Jul 01 19:35:55.916838 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.916786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:55.917066 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.916948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:55.919959 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.919928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:35:55.920131 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.919928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:35:55.931117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.931084 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1426157-278d-400e-b2fb-5bddea2931a5-metrics-certs\") pod \"network-metrics-daemon-9hnc7\" (UID: \"d1426157-278d-400e-b2fb-5bddea2931a5\") " pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:55.931117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:55.931111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/787908ec-fa30-4a1e-9780-422791191981-original-pull-secret\") pod \"global-pull-secret-syncer-m5f64\" (UID: \"787908ec-fa30-4a1e-9780-422791191981\") " pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:56.118802 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.118760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:56.121683 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.121659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvjr\" (UniqueName: \"kubernetes.io/projected/14c884cc-c67e-437f-80d9-5ca3eb6e09ea-kube-api-access-prvjr\") pod \"network-check-target-zs4qs\" (UID: \"14c884cc-c67e-437f-80d9-5ca3eb6e09ea\") " pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:56.213314 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.213222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m5f64" Jul 01 19:35:56.223482 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.223446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jdstn\"" Jul 01 19:35:56.229866 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.229829 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8z2\"" Jul 01 19:35:56.230861 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.230834 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:56.237845 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.237823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hnc7" Jul 01 19:35:56.508167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.508085 2563 patch_prober.go:28] interesting pod/console-operator-7fdbdf9c99-pgw4w container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 01 19:35:56.508167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:56.508131 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 01 19:35:57.514201 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.514174 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:35:57.514955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.514722 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/1.log" Jul 01 19:35:57.514955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.514764 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f83142e-57df-4a86-ab83-16aab214cba1" containerID="155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496" exitCode=255 Jul 01 19:35:57.514955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.514807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" event={"ID":"0f83142e-57df-4a86-ab83-16aab214cba1","Type":"ContainerDied","Data":"155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496"} Jul 01 19:35:57.514955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.514886 2563 scope.go:117] "RemoveContainer" containerID="ae38825cf248141fd74f275dbab6f562f3a5ee07fa2704a6a2a30251040ec669" Jul 01 19:35:57.515558 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.515354 2563 scope.go:117] "RemoveContainer" containerID="155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496" Jul 01 19:35:57.515705 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:57.515551 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-pgw4w_openshift-console-operator(0f83142e-57df-4a86-ab83-16aab214cba1)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" Jul 01 19:35:57.533404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.533351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:57.533556 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.533438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:57.536557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.536529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/287f889d-ee47-4ded-aeb7-8658f75ed31d-metrics-tls\") pod \"dns-default-xcrmt\" (UID: \"287f889d-ee47-4ded-aeb7-8658f75ed31d\") " pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:57.537086 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.537064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"image-registry-954c97544-gnv5b\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:57.546977 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.546898 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hnc7"] Jul 01 19:35:57.551416 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:57.551339 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1426157_278d_400e_b2fb_5bddea2931a5.slice/crio-1f8ea488738cdaf3d30ad60e1d3c22731d52617d025d77859572db1ff6c7a8dc WatchSource:0}: Error finding container 1f8ea488738cdaf3d30ad60e1d3c22731d52617d025d77859572db1ff6c7a8dc: Status 404 returned error can't find the container with id 1f8ea488738cdaf3d30ad60e1d3c22731d52617d025d77859572db1ff6c7a8dc Jul 01 19:35:57.567814 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.567351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zs4qs"] Jul 01 19:35:57.570012 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:57.569986 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c884cc_c67e_437f_80d9_5ca3eb6e09ea.slice/crio-d8cae28c35ccf68b8f2fa0f7d5a605c866f144c98e3ec58e86e19e50184ca15e WatchSource:0}: Error finding container d8cae28c35ccf68b8f2fa0f7d5a605c866f144c98e3ec58e86e19e50184ca15e: Status 404 returned error can't find the container with id d8cae28c35ccf68b8f2fa0f7d5a605c866f144c98e3ec58e86e19e50184ca15e Jul 01 19:35:57.707904 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.707806 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdmnz\"" Jul 01 19:35:57.715128 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.715108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:57.738707 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.738668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g9mcw\"" Jul 01 19:35:57.747054 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.747006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xcrmt" Jul 01 19:35:57.774072 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.771846 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m5f64"] Jul 01 19:35:57.777727 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:57.777697 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787908ec_fa30_4a1e_9780_422791191981.slice/crio-b2cf0662a2813ef755234cda0df1eb326087b583df8980fe6253331021b583d2 WatchSource:0}: Error finding container b2cf0662a2813ef755234cda0df1eb326087b583df8980fe6253331021b583d2: Status 404 returned error can't find the container with id b2cf0662a2813ef755234cda0df1eb326087b583df8980fe6253331021b583d2 Jul 01 19:35:57.861962 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.861893 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-954c97544-gnv5b"] Jul 01 19:35:57.866063 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:57.866034 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0098ba5d_f584_4dce_9238_046613b16eee.slice/crio-e49c299e4e9ddabe3ceda7fe637c7a34f3eb4c57d5cd4a5b2ce899ba5400c486 WatchSource:0}: Error finding container e49c299e4e9ddabe3ceda7fe637c7a34f3eb4c57d5cd4a5b2ce899ba5400c486: Status 404 returned error can't find the container with id e49c299e4e9ddabe3ceda7fe637c7a34f3eb4c57d5cd4a5b2ce899ba5400c486 Jul 01 19:35:57.888348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:57.888308 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xcrmt"] Jul 01 19:35:57.901814 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:35:57.901787 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287f889d_ee47_4ded_aeb7_8658f75ed31d.slice/crio-107ab1495494dd4b5aa6d96ed9c593acba3ebf5f145626a3493752974cef75bb WatchSource:0}: Error finding container 107ab1495494dd4b5aa6d96ed9c593acba3ebf5f145626a3493752974cef75bb: Status 404 returned error can't find the container with id 107ab1495494dd4b5aa6d96ed9c593acba3ebf5f145626a3493752974cef75bb Jul 01 19:35:58.520531 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.520411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hnc7" event={"ID":"d1426157-278d-400e-b2fb-5bddea2931a5","Type":"ContainerStarted","Data":"1f8ea488738cdaf3d30ad60e1d3c22731d52617d025d77859572db1ff6c7a8dc"} Jul 01 19:35:58.522628 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.522551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm2t7" event={"ID":"7e7f522e-5b27-42bc-bb66-b05fc3285ec7","Type":"ContainerStarted","Data":"6af5611776400d044f68616d3a3329393bb8a98035104f3a0516b4958ea8a770"} Jul 01 19:35:58.522628 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.522603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm2t7" event={"ID":"7e7f522e-5b27-42bc-bb66-b05fc3285ec7","Type":"ContainerStarted","Data":"71128b4ac162bc13475232d86bf1ae3f417af43086e8e86ba1a08057b1ef7b93"} Jul 01 19:35:58.523593 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.523568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xcrmt" event={"ID":"287f889d-ee47-4ded-aeb7-8658f75ed31d","Type":"ContainerStarted","Data":"107ab1495494dd4b5aa6d96ed9c593acba3ebf5f145626a3493752974cef75bb"} Jul 01 19:35:58.525973 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.525946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-954c97544-gnv5b" event={"ID":"0098ba5d-f584-4dce-9238-046613b16eee","Type":"ContainerStarted","Data":"622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041"} Jul 01 19:35:58.526087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.525985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-954c97544-gnv5b" event={"ID":"0098ba5d-f584-4dce-9238-046613b16eee","Type":"ContainerStarted","Data":"e49c299e4e9ddabe3ceda7fe637c7a34f3eb4c57d5cd4a5b2ce899ba5400c486"} Jul 01 19:35:58.526087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.526025 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:35:58.527414 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.527399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:35:58.528674 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.528645 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m5f64" event={"ID":"787908ec-fa30-4a1e-9780-422791191981","Type":"ContainerStarted","Data":"b2cf0662a2813ef755234cda0df1eb326087b583df8980fe6253331021b583d2"} Jul 01 19:35:58.530249 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.530223 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zs4qs" event={"ID":"14c884cc-c67e-437f-80d9-5ca3eb6e09ea","Type":"ContainerStarted","Data":"c4c3e14e2d5b0d39545e414e0289dac8b6864a9028f7feef5f75bdacfda768e3"} Jul 01 19:35:58.530337 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.530268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zs4qs" event={"ID":"14c884cc-c67e-437f-80d9-5ca3eb6e09ea","Type":"ContainerStarted","Data":"d8cae28c35ccf68b8f2fa0f7d5a605c866f144c98e3ec58e86e19e50184ca15e"} Jul 01 19:35:58.530401 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.530388 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:35:58.552554 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.552495 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-954c97544-gnv5b" podStartSLOduration=68.552471682 podStartE2EDuration="1m8.552471682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:58.551066098 +0000 UTC m=+68.821050801" watchObservedRunningTime="2026-07-01 19:35:58.552471682 +0000 UTC m=+68.822456375" Jul 01 19:35:58.568589 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:58.568533 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zs4qs" podStartSLOduration=68.568512375 podStartE2EDuration="1m8.568512375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:58.568038174 +0000 UTC m=+68.838022864" watchObservedRunningTime="2026-07-01 19:35:58.568512375 +0000 UTC m=+68.838497066" Jul 01 19:35:59.538460 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:59.538417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hnc7" event={"ID":"d1426157-278d-400e-b2fb-5bddea2931a5","Type":"ContainerStarted","Data":"9f0dbfb0b439eced8f8ca12eae36950402e97a82721038a78fdeb00078508074"} Jul 01 19:35:59.538972 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:59.538485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hnc7" event={"ID":"d1426157-278d-400e-b2fb-5bddea2931a5","Type":"ContainerStarted","Data":"7602934a03886ed600f7e0d2262c8d77522d4ca4f8dc7ef0bf220341c11b94d0"} Jul 01 19:35:59.569910 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:59.569830 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9hnc7" podStartSLOduration=68.008959743 podStartE2EDuration="1m9.569807661s" totalImagesPullingTime="1.560847918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:35:59.56784227 +0000 UTC m=+69.837826954" watchObservedRunningTime="2026-07-01 19:35:59.569807661 +0000 UTC m=+69.839792352" Jul 01 19:35:59.820466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:59.820424 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:35:59.820905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:35:59.820882 2563 scope.go:117] "RemoveContainer" containerID="155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496" Jul 01 19:35:59.821157 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:35:59.821124 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-pgw4w_openshift-console-operator(0f83142e-57df-4a86-ab83-16aab214cba1)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" Jul 01 19:36:01.269067 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.269029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:36:01.271754 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.271731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f262857e-88cd-438c-9884-da39c9ab2dc4-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-psm22\" (UID: \"f262857e-88cd-438c-9884-da39c9ab2dc4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:36:01.370463 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.369909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:36:01.373134 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.373105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-7ndg4\" (UID: \"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:36:01.423957 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.423919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v7mmn\"" Jul 01 19:36:01.430953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.430918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" Jul 01 19:36:01.471219 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.471181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:01.471399 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.471233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:01.471998 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.471944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af70a0dd-0806-4d7c-a848-f54624ce5f30-service-ca-bundle\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:01.474064 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.474042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af70a0dd-0806-4d7c-a848-f54624ce5f30-metrics-certs\") pod \"router-default-5c4496dc6f-dsxlr\" (UID: \"af70a0dd-0806-4d7c-a848-f54624ce5f30\") " pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:01.547201 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.547117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nvql2\"" Jul 01 19:36:01.554911 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.554880 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" Jul 01 19:36:01.662246 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.662215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-88sm8\"" Jul 01 19:36:01.669285 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:01.669257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:02.380169 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:02.380124 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:36:02.383002 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:02.382973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4818e1a6-8504-4b15-82e1-9afcc0533aae-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-qzbps\" (UID: \"4818e1a6-8504-4b15-82e1-9afcc0533aae\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:36:02.562169 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:02.562138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mq7w8\"" Jul 01 19:36:02.570483 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:02.570462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" Jul 01 19:36:03.530974 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.530701 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c4496dc6f-dsxlr"] Jul 01 19:36:03.551977 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.551534 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22"] Jul 01 19:36:03.570154 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.570124 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm2t7" event={"ID":"7e7f522e-5b27-42bc-bb66-b05fc3285ec7","Type":"ContainerStarted","Data":"8cd1a1aa5f6dd612dc92699c5131b6a6f5506c2eb1cf1240ed859169d992d828"} Jul 01 19:36:03.574324 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.574210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xcrmt" event={"ID":"287f889d-ee47-4ded-aeb7-8658f75ed31d","Type":"ContainerStarted","Data":"553a9d35051a180ad9fb11eec58645545d3c50fd3decaeefcd11387b013c9838"} Jul 01 19:36:03.581124 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.579640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps"] Jul 01 19:36:03.581124 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.580655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m5f64" event={"ID":"787908ec-fa30-4a1e-9780-422791191981","Type":"ContainerStarted","Data":"332addb46269e34f134400bc57bd668aa91ad84294907e61e43ea5583ffe12cb"} Jul 01 19:36:03.583401 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.583349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" event={"ID":"af70a0dd-0806-4d7c-a848-f54624ce5f30","Type":"ContainerStarted","Data":"b552233557118fab70cba3f3bf2db320307c91935f314db30d24d0c5b04b20ce"} Jul 01 19:36:03.608677 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.608612 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mm2t7" podStartSLOduration=17.331973974 podStartE2EDuration="26.608591225s" totalImagesPullingTime="9.276617251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:35:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:03.608283795 +0000 UTC m=+73.878268486" watchObservedRunningTime="2026-07-01 19:36:03.608591225 +0000 UTC m=+73.878575913" Jul 01 19:36:03.649525 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.649469 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m5f64" podStartSLOduration=68.126096112 podStartE2EDuration="1m13.649445743s" totalImagesPullingTime="5.523349631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:03.646472386 +0000 UTC m=+73.916457076" watchObservedRunningTime="2026-07-01 19:36:03.649445743 +0000 UTC m=+73.919430414" Jul 01 19:36:03.740524 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:03.740480 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4"] Jul 01 19:36:03.745562 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:36:03.745535 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7f1f36_5ade_41e8_aa35_f0a1c17b33d8.slice/crio-34d79acecbfc8257c2f7764beeab7bf1add4f5895c6c0dad63ebcb14a0cd8b71 WatchSource:0}: Error finding container 34d79acecbfc8257c2f7764beeab7bf1add4f5895c6c0dad63ebcb14a0cd8b71: Status 404 returned error can't find the container with id 34d79acecbfc8257c2f7764beeab7bf1add4f5895c6c0dad63ebcb14a0cd8b71 Jul 01 19:36:04.590527 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.590484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xcrmt" event={"ID":"287f889d-ee47-4ded-aeb7-8658f75ed31d","Type":"ContainerStarted","Data":"3d041fc02f009189cf671850391cea0e4d3a7130bf9b6bb6d775416e43a8c42e"} Jul 01 19:36:04.591020 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.590936 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xcrmt" Jul 01 19:36:04.592417 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.592364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" event={"ID":"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8","Type":"ContainerStarted","Data":"34d79acecbfc8257c2f7764beeab7bf1add4f5895c6c0dad63ebcb14a0cd8b71"} Jul 01 19:36:04.593679 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.593604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" event={"ID":"f262857e-88cd-438c-9884-da39c9ab2dc4","Type":"ContainerStarted","Data":"fe525a21677f7466466a8c84a007af0a6f7536998f5c26668edf935bf2571db3"} Jul 01 19:36:04.596072 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.596049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" event={"ID":"af70a0dd-0806-4d7c-a848-f54624ce5f30","Type":"ContainerStarted","Data":"869b1f49562ed92ba6fd9ff19d7f25f7ef7cf402da846e26d7f48063b08e8bd6"} Jul 01 19:36:04.600099 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.600074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" event={"ID":"4818e1a6-8504-4b15-82e1-9afcc0533aae","Type":"ContainerStarted","Data":"8fb8c1f299470d50a918196675a0b0b2e5512b18185c55e8f8e1fd7e907d26e4"} Jul 01 19:36:04.615795 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.615121 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xcrmt" podStartSLOduration=34.231890111 podStartE2EDuration="39.615100453s" totalImagesPullingTime="5.383210342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:04.614287854 +0000 UTC m=+74.884272544" watchObservedRunningTime="2026-07-01 19:36:04.615100453 +0000 UTC m=+74.885085145" Jul 01 19:36:04.641257 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.640967 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" podStartSLOduration=35.640947064 podStartE2EDuration="35.640947064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:04.638981678 +0000 UTC m=+74.908966369" watchObservedRunningTime="2026-07-01 19:36:04.640947064 +0000 UTC m=+74.910931753" Jul 01 19:36:04.670311 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.670227 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:04.673694 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:04.673484 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:05.606160 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:05.606121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" event={"ID":"4818e1a6-8504-4b15-82e1-9afcc0533aae","Type":"ContainerStarted","Data":"16cfd8d45d4787df228947b280a7c43225f7867cdefe69da5290f083da63b955"} Jul 01 19:36:05.606611 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:05.606420 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:05.607710 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:05.607688 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c4496dc6f-dsxlr" Jul 01 19:36:05.623425 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:05.623365 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-qzbps" podStartSLOduration=34.434014563 podStartE2EDuration="35.623341379s" totalImagesPullingTime="1.189326816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:05.623151497 +0000 UTC m=+75.893136188" watchObservedRunningTime="2026-07-01 19:36:05.623341379 +0000 UTC m=+75.893326070" Jul 01 19:36:06.611818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:06.611772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" event={"ID":"3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8","Type":"ContainerStarted","Data":"7a9fe37c27cc786e9e8e9a7a797e7e4ca963988369cf0d826ff259e63cde4312"} Jul 01 19:36:06.614053 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:06.614021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" event={"ID":"f262857e-88cd-438c-9884-da39c9ab2dc4","Type":"ContainerStarted","Data":"c566b171618b2d7e0c294a0b76a62320de3168a03f4cacdc282c8db2b9f8f447"} Jul 01 19:36:06.614200 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:06.614076 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" event={"ID":"f262857e-88cd-438c-9884-da39c9ab2dc4","Type":"ContainerStarted","Data":"6406748f4bc83eda2be8011c4c86753a523f13a180f81ff381161bb81c4e3d31"} Jul 01 19:36:06.630731 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:06.630667 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-7ndg4" podStartSLOduration=35.456950787 podStartE2EDuration="37.630647913s" totalImagesPullingTime="2.173697126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:06.629966468 +0000 UTC m=+76.899951160" watchObservedRunningTime="2026-07-01 19:36:06.630647913 +0000 UTC m=+76.900632605" Jul 01 19:36:06.664447 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:06.664386 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-psm22" podStartSLOduration=35.366187825 podStartE2EDuration="37.664362844s" totalImagesPullingTime="2.298175019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:06.663673922 +0000 UTC m=+76.933658615" watchObservedRunningTime="2026-07-01 19:36:06.664362844 +0000 UTC m=+76.934347537" Jul 01 19:36:14.200892 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:14.200723 2563 scope.go:117] "RemoveContainer" containerID="155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496" Jul 01 19:36:14.201442 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:36:14.200931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-pgw4w_openshift-console-operator(0f83142e-57df-4a86-ab83-16aab214cba1)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" podUID="0f83142e-57df-4a86-ab83-16aab214cba1" Jul 01 19:36:14.608777 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:14.608699 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xcrmt" Jul 01 19:36:17.252905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.252871 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5dgbf"] Jul 01 19:36:17.256419 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.256399 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.261010 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.260978 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dzlzj\"" Jul 01 19:36:17.264994 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.264971 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:36:17.265104 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.265016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:36:17.265104 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.265058 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:36:17.265212 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.265130 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:36:17.294466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tttbw\" (UniqueName: \"kubernetes.io/projected/e9677d0d-bb55-4ceb-96ff-17208ecd906e-kube-api-access-tttbw\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294577 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294577 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-textfile\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294660 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9677d0d-bb55-4ceb-96ff-17208ecd906e-metrics-client-ca\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294706 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-root\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294706 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294804 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-wtmp\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294804 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294794 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-sys\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.294936 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.294836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-tls\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396077 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9677d0d-bb55-4ceb-96ff-17208ecd906e-metrics-client-ca\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-root\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-wtmp\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-sys\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-tls\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-root\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tttbw\" (UniqueName: \"kubernetes.io/projected/e9677d0d-bb55-4ceb-96ff-17208ecd906e-kube-api-access-tttbw\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396629 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-sys\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396629 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396629 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-textfile\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396629 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-wtmp\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396629 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-textfile\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396882 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396722 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9677d0d-bb55-4ceb-96ff-17208ecd906e-metrics-client-ca\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.396882 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.396812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-accelerators-collector-config\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.398536 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.398516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.398729 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.398707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9677d0d-bb55-4ceb-96ff-17208ecd906e-node-exporter-tls\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.409970 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.409943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tttbw\" (UniqueName: \"kubernetes.io/projected/e9677d0d-bb55-4ceb-96ff-17208ecd906e-kube-api-access-tttbw\") pod \"node-exporter-5dgbf\" (UID: \"e9677d0d-bb55-4ceb-96ff-17208ecd906e\") " pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.566458 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.566379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5dgbf" Jul 01 19:36:17.579633 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:36:17.579606 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9677d0d_bb55_4ceb_96ff_17208ecd906e.slice/crio-70cffe03b3819f4154e484f246c693c5b572e5e717dd0360afe9b57522cbabb1 WatchSource:0}: Error finding container 70cffe03b3819f4154e484f246c693c5b572e5e717dd0360afe9b57522cbabb1: Status 404 returned error can't find the container with id 70cffe03b3819f4154e484f246c693c5b572e5e717dd0360afe9b57522cbabb1 Jul 01 19:36:17.657282 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:17.657248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dgbf" event={"ID":"e9677d0d-bb55-4ceb-96ff-17208ecd906e","Type":"ContainerStarted","Data":"70cffe03b3819f4154e484f246c693c5b572e5e717dd0360afe9b57522cbabb1"} Jul 01 19:36:18.663459 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:18.663418 2563 generic.go:356] "Generic (PLEG): container finished" podID="e9677d0d-bb55-4ceb-96ff-17208ecd906e" containerID="c111b5e3d139da68a9b01fce8d8e38d6a0f74af20be68e64cfa7f8838c2323ec" exitCode=0 Jul 01 19:36:18.663886 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:18.663496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dgbf" event={"ID":"e9677d0d-bb55-4ceb-96ff-17208ecd906e","Type":"ContainerDied","Data":"c111b5e3d139da68a9b01fce8d8e38d6a0f74af20be68e64cfa7f8838c2323ec"} Jul 01 19:36:19.543360 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:19.543329 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:36:19.669454 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:19.669416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dgbf" event={"ID":"e9677d0d-bb55-4ceb-96ff-17208ecd906e","Type":"ContainerStarted","Data":"8546af6d6036df0a80355242c9c082510517df6f527421233eefda1249f8cfcf"} Jul 01 19:36:19.669822 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:19.669473 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5dgbf" event={"ID":"e9677d0d-bb55-4ceb-96ff-17208ecd906e","Type":"ContainerStarted","Data":"edf30e88164ecf01fb46222860121f527fc40ed5d4440066abd9dc1698624280"} Jul 01 19:36:19.692449 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:19.692402 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5dgbf" podStartSLOduration=1.776180234 podStartE2EDuration="2.69238652s" totalImagesPullingTime="838.405386ms" totalInitContainerRuntime="77.8009ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:19.691376558 +0000 UTC m=+89.961361294" watchObservedRunningTime="2026-07-01 19:36:19.69238652 +0000 UTC m=+89.962371209" Jul 01 19:36:23.378037 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:23.378004 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-954c97544-gnv5b"] Jul 01 19:36:27.201503 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.201475 2563 scope.go:117] "RemoveContainer" containerID="155cd3abb5954b95abb4dcec6c821c94bb73def3240870c35ef4e8aedb43f496" Jul 01 19:36:27.700276 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.700250 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:36:27.700476 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.700313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" event={"ID":"0f83142e-57df-4a86-ab83-16aab214cba1","Type":"ContainerStarted","Data":"865d34349e6b843c29e36eb845bbc71ccea5c9303cd8e9371605ca431ccbf8f6"} Jul 01 19:36:27.700575 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.700552 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:36:27.710707 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.710680 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-pgw4w" Jul 01 19:36:27.882644 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.882612 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-qfdnc"] Jul 01 19:36:27.917579 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.917541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-qfdnc"] Jul 01 19:36:27.917748 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.917668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:27.921060 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.921036 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8fmwq\"" Jul 01 19:36:27.921199 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.921036 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:36:27.921199 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.921098 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:36:27.981461 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:27.981380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthb8\" (UniqueName: \"kubernetes.io/projected/ddcc2406-704d-4b18-8253-c79affbe2752-kube-api-access-zthb8\") pod \"downloads-5499b6fb8f-qfdnc\" (UID: \"ddcc2406-704d-4b18-8253-c79affbe2752\") " pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:28.082413 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:28.082375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthb8\" (UniqueName: \"kubernetes.io/projected/ddcc2406-704d-4b18-8253-c79affbe2752-kube-api-access-zthb8\") pod \"downloads-5499b6fb8f-qfdnc\" (UID: \"ddcc2406-704d-4b18-8253-c79affbe2752\") " pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:28.094539 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:28.094512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthb8\" (UniqueName: \"kubernetes.io/projected/ddcc2406-704d-4b18-8253-c79affbe2752-kube-api-access-zthb8\") pod \"downloads-5499b6fb8f-qfdnc\" (UID: \"ddcc2406-704d-4b18-8253-c79affbe2752\") " pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:28.226817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:28.226774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:28.383773 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:28.383738 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-qfdnc"] Jul 01 19:36:28.386598 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:36:28.386569 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcc2406_704d_4b18_8253_c79affbe2752.slice/crio-f2313db9b2cc4196a656766861d6f5dbd997b3566e7d32741af1b4cd8552f504 WatchSource:0}: Error finding container f2313db9b2cc4196a656766861d6f5dbd997b3566e7d32741af1b4cd8552f504: Status 404 returned error can't find the container with id f2313db9b2cc4196a656766861d6f5dbd997b3566e7d32741af1b4cd8552f504 Jul 01 19:36:28.706028 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:28.705987 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-qfdnc" event={"ID":"ddcc2406-704d-4b18-8253-c79affbe2752","Type":"ContainerStarted","Data":"f2313db9b2cc4196a656766861d6f5dbd997b3566e7d32741af1b4cd8552f504"} Jul 01 19:36:29.541783 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:29.541746 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zs4qs" Jul 01 19:36:37.392391 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.392281 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77bb9c94c8-bnl5z"] Jul 01 19:36:37.478839 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.478776 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bb9c94c8-bnl5z"] Jul 01 19:36:37.479029 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.478928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.486274 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.486249 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:36:37.487763 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.487048 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:36:37.487763 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.487128 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:36:37.487763 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.487261 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hfgvk\"" Jul 01 19:36:37.487763 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.487350 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:36:37.487763 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.487395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:36:37.565261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.565225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcklq\" (UniqueName: \"kubernetes.io/projected/7536d999-bc71-4070-9012-55f79032d4a9-kube-api-access-bcklq\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.565447 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.565276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-serving-cert\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.565447 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.565296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-oauth-config\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.565447 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.565383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-service-ca\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.565447 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.565421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-oauth-serving-cert\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.565620 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.565473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-console-config\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.666741 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.666659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-oauth-serving-cert\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.666741 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.666712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-console-config\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.666990 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.666753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcklq\" (UniqueName: \"kubernetes.io/projected/7536d999-bc71-4070-9012-55f79032d4a9-kube-api-access-bcklq\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.666990 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.666770 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-serving-cert\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.666990 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.666785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-oauth-config\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.666990 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.666822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-service-ca\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.667432 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.667407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-oauth-serving-cert\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.667576 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.667549 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-console-config\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.667644 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.667571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-service-ca\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.669445 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.669422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-oauth-config\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.669538 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.669500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-serving-cert\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.676379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.676304 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcklq\" (UniqueName: \"kubernetes.io/projected/7536d999-bc71-4070-9012-55f79032d4a9-kube-api-access-bcklq\") pod \"console-77bb9c94c8-bnl5z\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.790495 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.790457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:37.972842 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:37.972813 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bb9c94c8-bnl5z"] Jul 01 19:36:37.975747 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:36:37.975718 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7536d999_bc71_4070_9012_55f79032d4a9.slice/crio-d7aa2583f9116ef420dd2519cff6886965212a7e05054e5456cc1f3cd54a02cc WatchSource:0}: Error finding container d7aa2583f9116ef420dd2519cff6886965212a7e05054e5456cc1f3cd54a02cc: Status 404 returned error can't find the container with id d7aa2583f9116ef420dd2519cff6886965212a7e05054e5456cc1f3cd54a02cc Jul 01 19:36:38.751589 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:38.751541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb9c94c8-bnl5z" event={"ID":"7536d999-bc71-4070-9012-55f79032d4a9","Type":"ContainerStarted","Data":"d7aa2583f9116ef420dd2519cff6886965212a7e05054e5456cc1f3cd54a02cc"} Jul 01 19:36:45.784183 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.784086 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-qfdnc" event={"ID":"ddcc2406-704d-4b18-8253-c79affbe2752","Type":"ContainerStarted","Data":"5a2ee48f2eb41e93225fa1551595eaed3d91232d77896b44c5e4b1bf87130c40"} Jul 01 19:36:45.784671 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.784275 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:45.788990 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.788966 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64866bb574-d7m6b"] Jul 01 19:36:45.792060 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.792036 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.795933 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.795904 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-qfdnc" Jul 01 19:36:45.799886 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.799839 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:36:45.813477 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.813442 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64866bb574-d7m6b"] Jul 01 19:36:45.818723 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.818660 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-qfdnc" podStartSLOduration=1.777528988 podStartE2EDuration="18.818638635s" totalImagesPullingTime="17.041109647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:45.816424109 +0000 UTC m=+116.086408799" watchObservedRunningTime="2026-07-01 19:36:45.818638635 +0000 UTC m=+116.088623325" Jul 01 19:36:45.938261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-oauth-config\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.938460 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqhpp\" (UniqueName: \"kubernetes.io/projected/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-kube-api-access-pqhpp\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.938460 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-config\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.938460 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-service-ca\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.938460 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-oauth-serving-cert\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.938653 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-trusted-ca-bundle\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:45.938653 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:45.938515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-serving-cert\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.039958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.039817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-serving-cert\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.039958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.039907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-oauth-config\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.039958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.039938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqhpp\" (UniqueName: \"kubernetes.io/projected/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-kube-api-access-pqhpp\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.040202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.039968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-config\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.040202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.040015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-service-ca\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.040202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.040043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-oauth-serving-cert\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.040202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.040115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-trusted-ca-bundle\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.041435 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.041247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-trusted-ca-bundle\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.042352 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.042320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-config\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.043430 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.043373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-service-ca\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.043430 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.043408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-oauth-serving-cert\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.044764 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.044735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-serving-cert\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.047884 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.047810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-oauth-config\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.054514 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.054482 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqhpp\" (UniqueName: \"kubernetes.io/projected/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-kube-api-access-pqhpp\") pod \"console-64866bb574-d7m6b\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.104340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.104040 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:46.297137 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.297059 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64866bb574-d7m6b"] Jul 01 19:36:46.301118 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:36:46.301074 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc8abc1_c59c_40f2_a4f2_5a21c43c9f67.slice/crio-7a7dad3007f21ceaecbd997ddbf79284f55593f77955068617f733817eb8924a WatchSource:0}: Error finding container 7a7dad3007f21ceaecbd997ddbf79284f55593f77955068617f733817eb8924a: Status 404 returned error can't find the container with id 7a7dad3007f21ceaecbd997ddbf79284f55593f77955068617f733817eb8924a Jul 01 19:36:46.790529 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:46.790458 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64866bb574-d7m6b" event={"ID":"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67","Type":"ContainerStarted","Data":"7a7dad3007f21ceaecbd997ddbf79284f55593f77955068617f733817eb8924a"} Jul 01 19:36:47.802525 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:47.802157 2563 generic.go:356] "Generic (PLEG): container finished" podID="39c8ff20-44a0-4999-8b14-449cfd0cc093" containerID="dfba03a7c9154fbca98ad045c9cb5c0dcc75be89f64236d892957b8c2640bf47" exitCode=0 Jul 01 19:36:47.802525 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:47.802313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" event={"ID":"39c8ff20-44a0-4999-8b14-449cfd0cc093","Type":"ContainerDied","Data":"dfba03a7c9154fbca98ad045c9cb5c0dcc75be89f64236d892957b8c2640bf47"} Jul 01 19:36:47.803086 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:47.802841 2563 scope.go:117] "RemoveContainer" containerID="dfba03a7c9154fbca98ad045c9cb5c0dcc75be89f64236d892957b8c2640bf47" Jul 01 19:36:48.402244 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:48.402030 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-954c97544-gnv5b" podUID="0098ba5d-f584-4dce-9238-046613b16eee" containerName="registry" containerID="cri-o://622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041" gracePeriod=30 Jul 01 19:36:49.587601 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.587558 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:36:49.673758 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.673718 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qffd4\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-kube-api-access-qffd4\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.673975 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.673787 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.673975 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.673824 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-installation-pull-secrets\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.673975 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.673865 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-trusted-ca\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.673975 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.673895 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-image-registry-private-configuration\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.673975 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.673944 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-registry-certificates\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.674270 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.674006 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098ba5d-f584-4dce-9238-046613b16eee-ca-trust-extracted\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.674270 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.674031 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-bound-sa-token\") pod \"0098ba5d-f584-4dce-9238-046613b16eee\" (UID: \"0098ba5d-f584-4dce-9238-046613b16eee\") " Jul 01 19:36:49.678895 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.676184 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:36:49.678895 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.676816 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:36:49.678895 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.678058 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:36:49.678895 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.678168 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:36:49.678895 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.678237 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:36:49.678895 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.678447 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-kube-api-access-qffd4" (OuterVolumeSpecName: "kube-api-access-qffd4") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "kube-api-access-qffd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:36:49.681357 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.681313 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:36:49.687162 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.687139 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0098ba5d-f584-4dce-9238-046613b16eee-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0098ba5d-f584-4dce-9238-046613b16eee" (UID: "0098ba5d-f584-4dce-9238-046613b16eee"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:36:49.774962 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.774921 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-registry-tls\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.774962 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.774960 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-installation-pull-secrets\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.775186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.774978 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-trusted-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.775186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.774989 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098ba5d-f584-4dce-9238-046613b16eee-image-registry-private-configuration\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.775186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.774999 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098ba5d-f584-4dce-9238-046613b16eee-registry-certificates\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.775186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.775007 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098ba5d-f584-4dce-9238-046613b16eee-ca-trust-extracted\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.775186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.775015 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-bound-sa-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.775186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.775024 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qffd4\" (UniqueName: \"kubernetes.io/projected/0098ba5d-f584-4dce-9238-046613b16eee-kube-api-access-qffd4\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:36:49.815865 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.815814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qn2gb" event={"ID":"39c8ff20-44a0-4999-8b14-449cfd0cc093","Type":"ContainerStarted","Data":"47e534f4eca9b5545f774c8e5a20230545bcfa0de2594ccbdfc310c97b0f985e"} Jul 01 19:36:49.817493 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.817457 2563 generic.go:356] "Generic (PLEG): container finished" podID="0098ba5d-f584-4dce-9238-046613b16eee" containerID="622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041" exitCode=0 Jul 01 19:36:49.817646 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.817504 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-954c97544-gnv5b" Jul 01 19:36:49.817646 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.817543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-954c97544-gnv5b" event={"ID":"0098ba5d-f584-4dce-9238-046613b16eee","Type":"ContainerDied","Data":"622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041"} Jul 01 19:36:49.817646 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.817593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-954c97544-gnv5b" event={"ID":"0098ba5d-f584-4dce-9238-046613b16eee","Type":"ContainerDied","Data":"e49c299e4e9ddabe3ceda7fe637c7a34f3eb4c57d5cd4a5b2ce899ba5400c486"} Jul 01 19:36:49.817646 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.817620 2563 scope.go:117] "RemoveContainer" containerID="622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041" Jul 01 19:36:49.902089 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.902061 2563 scope.go:117] "RemoveContainer" containerID="622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041" Jul 01 19:36:49.904485 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.904456 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-954c97544-gnv5b"] Jul 01 19:36:49.907209 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:36:49.907177 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041\": container with ID starting with 622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041 not found: ID does not exist" containerID="622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041" Jul 01 19:36:49.907404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.907354 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041"} err="failed to get container status \"622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041\": rpc error: code = NotFound desc = could not find container \"622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041\": container with ID starting with 622e510e4be49509f0f05dc640c53d28012af0b498694350796d5f5f2acb4041 not found: ID does not exist" Jul 01 19:36:49.914263 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.914234 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-954c97544-gnv5b"] Jul 01 19:36:49.953588 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.953500 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4496dc6f-dsxlr_af70a0dd-0806-4d7c-a848-f54624ce5f30/router/0.log" Jul 01 19:36:49.965684 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:49.965649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptjvk_ec602860-3dba-4d84-a58d-e392eb053e78/serve-healthcheck-canary/0.log" Jul 01 19:36:50.212360 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:50.211583 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0098ba5d-f584-4dce-9238-046613b16eee" path="/var/lib/kubelet/pods/0098ba5d-f584-4dce-9238-046613b16eee/volumes" Jul 01 19:36:50.824385 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:50.824341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb9c94c8-bnl5z" event={"ID":"7536d999-bc71-4070-9012-55f79032d4a9","Type":"ContainerStarted","Data":"7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22"} Jul 01 19:36:50.826139 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:50.826098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64866bb574-d7m6b" event={"ID":"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67","Type":"ContainerStarted","Data":"ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53"} Jul 01 19:36:50.844530 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:50.844476 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77bb9c94c8-bnl5z" podStartSLOduration=1.855033878 podStartE2EDuration="13.844457084s" totalImagesPullingTime="11.989423206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:50.843684219 +0000 UTC m=+121.113668911" watchObservedRunningTime="2026-07-01 19:36:50.844457084 +0000 UTC m=+121.114441774" Jul 01 19:36:50.864482 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:50.864410 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64866bb574-d7m6b" podStartSLOduration=2.192922789 podStartE2EDuration="5.864390145s" totalImagesPullingTime="3.671467356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:50.863960743 +0000 UTC m=+121.133945435" watchObservedRunningTime="2026-07-01 19:36:50.864390145 +0000 UTC m=+121.134374836" Jul 01 19:36:54.540249 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:54.540193 2563 patch_prober.go:28] interesting pod/image-registry-954c97544-gnv5b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 01 19:36:54.540818 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:54.540302 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-954c97544-gnv5b" podUID="0098ba5d-f584-4dce-9238-046613b16eee" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 01 19:36:56.104488 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:56.104440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:56.104901 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:56.104550 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:56.109297 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:56.109272 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:56.853712 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:56.853683 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:36:56.904464 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:56.904433 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bb9c94c8-bnl5z"] Jul 01 19:36:57.790873 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.790772 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:36:57.854866 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.854829 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e9dc957-b331-4959-b98b-72fd2150b1ea" containerID="ae209c226cf018c2de81ec49f089da1a6a8e79a2d0a4d16c44e2967b854d755a" exitCode=0 Jul 01 19:36:57.855096 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.854905 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" event={"ID":"5e9dc957-b331-4959-b98b-72fd2150b1ea","Type":"ContainerDied","Data":"ae209c226cf018c2de81ec49f089da1a6a8e79a2d0a4d16c44e2967b854d755a"} Jul 01 19:36:57.855293 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.855276 2563 scope.go:117] "RemoveContainer" containerID="ae209c226cf018c2de81ec49f089da1a6a8e79a2d0a4d16c44e2967b854d755a" Jul 01 19:36:57.856775 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.856754 2563 generic.go:356] "Generic (PLEG): container finished" podID="e7ed238b-41a1-4f79-b2b8-621453417915" containerID="56c090779699f2e7459ad15d3b479c556cf846f79129253aeb68200d023d8cd7" exitCode=0 Jul 01 19:36:57.856887 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.856833 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" event={"ID":"e7ed238b-41a1-4f79-b2b8-621453417915","Type":"ContainerDied","Data":"56c090779699f2e7459ad15d3b479c556cf846f79129253aeb68200d023d8cd7"} Jul 01 19:36:57.857192 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:57.857178 2563 scope.go:117] "RemoveContainer" containerID="56c090779699f2e7459ad15d3b479c556cf846f79129253aeb68200d023d8cd7" Jul 01 19:36:58.862170 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:58.862129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-shvqr" event={"ID":"5e9dc957-b331-4959-b98b-72fd2150b1ea","Type":"ContainerStarted","Data":"429dae72f4290ddc74d8e7927c4dbaefb4c7001bc0b55ba6a7fc043f9f266d40"} Jul 01 19:36:58.863976 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:36:58.863950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-hztv5" event={"ID":"e7ed238b-41a1-4f79-b2b8-621453417915","Type":"ContainerStarted","Data":"9adf07e18175eefbeac4373a4a0f703e85859eabc9aa33cfa0fa232a82974f0a"} Jul 01 19:37:21.932708 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:21.932640 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77bb9c94c8-bnl5z" podUID="7536d999-bc71-4070-9012-55f79032d4a9" containerName="console" containerID="cri-o://7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22" gracePeriod=15 Jul 01 19:37:22.215122 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.215088 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:37:22.245747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.245714 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-service-ca\") pod \"7536d999-bc71-4070-9012-55f79032d4a9\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " Jul 01 19:37:22.245933 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.245755 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-serving-cert\") pod \"7536d999-bc71-4070-9012-55f79032d4a9\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " Jul 01 19:37:22.245933 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.245790 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-console-config\") pod \"7536d999-bc71-4070-9012-55f79032d4a9\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " Jul 01 19:37:22.245933 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.245840 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-oauth-serving-cert\") pod \"7536d999-bc71-4070-9012-55f79032d4a9\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " Jul 01 19:37:22.246096 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.245986 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-oauth-config\") pod \"7536d999-bc71-4070-9012-55f79032d4a9\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " Jul 01 19:37:22.246096 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246037 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcklq\" (UniqueName: \"kubernetes.io/projected/7536d999-bc71-4070-9012-55f79032d4a9-kube-api-access-bcklq\") pod \"7536d999-bc71-4070-9012-55f79032d4a9\" (UID: \"7536d999-bc71-4070-9012-55f79032d4a9\") " Jul 01 19:37:22.246198 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246183 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "7536d999-bc71-4070-9012-55f79032d4a9" (UID: "7536d999-bc71-4070-9012-55f79032d4a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:22.246270 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246250 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7536d999-bc71-4070-9012-55f79032d4a9" (UID: "7536d999-bc71-4070-9012-55f79032d4a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:22.246329 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246263 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-console-config" (OuterVolumeSpecName: "console-config") pod "7536d999-bc71-4070-9012-55f79032d4a9" (UID: "7536d999-bc71-4070-9012-55f79032d4a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:22.246413 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246388 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:37:22.246550 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246412 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-console-config\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:37:22.246550 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.246426 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7536d999-bc71-4070-9012-55f79032d4a9-oauth-serving-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:37:22.248912 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.248875 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7536d999-bc71-4070-9012-55f79032d4a9" (UID: "7536d999-bc71-4070-9012-55f79032d4a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:22.249050 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.248990 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7536d999-bc71-4070-9012-55f79032d4a9" (UID: "7536d999-bc71-4070-9012-55f79032d4a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:22.249122 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.249052 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7536d999-bc71-4070-9012-55f79032d4a9-kube-api-access-bcklq" (OuterVolumeSpecName: "kube-api-access-bcklq") pod "7536d999-bc71-4070-9012-55f79032d4a9" (UID: "7536d999-bc71-4070-9012-55f79032d4a9"). InnerVolumeSpecName "kube-api-access-bcklq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:37:22.347483 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.347444 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-oauth-config\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:37:22.347483 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.347475 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcklq\" (UniqueName: \"kubernetes.io/projected/7536d999-bc71-4070-9012-55f79032d4a9-kube-api-access-bcklq\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:37:22.347483 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.347484 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7536d999-bc71-4070-9012-55f79032d4a9-console-serving-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:37:22.959431 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.959396 2563 generic.go:356] "Generic (PLEG): container finished" podID="7536d999-bc71-4070-9012-55f79032d4a9" containerID="7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22" exitCode=0 Jul 01 19:37:22.959917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.959441 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb9c94c8-bnl5z" Jul 01 19:37:22.959917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.959447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb9c94c8-bnl5z" event={"ID":"7536d999-bc71-4070-9012-55f79032d4a9","Type":"ContainerDied","Data":"7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22"} Jul 01 19:37:22.959917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.959497 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb9c94c8-bnl5z" event={"ID":"7536d999-bc71-4070-9012-55f79032d4a9","Type":"ContainerDied","Data":"d7aa2583f9116ef420dd2519cff6886965212a7e05054e5456cc1f3cd54a02cc"} Jul 01 19:37:22.959917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.959524 2563 scope.go:117] "RemoveContainer" containerID="7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22" Jul 01 19:37:22.968132 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.968116 2563 scope.go:117] "RemoveContainer" containerID="7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22" Jul 01 19:37:22.968371 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:37:22.968351 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22\": container with ID starting with 7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22 not found: ID does not exist" containerID="7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22" Jul 01 19:37:22.968420 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.968379 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22"} err="failed to get container status \"7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22\": rpc error: code = NotFound desc = could not find container \"7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22\": container with ID starting with 7f6611c6aa49b9b6a3d5cbccc104bce3136f6110a421f2d5a33aaddfce1ffe22 not found: ID does not exist" Jul 01 19:37:22.983027 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.983008 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bb9c94c8-bnl5z"] Jul 01 19:37:22.986823 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:22.986803 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77bb9c94c8-bnl5z"] Jul 01 19:37:24.205963 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:24.205928 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7536d999-bc71-4070-9012-55f79032d4a9" path="/var/lib/kubelet/pods/7536d999-bc71-4070-9012-55f79032d4a9/volumes" Jul 01 19:37:45.580564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.580473 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d86bb69f8-xq4cl"] Jul 01 19:37:45.581102 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.580949 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0098ba5d-f584-4dce-9238-046613b16eee" containerName="registry" Jul 01 19:37:45.581102 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.580970 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0098ba5d-f584-4dce-9238-046613b16eee" containerName="registry" Jul 01 19:37:45.581102 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.581014 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7536d999-bc71-4070-9012-55f79032d4a9" containerName="console" Jul 01 19:37:45.581102 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.581024 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7536d999-bc71-4070-9012-55f79032d4a9" containerName="console" Jul 01 19:37:45.581102 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.581100 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0098ba5d-f584-4dce-9238-046613b16eee" containerName="registry" Jul 01 19:37:45.581360 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.581114 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7536d999-bc71-4070-9012-55f79032d4a9" containerName="console" Jul 01 19:37:45.583242 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.583222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.598171 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.598144 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d86bb69f8-xq4cl"] Jul 01 19:37:45.628094 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-service-ca\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.628094 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-trusted-ca-bundle\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.628315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-console-config\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.628315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-serving-cert\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.628315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-oauth-config\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.628315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-oauth-serving-cert\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.628315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.628313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955hg\" (UniqueName: \"kubernetes.io/projected/0f231049-7791-4352-8b93-5d99b8d9a731-kube-api-access-955hg\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.729509 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.729466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-oauth-config\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.729711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.729568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-oauth-serving-cert\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.729711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.729592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955hg\" (UniqueName: \"kubernetes.io/projected/0f231049-7791-4352-8b93-5d99b8d9a731-kube-api-access-955hg\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.729711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.729630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-service-ca\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.729711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.729651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-trusted-ca-bundle\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.729711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.729670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-console-config\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.730147 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.730121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-serving-cert\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.730493 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.730469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-service-ca\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.730584 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.730516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-console-config\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.730690 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.730668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-oauth-serving-cert\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.730988 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.730964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-trusted-ca-bundle\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.732467 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.732441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-serving-cert\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.732467 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.732462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-oauth-config\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.739538 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.739513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-955hg\" (UniqueName: \"kubernetes.io/projected/0f231049-7791-4352-8b93-5d99b8d9a731-kube-api-access-955hg\") pod \"console-6d86bb69f8-xq4cl\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:45.893808 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:45.893773 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:46.039276 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:46.039250 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d86bb69f8-xq4cl"] Jul 01 19:37:46.041993 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:37:46.041967 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f231049_7791_4352_8b93_5d99b8d9a731.slice/crio-ad7b0d6ca37ae20002eda0396fd2463da7521371cc95696d30f23893ea38b748 WatchSource:0}: Error finding container ad7b0d6ca37ae20002eda0396fd2463da7521371cc95696d30f23893ea38b748: Status 404 returned error can't find the container with id ad7b0d6ca37ae20002eda0396fd2463da7521371cc95696d30f23893ea38b748 Jul 01 19:37:46.050500 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:46.050475 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d86bb69f8-xq4cl" event={"ID":"0f231049-7791-4352-8b93-5d99b8d9a731","Type":"ContainerStarted","Data":"ad7b0d6ca37ae20002eda0396fd2463da7521371cc95696d30f23893ea38b748"} Jul 01 19:37:47.055261 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:47.055221 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d86bb69f8-xq4cl" event={"ID":"0f231049-7791-4352-8b93-5d99b8d9a731","Type":"ContainerStarted","Data":"112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc"} Jul 01 19:37:47.085054 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:47.085001 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d86bb69f8-xq4cl" podStartSLOduration=2.084986615 podStartE2EDuration="2.084986615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:37:47.083504251 +0000 UTC m=+177.353488941" watchObservedRunningTime="2026-07-01 19:37:47.084986615 +0000 UTC m=+177.354971369" Jul 01 19:37:55.894283 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:55.894241 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:55.894918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:55.894316 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:55.899107 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:55.899088 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:56.092759 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:56.092731 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:37:56.141269 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:37:56.141233 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64866bb574-d7m6b"] Jul 01 19:38:21.169797 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.169732 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64866bb574-d7m6b" podUID="bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" containerName="console" containerID="cri-o://ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53" gracePeriod=15 Jul 01 19:38:21.416689 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.416658 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:38:21.514648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514546 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-trusted-ca-bundle\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.514648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514601 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-oauth-config\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.514648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514625 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqhpp\" (UniqueName: \"kubernetes.io/projected/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-kube-api-access-pqhpp\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.514648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514646 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-serving-cert\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.514984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514696 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-oauth-serving-cert\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.514984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514725 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-config\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.514984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.514754 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-service-ca\") pod \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\" (UID: \"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67\") " Jul 01 19:38:21.515191 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.515158 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:21.515321 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.515293 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:21.515379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.515309 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:21.515379 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.515323 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-config" (OuterVolumeSpecName: "console-config") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:21.517175 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.517148 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:38:21.517579 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.517555 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:38:21.517634 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.517555 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-kube-api-access-pqhpp" (OuterVolumeSpecName: "kube-api-access-pqhpp") pod "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" (UID: "bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67"). InnerVolumeSpecName "kube-api-access-pqhpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:38:21.616339 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616283 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-trusted-ca-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:21.616339 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616329 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-oauth-config\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:21.616339 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616341 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqhpp\" (UniqueName: \"kubernetes.io/projected/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-kube-api-access-pqhpp\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:21.616339 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616353 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-serving-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:21.616339 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616361 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-oauth-serving-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:21.616642 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616371 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-console-config\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:21.616642 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:21.616380 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:38:22.186310 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.186271 2563 generic.go:356] "Generic (PLEG): container finished" podID="bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" containerID="ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53" exitCode=0 Jul 01 19:38:22.186704 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.186319 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64866bb574-d7m6b" Jul 01 19:38:22.186704 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.186361 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64866bb574-d7m6b" event={"ID":"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67","Type":"ContainerDied","Data":"ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53"} Jul 01 19:38:22.186704 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.186415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64866bb574-d7m6b" event={"ID":"bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67","Type":"ContainerDied","Data":"7a7dad3007f21ceaecbd997ddbf79284f55593f77955068617f733817eb8924a"} Jul 01 19:38:22.186704 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.186436 2563 scope.go:117] "RemoveContainer" containerID="ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53" Jul 01 19:38:22.194785 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.194771 2563 scope.go:117] "RemoveContainer" containerID="ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53" Jul 01 19:38:22.195058 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:38:22.195037 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53\": container with ID starting with ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53 not found: ID does not exist" containerID="ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53" Jul 01 19:38:22.195150 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.195065 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53"} err="failed to get container status \"ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53\": rpc error: code = NotFound desc = could not find container \"ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53\": container with ID starting with ecb4e7a00e906e0bbd32a8bc73920eb6abee05c113acee27aa8521816ecefd53 not found: ID does not exist" Jul 01 19:38:22.209612 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.209587 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64866bb574-d7m6b"] Jul 01 19:38:22.215434 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:22.215412 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64866bb574-d7m6b"] Jul 01 19:38:24.204793 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:24.204758 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" path="/var/lib/kubelet/pods/bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67/volumes" Jul 01 19:38:55.199449 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.199418 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58bbd765cb-swhpt"] Jul 01 19:38:55.199881 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.199693 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" containerName="console" Jul 01 19:38:55.199881 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.199706 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" containerName="console" Jul 01 19:38:55.199881 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.199765 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfc8abc1-c59c-40f2-a4f2-5a21c43c9f67" containerName="console" Jul 01 19:38:55.202570 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.202547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.234911 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.234875 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bbd765cb-swhpt"] Jul 01 19:38:55.285531 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-trusted-ca-bundle\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.285531 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-oauth-config\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.285747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5z5f\" (UniqueName: \"kubernetes.io/projected/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-kube-api-access-d5z5f\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.285747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-serving-cert\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.285747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-config\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.285847 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-service-ca\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.285847 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.285790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-oauth-serving-cert\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387052 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-config\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387052 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-service-ca\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-oauth-serving-cert\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-trusted-ca-bundle\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-oauth-config\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5z5f\" (UniqueName: \"kubernetes.io/projected/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-kube-api-access-d5z5f\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387348 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-serving-cert\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.387958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.387926 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-config\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.388111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.388087 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-service-ca\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.388196 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.388175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-oauth-serving-cert\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.388520 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.388497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-trusted-ca-bundle\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.389682 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.389664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-oauth-config\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.389811 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.389791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-console-serving-cert\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.398652 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.398630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5z5f\" (UniqueName: \"kubernetes.io/projected/c6ff3499-bdc0-447f-95c9-2ed372be0b6d-kube-api-access-d5z5f\") pod \"console-58bbd765cb-swhpt\" (UID: \"c6ff3499-bdc0-447f-95c9-2ed372be0b6d\") " pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.512688 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.512597 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:38:55.653249 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:55.653221 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58bbd765cb-swhpt"] Jul 01 19:38:55.655731 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:38:55.655702 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ff3499_bdc0_447f_95c9_2ed372be0b6d.slice/crio-82d07b9a4984a0846af01b04349bc9ebde18921886beb27a95fb562a0e734295 WatchSource:0}: Error finding container 82d07b9a4984a0846af01b04349bc9ebde18921886beb27a95fb562a0e734295: Status 404 returned error can't find the container with id 82d07b9a4984a0846af01b04349bc9ebde18921886beb27a95fb562a0e734295 Jul 01 19:38:56.313800 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:56.313766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bbd765cb-swhpt" event={"ID":"c6ff3499-bdc0-447f-95c9-2ed372be0b6d","Type":"ContainerStarted","Data":"a806b38da5708505b26f807a63300406a3ecd49dabd35c37919b41860b260bf6"} Jul 01 19:38:56.314210 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:56.313813 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58bbd765cb-swhpt" event={"ID":"c6ff3499-bdc0-447f-95c9-2ed372be0b6d","Type":"ContainerStarted","Data":"82d07b9a4984a0846af01b04349bc9ebde18921886beb27a95fb562a0e734295"} Jul 01 19:38:56.335122 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:38:56.335070 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58bbd765cb-swhpt" podStartSLOduration=1.335050291 podStartE2EDuration="1.335050291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:38:56.333957204 +0000 UTC m=+246.603941897" watchObservedRunningTime="2026-07-01 19:38:56.335050291 +0000 UTC m=+246.605034981" Jul 01 19:39:05.513284 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:05.513230 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:39:05.513961 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:05.513315 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:39:05.518362 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:05.518335 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:39:06.354989 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:06.354959 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58bbd765cb-swhpt" Jul 01 19:39:06.407420 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:06.407390 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d86bb69f8-xq4cl"] Jul 01 19:39:31.430149 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.430106 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d86bb69f8-xq4cl" podUID="0f231049-7791-4352-8b93-5d99b8d9a731" containerName="console" containerID="cri-o://112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc" gracePeriod=15 Jul 01 19:39:31.677032 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.677009 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:39:31.762108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762008 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-console-config\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762058 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-service-ca\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762088 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-oauth-serving-cert\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762382 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762136 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-trusted-ca-bundle\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762382 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762169 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-955hg\" (UniqueName: \"kubernetes.io/projected/0f231049-7791-4352-8b93-5d99b8d9a731-kube-api-access-955hg\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762382 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762214 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-oauth-config\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762382 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762243 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-serving-cert\") pod \"0f231049-7791-4352-8b93-5d99b8d9a731\" (UID: \"0f231049-7791-4352-8b93-5d99b8d9a731\") " Jul 01 19:39:31.762538 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762515 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-console-config" (OuterVolumeSpecName: "console-config") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:39:31.762572 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762534 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:39:31.762572 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762520 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:39:31.762640 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.762611 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:39:31.764480 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.764452 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:39:31.764628 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.764608 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f231049-7791-4352-8b93-5d99b8d9a731-kube-api-access-955hg" (OuterVolumeSpecName: "kube-api-access-955hg") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "kube-api-access-955hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:39:31.764816 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.764797 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f231049-7791-4352-8b93-5d99b8d9a731" (UID: "0f231049-7791-4352-8b93-5d99b8d9a731"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:39:31.863390 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863354 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-trusted-ca-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:31.863390 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863384 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-955hg\" (UniqueName: \"kubernetes.io/projected/0f231049-7791-4352-8b93-5d99b8d9a731-kube-api-access-955hg\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:31.863390 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863394 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-oauth-config\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:31.863390 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863403 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f231049-7791-4352-8b93-5d99b8d9a731-console-serving-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:31.863650 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863413 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-console-config\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:31.863650 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863422 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:31.863650 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:31.863431 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f231049-7791-4352-8b93-5d99b8d9a731-oauth-serving-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:32.451161 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.451125 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f231049-7791-4352-8b93-5d99b8d9a731" containerID="112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc" exitCode=0 Jul 01 19:39:32.451570 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.451176 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d86bb69f8-xq4cl" Jul 01 19:39:32.451570 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.451208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d86bb69f8-xq4cl" event={"ID":"0f231049-7791-4352-8b93-5d99b8d9a731","Type":"ContainerDied","Data":"112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc"} Jul 01 19:39:32.451570 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.451261 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d86bb69f8-xq4cl" event={"ID":"0f231049-7791-4352-8b93-5d99b8d9a731","Type":"ContainerDied","Data":"ad7b0d6ca37ae20002eda0396fd2463da7521371cc95696d30f23893ea38b748"} Jul 01 19:39:32.451570 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.451283 2563 scope.go:117] "RemoveContainer" containerID="112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc" Jul 01 19:39:32.459459 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.459439 2563 scope.go:117] "RemoveContainer" containerID="112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc" Jul 01 19:39:32.459786 ip-10-0-128-74 kubenswrapper[2563]: E0701 19:39:32.459763 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc\": container with ID starting with 112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc not found: ID does not exist" containerID="112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc" Jul 01 19:39:32.459866 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.459807 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc"} err="failed to get container status \"112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc\": rpc error: code = NotFound desc = could not find container \"112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc\": container with ID starting with 112d2cda694e0419b4a12533331d72317755608e4fab24addbcf1de072ec88fc not found: ID does not exist" Jul 01 19:39:32.470872 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.470796 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d86bb69f8-xq4cl"] Jul 01 19:39:32.474402 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:32.474378 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d86bb69f8-xq4cl"] Jul 01 19:39:34.205109 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:34.205069 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f231049-7791-4352-8b93-5d99b8d9a731" path="/var/lib/kubelet/pods/0f231049-7791-4352-8b93-5d99b8d9a731/volumes" Jul 01 19:39:38.361613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.361579 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk"] Jul 01 19:39:38.362097 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.361843 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f231049-7791-4352-8b93-5d99b8d9a731" containerName="console" Jul 01 19:39:38.362097 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.361877 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f231049-7791-4352-8b93-5d99b8d9a731" containerName="console" Jul 01 19:39:38.362097 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.361940 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f231049-7791-4352-8b93-5d99b8d9a731" containerName="console" Jul 01 19:39:38.364908 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.364892 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.367399 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.367376 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:39:38.367489 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.367447 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc497\"" Jul 01 19:39:38.368391 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.368378 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:39:38.376452 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.376430 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk"] Jul 01 19:39:38.414927 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.414900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwn98\" (UniqueName: \"kubernetes.io/projected/7fd20596-541d-4bef-b865-930d7d5ea6eb-kube-api-access-wwn98\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.415215 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.414961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.415215 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.415055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.515559 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.515528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.515721 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.515571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.515721 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.515612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwn98\" (UniqueName: \"kubernetes.io/projected/7fd20596-541d-4bef-b865-930d7d5ea6eb-kube-api-access-wwn98\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.515991 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.515966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.516029 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.515993 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.525723 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.525693 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwn98\" (UniqueName: \"kubernetes.io/projected/7fd20596-541d-4bef-b865-930d7d5ea6eb-kube-api-access-wwn98\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.674012 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.673971 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:38.810829 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:38.810805 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk"] Jul 01 19:39:38.813673 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:39:38.813650 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd20596_541d_4bef_b865_930d7d5ea6eb.slice/crio-42ecfb423e639140fc1b86c0b141522460146a48bc55df08eacf06899b897022 WatchSource:0}: Error finding container 42ecfb423e639140fc1b86c0b141522460146a48bc55df08eacf06899b897022: Status 404 returned error can't find the container with id 42ecfb423e639140fc1b86c0b141522460146a48bc55df08eacf06899b897022 Jul 01 19:39:39.482362 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:39.482329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" event={"ID":"7fd20596-541d-4bef-b865-930d7d5ea6eb","Type":"ContainerStarted","Data":"42ecfb423e639140fc1b86c0b141522460146a48bc55df08eacf06899b897022"} Jul 01 19:39:47.515244 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:47.515208 2563 generic.go:356] "Generic (PLEG): container finished" podID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerID="ab45949f1f53df5bfbf04a9e98241b2c70c9d6c4ff1e7cd2a31d3ab317cb9124" exitCode=0 Jul 01 19:39:47.515616 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:47.515290 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" event={"ID":"7fd20596-541d-4bef-b865-930d7d5ea6eb","Type":"ContainerDied","Data":"ab45949f1f53df5bfbf04a9e98241b2c70c9d6c4ff1e7cd2a31d3ab317cb9124"} Jul 01 19:39:50.147496 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.147459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:39:50.147995 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.147556 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:39:50.158031 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.158007 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:39:50.158200 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.158067 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:39:50.161929 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.161908 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:39:50.531131 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.531045 2563 generic.go:356] "Generic (PLEG): container finished" podID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerID="4764f533d23d489ebc8016929b5197d03560a0cf39bc85bec6246bec7d15d8c5" exitCode=0 Jul 01 19:39:50.531131 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:50.531112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" event={"ID":"7fd20596-541d-4bef-b865-930d7d5ea6eb","Type":"ContainerDied","Data":"4764f533d23d489ebc8016929b5197d03560a0cf39bc85bec6246bec7d15d8c5"} Jul 01 19:39:58.566015 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:58.565971 2563 generic.go:356] "Generic (PLEG): container finished" podID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerID="764cc667495e3caff2b9a4102c2cc7d441180257ba65b7e7e0fe0b6154f97153" exitCode=0 Jul 01 19:39:58.566413 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:58.566014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" event={"ID":"7fd20596-541d-4bef-b865-930d7d5ea6eb","Type":"ContainerDied","Data":"764cc667495e3caff2b9a4102c2cc7d441180257ba65b7e7e0fe0b6154f97153"} Jul 01 19:39:59.700295 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.700272 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:39:59.795184 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.795151 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwn98\" (UniqueName: \"kubernetes.io/projected/7fd20596-541d-4bef-b865-930d7d5ea6eb-kube-api-access-wwn98\") pod \"7fd20596-541d-4bef-b865-930d7d5ea6eb\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " Jul 01 19:39:59.795353 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.795200 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-util\") pod \"7fd20596-541d-4bef-b865-930d7d5ea6eb\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " Jul 01 19:39:59.795353 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.795225 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-bundle\") pod \"7fd20596-541d-4bef-b865-930d7d5ea6eb\" (UID: \"7fd20596-541d-4bef-b865-930d7d5ea6eb\") " Jul 01 19:39:59.796126 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.796097 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-bundle" (OuterVolumeSpecName: "bundle") pod "7fd20596-541d-4bef-b865-930d7d5ea6eb" (UID: "7fd20596-541d-4bef-b865-930d7d5ea6eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:39:59.797499 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.797477 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd20596-541d-4bef-b865-930d7d5ea6eb-kube-api-access-wwn98" (OuterVolumeSpecName: "kube-api-access-wwn98") pod "7fd20596-541d-4bef-b865-930d7d5ea6eb" (UID: "7fd20596-541d-4bef-b865-930d7d5ea6eb"). InnerVolumeSpecName "kube-api-access-wwn98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:39:59.799771 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.799735 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-util" (OuterVolumeSpecName: "util") pod "7fd20596-541d-4bef-b865-930d7d5ea6eb" (UID: "7fd20596-541d-4bef-b865-930d7d5ea6eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:39:59.896815 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.896777 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwn98\" (UniqueName: \"kubernetes.io/projected/7fd20596-541d-4bef-b865-930d7d5ea6eb-kube-api-access-wwn98\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:59.896815 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.896814 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:39:59.896815 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:39:59.896824 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fd20596-541d-4bef-b865-930d7d5ea6eb-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:00.575300 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:00.575216 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" event={"ID":"7fd20596-541d-4bef-b865-930d7d5ea6eb","Type":"ContainerDied","Data":"42ecfb423e639140fc1b86c0b141522460146a48bc55df08eacf06899b897022"} Jul 01 19:40:00.575300 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:00.575293 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42ecfb423e639140fc1b86c0b141522460146a48bc55df08eacf06899b897022" Jul 01 19:40:00.575300 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:00.575228 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd9xtk" Jul 01 19:40:06.691942 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.691910 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5"] Jul 01 19:40:06.692307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692201 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="extract" Jul 01 19:40:06.692307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692214 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="extract" Jul 01 19:40:06.692307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692235 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="pull" Jul 01 19:40:06.692307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692240 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="pull" Jul 01 19:40:06.692307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692248 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="util" Jul 01 19:40:06.692307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692253 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="util" Jul 01 19:40:06.692626 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.692321 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd20596-541d-4bef-b865-930d7d5ea6eb" containerName="extract" Jul 01 19:40:06.741908 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.741839 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5"] Jul 01 19:40:06.742082 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.741962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:06.745173 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.745142 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:40:06.745317 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.745199 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 19:40:06.745317 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.745199 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zlz2x\"" Jul 01 19:40:06.854204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.854163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-965p5\" (UID: \"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:06.854386 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.854218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhvcp\" (UniqueName: \"kubernetes.io/projected/7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2-kube-api-access-bhvcp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-965p5\" (UID: \"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:06.955111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.955026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-965p5\" (UID: \"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:06.955111 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.955075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhvcp\" (UniqueName: \"kubernetes.io/projected/7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2-kube-api-access-bhvcp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-965p5\" (UID: \"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:06.955415 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.955397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-965p5\" (UID: \"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:06.968578 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:06.968545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhvcp\" (UniqueName: \"kubernetes.io/projected/7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2-kube-api-access-bhvcp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-965p5\" (UID: \"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:07.051459 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:07.051416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" Jul 01 19:40:07.214364 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:07.214280 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5"] Jul 01 19:40:07.217562 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:40:07.217530 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9f94eb_c2e0_49b8_b9a5_860d2fd6b6d2.slice/crio-6ee87d6c1ea7925815b8093c37cb49c61aefba40e07a8c02dbd375fa779b06a7 WatchSource:0}: Error finding container 6ee87d6c1ea7925815b8093c37cb49c61aefba40e07a8c02dbd375fa779b06a7: Status 404 returned error can't find the container with id 6ee87d6c1ea7925815b8093c37cb49c61aefba40e07a8c02dbd375fa779b06a7 Jul 01 19:40:07.222383 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:07.220677 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:40:07.603918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:07.603817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" event={"ID":"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2","Type":"ContainerStarted","Data":"6ee87d6c1ea7925815b8093c37cb49c61aefba40e07a8c02dbd375fa779b06a7"} Jul 01 19:40:10.619563 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:10.619519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" event={"ID":"7a9f94eb-c2e0-49b8-b9a5-860d2fd6b6d2","Type":"ContainerStarted","Data":"6e4d259802e41e86fa9dcdbbb8b135fef65620f608cd0ce41368cbef5ffa1742"} Jul 01 19:40:10.650207 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:10.650145 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-965p5" podStartSLOduration=2.24140733 podStartE2EDuration="4.650128529s" totalImagesPullingTime="2.408721199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:40:10.647751793 +0000 UTC m=+320.917736486" watchObservedRunningTime="2026-07-01 19:40:10.650128529 +0000 UTC m=+320.920113219" Jul 01 19:40:11.345181 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.345144 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw"] Jul 01 19:40:11.347615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.347596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.350579 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.350551 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:40:11.350821 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.350803 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:40:11.351613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.351599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc497\"" Jul 01 19:40:11.368921 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.368894 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw"] Jul 01 19:40:11.488866 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.488824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.489070 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.488877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.489070 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.489009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkfp\" (UniqueName: \"kubernetes.io/projected/3bae6dd6-15a1-4c30-901d-f709f62275bd-kube-api-access-wdkfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.589639 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.589600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkfp\" (UniqueName: \"kubernetes.io/projected/3bae6dd6-15a1-4c30-901d-f709f62275bd-kube-api-access-wdkfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.589833 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.589663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.589833 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.589770 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.590090 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.590068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.590145 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.590094 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.604711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.604656 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkfp\" (UniqueName: \"kubernetes.io/projected/3bae6dd6-15a1-4c30-901d-f709f62275bd-kube-api-access-wdkfp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.656995 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.656956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:11.796571 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:11.796541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw"] Jul 01 19:40:11.799378 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:40:11.799347 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bae6dd6_15a1_4c30_901d_f709f62275bd.slice/crio-6f9f3a35152ffa2d912b0351fe6beee17c9b06d146019190d2739d53cd17196a WatchSource:0}: Error finding container 6f9f3a35152ffa2d912b0351fe6beee17c9b06d146019190d2739d53cd17196a: Status 404 returned error can't find the container with id 6f9f3a35152ffa2d912b0351fe6beee17c9b06d146019190d2739d53cd17196a Jul 01 19:40:12.630906 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:12.630845 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerID="f66fd84c7fc2d45742732186be6de33dea53a14f986c598960a67139e72b6772" exitCode=0 Jul 01 19:40:12.631087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:12.630954 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" event={"ID":"3bae6dd6-15a1-4c30-901d-f709f62275bd","Type":"ContainerDied","Data":"f66fd84c7fc2d45742732186be6de33dea53a14f986c598960a67139e72b6772"} Jul 01 19:40:12.631087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:12.631000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" event={"ID":"3bae6dd6-15a1-4c30-901d-f709f62275bd","Type":"ContainerStarted","Data":"6f9f3a35152ffa2d912b0351fe6beee17c9b06d146019190d2739d53cd17196a"} Jul 01 19:40:15.934876 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:15.934827 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9"] Jul 01 19:40:15.937283 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:15.937262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:15.939985 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:15.939957 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-76k8x\"" Jul 01 19:40:15.940780 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:15.940752 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 19:40:15.940913 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:15.940752 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 19:40:15.950596 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:15.950571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9"] Jul 01 19:40:16.026424 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.026383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6eded4d-3675-48e1-8655-42a3829540e4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jhqn9\" (UID: \"c6eded4d-3675-48e1-8655-42a3829540e4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.026424 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.026424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcb7l\" (UniqueName: \"kubernetes.io/projected/c6eded4d-3675-48e1-8655-42a3829540e4-kube-api-access-zcb7l\") pod \"cert-manager-cainjector-5d99449ffd-jhqn9\" (UID: \"c6eded4d-3675-48e1-8655-42a3829540e4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.127431 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.127378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6eded4d-3675-48e1-8655-42a3829540e4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jhqn9\" (UID: \"c6eded4d-3675-48e1-8655-42a3829540e4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.127431 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.127430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcb7l\" (UniqueName: \"kubernetes.io/projected/c6eded4d-3675-48e1-8655-42a3829540e4-kube-api-access-zcb7l\") pod \"cert-manager-cainjector-5d99449ffd-jhqn9\" (UID: \"c6eded4d-3675-48e1-8655-42a3829540e4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.142537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.142507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6eded4d-3675-48e1-8655-42a3829540e4-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-jhqn9\" (UID: \"c6eded4d-3675-48e1-8655-42a3829540e4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.143307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.143284 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcb7l\" (UniqueName: \"kubernetes.io/projected/c6eded4d-3675-48e1-8655-42a3829540e4-kube-api-access-zcb7l\") pod \"cert-manager-cainjector-5d99449ffd-jhqn9\" (UID: \"c6eded4d-3675-48e1-8655-42a3829540e4\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.264769 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.264684 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" Jul 01 19:40:16.406217 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.406194 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9"] Jul 01 19:40:16.408278 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:40:16.408244 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6eded4d_3675_48e1_8655_42a3829540e4.slice/crio-687cdda285e6daa3964ccc2f34f9b9f18c93c6add7a9568346dc3498569cf855 WatchSource:0}: Error finding container 687cdda285e6daa3964ccc2f34f9b9f18c93c6add7a9568346dc3498569cf855: Status 404 returned error can't find the container with id 687cdda285e6daa3964ccc2f34f9b9f18c93c6add7a9568346dc3498569cf855 Jul 01 19:40:16.650816 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:16.650781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" event={"ID":"c6eded4d-3675-48e1-8655-42a3829540e4","Type":"ContainerStarted","Data":"687cdda285e6daa3964ccc2f34f9b9f18c93c6add7a9568346dc3498569cf855"} Jul 01 19:40:20.670794 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:20.670754 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" event={"ID":"c6eded4d-3675-48e1-8655-42a3829540e4","Type":"ContainerStarted","Data":"7c0ee2d3b4f9dabb3a7850542206cff84cab913347b4b0db0a24a40524e16a4a"} Jul 01 19:40:20.691466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:20.691421 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-jhqn9" podStartSLOduration=2.251064509 podStartE2EDuration="5.691406389s" totalImagesPullingTime="3.44034188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:40:20.690099602 +0000 UTC m=+330.960084294" watchObservedRunningTime="2026-07-01 19:40:20.691406389 +0000 UTC m=+330.961391079" Jul 01 19:40:23.670013 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.669977 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-qc6b6"] Jul 01 19:40:23.672201 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.672183 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.674931 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.674907 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7vhhz\"" Jul 01 19:40:23.680338 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.680315 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-qc6b6"] Jul 01 19:40:23.792215 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.792174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c0bd1d8-b9ff-407b-bdcb-041992cbdb06-bound-sa-token\") pod \"cert-manager-59c77684cc-qc6b6\" (UID: \"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06\") " pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.792368 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.792228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdlq8\" (UniqueName: \"kubernetes.io/projected/6c0bd1d8-b9ff-407b-bdcb-041992cbdb06-kube-api-access-qdlq8\") pod \"cert-manager-59c77684cc-qc6b6\" (UID: \"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06\") " pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.893403 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.893367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c0bd1d8-b9ff-407b-bdcb-041992cbdb06-bound-sa-token\") pod \"cert-manager-59c77684cc-qc6b6\" (UID: \"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06\") " pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.893550 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.893428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdlq8\" (UniqueName: \"kubernetes.io/projected/6c0bd1d8-b9ff-407b-bdcb-041992cbdb06-kube-api-access-qdlq8\") pod \"cert-manager-59c77684cc-qc6b6\" (UID: \"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06\") " pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.902662 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.902633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c0bd1d8-b9ff-407b-bdcb-041992cbdb06-bound-sa-token\") pod \"cert-manager-59c77684cc-qc6b6\" (UID: \"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06\") " pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.902776 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.902633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdlq8\" (UniqueName: \"kubernetes.io/projected/6c0bd1d8-b9ff-407b-bdcb-041992cbdb06-kube-api-access-qdlq8\") pod \"cert-manager-59c77684cc-qc6b6\" (UID: \"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06\") " pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:23.982950 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:23.982869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-qc6b6" Jul 01 19:40:24.118748 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:24.118723 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-qc6b6"] Jul 01 19:40:24.120997 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:40:24.120960 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c0bd1d8_b9ff_407b_bdcb_041992cbdb06.slice/crio-bb2d81f6c3ae2dd486030def1c4677855395ed79f01b31faa2e79cd3b379df2d WatchSource:0}: Error finding container bb2d81f6c3ae2dd486030def1c4677855395ed79f01b31faa2e79cd3b379df2d: Status 404 returned error can't find the container with id bb2d81f6c3ae2dd486030def1c4677855395ed79f01b31faa2e79cd3b379df2d Jul 01 19:40:24.688612 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:24.688577 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-qc6b6" event={"ID":"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06","Type":"ContainerStarted","Data":"957a9c8003d91e8e4124f92f1c4b51439d7869796da1cd0b6d4e4910ba134f4c"} Jul 01 19:40:24.688612 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:24.688617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-qc6b6" event={"ID":"6c0bd1d8-b9ff-407b-bdcb-041992cbdb06","Type":"ContainerStarted","Data":"bb2d81f6c3ae2dd486030def1c4677855395ed79f01b31faa2e79cd3b379df2d"} Jul 01 19:40:24.709506 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:24.709456 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-qc6b6" podStartSLOduration=1.709441655 podStartE2EDuration="1.709441655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:40:24.708136401 +0000 UTC m=+334.978121109" watchObservedRunningTime="2026-07-01 19:40:24.709441655 +0000 UTC m=+334.979426345" Jul 01 19:40:29.712335 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:29.712295 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerID="728a5aa218e3956e285f668a812ba1a2350b0204b734ab33cd5a09fc2c594e56" exitCode=0 Jul 01 19:40:29.712835 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:29.712346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" event={"ID":"3bae6dd6-15a1-4c30-901d-f709f62275bd","Type":"ContainerDied","Data":"728a5aa218e3956e285f668a812ba1a2350b0204b734ab33cd5a09fc2c594e56"} Jul 01 19:40:30.718905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:30.718836 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerID="70198783e523354e039ca4864a17a448741fb38a0bc4d545d95fde384bfc666c" exitCode=0 Jul 01 19:40:30.719364 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:30.718906 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" event={"ID":"3bae6dd6-15a1-4c30-901d-f709f62275bd","Type":"ContainerDied","Data":"70198783e523354e039ca4864a17a448741fb38a0bc4d545d95fde384bfc666c"} Jul 01 19:40:31.853724 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.853695 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:31.958482 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.958436 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-util\") pod \"3bae6dd6-15a1-4c30-901d-f709f62275bd\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " Jul 01 19:40:31.958682 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.958492 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdkfp\" (UniqueName: \"kubernetes.io/projected/3bae6dd6-15a1-4c30-901d-f709f62275bd-kube-api-access-wdkfp\") pod \"3bae6dd6-15a1-4c30-901d-f709f62275bd\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " Jul 01 19:40:31.958682 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.958535 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-bundle\") pod \"3bae6dd6-15a1-4c30-901d-f709f62275bd\" (UID: \"3bae6dd6-15a1-4c30-901d-f709f62275bd\") " Jul 01 19:40:31.959043 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.959013 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-bundle" (OuterVolumeSpecName: "bundle") pod "3bae6dd6-15a1-4c30-901d-f709f62275bd" (UID: "3bae6dd6-15a1-4c30-901d-f709f62275bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:40:31.960913 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.960825 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bae6dd6-15a1-4c30-901d-f709f62275bd-kube-api-access-wdkfp" (OuterVolumeSpecName: "kube-api-access-wdkfp") pod "3bae6dd6-15a1-4c30-901d-f709f62275bd" (UID: "3bae6dd6-15a1-4c30-901d-f709f62275bd"). InnerVolumeSpecName "kube-api-access-wdkfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:40:31.963436 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:31.963412 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-util" (OuterVolumeSpecName: "util") pod "3bae6dd6-15a1-4c30-901d-f709f62275bd" (UID: "3bae6dd6-15a1-4c30-901d-f709f62275bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:40:32.059940 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:32.059831 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:32.059940 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:32.059889 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdkfp\" (UniqueName: \"kubernetes.io/projected/3bae6dd6-15a1-4c30-901d-f709f62275bd-kube-api-access-wdkfp\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:32.059940 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:32.059903 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bae6dd6-15a1-4c30-901d-f709f62275bd-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:32.730162 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:32.730119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" event={"ID":"3bae6dd6-15a1-4c30-901d-f709f62275bd","Type":"ContainerDied","Data":"6f9f3a35152ffa2d912b0351fe6beee17c9b06d146019190d2739d53cd17196a"} Jul 01 19:40:32.730162 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:32.730154 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl9wvw" Jul 01 19:40:32.730365 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:32.730178 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f9f3a35152ffa2d912b0351fe6beee17c9b06d146019190d2739d53cd17196a" Jul 01 19:40:45.165877 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.165769 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr"] Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166109 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="extract" Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166123 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="extract" Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166136 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="pull" Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166141 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="pull" Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166154 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="util" Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166159 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="util" Jul 01 19:40:45.166327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.166212 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bae6dd6-15a1-4c30-901d-f709f62275bd" containerName="extract" Jul 01 19:40:45.170308 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.170289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.173985 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.173960 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:40:45.175098 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.175078 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:40:45.175155 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.175078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc497\"" Jul 01 19:40:45.180563 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.180542 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr"] Jul 01 19:40:45.241994 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.241954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss45m\" (UniqueName: \"kubernetes.io/projected/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-kube-api-access-ss45m\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.242202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.242019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.242202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.242075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.342690 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.342646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss45m\" (UniqueName: \"kubernetes.io/projected/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-kube-api-access-ss45m\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.342917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.342716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.342917 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.342738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.343117 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.343101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.343160 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.343146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.353170 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.353142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss45m\" (UniqueName: \"kubernetes.io/projected/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-kube-api-access-ss45m\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.479699 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.479619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:45.658188 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.658046 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr"] Jul 01 19:40:45.660786 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:40:45.660760 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d70d5a_d46a_4a41_853e_d00f7a2de4e7.slice/crio-8fc91f2e96dce8d01615c7273128e2b346adaf39b855d1ef0fdc3f87f8dd771f WatchSource:0}: Error finding container 8fc91f2e96dce8d01615c7273128e2b346adaf39b855d1ef0fdc3f87f8dd771f: Status 404 returned error can't find the container with id 8fc91f2e96dce8d01615c7273128e2b346adaf39b855d1ef0fdc3f87f8dd771f Jul 01 19:40:45.786405 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.786379 2563 generic.go:356] "Generic (PLEG): container finished" podID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerID="9050f8d644c122ec0002a4b6805755a5b59e7b0838c4f879742d9d3bdbafaaba" exitCode=0 Jul 01 19:40:45.786572 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.786433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" event={"ID":"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7","Type":"ContainerDied","Data":"9050f8d644c122ec0002a4b6805755a5b59e7b0838c4f879742d9d3bdbafaaba"} Jul 01 19:40:45.786572 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:45.786473 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" event={"ID":"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7","Type":"ContainerStarted","Data":"8fc91f2e96dce8d01615c7273128e2b346adaf39b855d1ef0fdc3f87f8dd771f"} Jul 01 19:40:46.792841 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:46.792807 2563 generic.go:356] "Generic (PLEG): container finished" podID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerID="131b129a502530d21acee4dd85489d9be63111af8690f0ba1fe7b5b34c1a119e" exitCode=0 Jul 01 19:40:46.793204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:46.792873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" event={"ID":"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7","Type":"ContainerDied","Data":"131b129a502530d21acee4dd85489d9be63111af8690f0ba1fe7b5b34c1a119e"} Jul 01 19:40:47.799475 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:47.799437 2563 generic.go:356] "Generic (PLEG): container finished" podID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerID="afd3956351b6c51f6f9671dea9b36de6e9b9e87b4215aa6bf7442f7b7779dcbf" exitCode=0 Jul 01 19:40:47.799887 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:47.799523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" event={"ID":"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7","Type":"ContainerDied","Data":"afd3956351b6c51f6f9671dea9b36de6e9b9e87b4215aa6bf7442f7b7779dcbf"} Jul 01 19:40:48.947030 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.946995 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:48.962544 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.962509 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-bundle\") pod \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " Jul 01 19:40:48.962721 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.962582 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-util\") pod \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " Jul 01 19:40:48.962721 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.962615 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss45m\" (UniqueName: \"kubernetes.io/projected/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-kube-api-access-ss45m\") pod \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\" (UID: \"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7\") " Jul 01 19:40:48.963328 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.963298 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-bundle" (OuterVolumeSpecName: "bundle") pod "c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" (UID: "c7d70d5a-d46a-4a41-853e-d00f7a2de4e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:40:48.964826 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.964806 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-kube-api-access-ss45m" (OuterVolumeSpecName: "kube-api-access-ss45m") pod "c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" (UID: "c7d70d5a-d46a-4a41-853e-d00f7a2de4e7"). InnerVolumeSpecName "kube-api-access-ss45m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:40:48.970955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:48.970930 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-util" (OuterVolumeSpecName: "util") pod "c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" (UID: "c7d70d5a-d46a-4a41-853e-d00f7a2de4e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:40:49.063370 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:49.063286 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:49.063370 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:49.063315 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss45m\" (UniqueName: \"kubernetes.io/projected/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-kube-api-access-ss45m\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:49.063370 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:49.063325 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d70d5a-d46a-4a41-853e-d00f7a2de4e7-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:40:49.810638 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:49.810605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" event={"ID":"c7d70d5a-d46a-4a41-853e-d00f7a2de4e7","Type":"ContainerDied","Data":"8fc91f2e96dce8d01615c7273128e2b346adaf39b855d1ef0fdc3f87f8dd771f"} Jul 01 19:40:49.810819 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:49.810648 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwv5hr" Jul 01 19:40:49.810819 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:49.810690 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fc91f2e96dce8d01615c7273128e2b346adaf39b855d1ef0fdc3f87f8dd771f" Jul 01 19:40:59.697137 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697101 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9"] Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697398 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="extract" Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697409 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="extract" Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697426 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="util" Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697431 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="util" Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697440 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="pull" Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697444 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="pull" Jul 01 19:40:59.697537 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.697491 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d70d5a-d46a-4a41-853e-d00f7a2de4e7" containerName="extract" Jul 01 19:40:59.700687 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.700665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.704078 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.704058 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 19:40:59.704200 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.704063 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 19:40:59.705509 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.705490 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:40:59.705615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.705510 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 19:40:59.705615 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.705510 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nh5xm\"" Jul 01 19:40:59.705991 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.705974 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 19:40:59.717244 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.717218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9"] Jul 01 19:40:59.740029 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.739997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9rs\" (UniqueName: \"kubernetes.io/projected/49acfc6c-e035-435b-9886-5b7805b30ec6-kube-api-access-fq9rs\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.740199 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.740037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/49acfc6c-e035-435b-9886-5b7805b30ec6-metrics-cert\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.740199 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.740066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49acfc6c-e035-435b-9886-5b7805b30ec6-cert\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.740199 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.740133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/49acfc6c-e035-435b-9886-5b7805b30ec6-manager-config\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.841017 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.840975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/49acfc6c-e035-435b-9886-5b7805b30ec6-manager-config\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.841181 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.841038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9rs\" (UniqueName: \"kubernetes.io/projected/49acfc6c-e035-435b-9886-5b7805b30ec6-kube-api-access-fq9rs\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.841181 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.841076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/49acfc6c-e035-435b-9886-5b7805b30ec6-metrics-cert\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.841181 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.841110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49acfc6c-e035-435b-9886-5b7805b30ec6-cert\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.841710 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.841680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/49acfc6c-e035-435b-9886-5b7805b30ec6-manager-config\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.843733 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.843711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49acfc6c-e035-435b-9886-5b7805b30ec6-cert\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.843935 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.843913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/49acfc6c-e035-435b-9886-5b7805b30ec6-metrics-cert\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.857067 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.857038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9rs\" (UniqueName: \"kubernetes.io/projected/49acfc6c-e035-435b-9886-5b7805b30ec6-kube-api-access-fq9rs\") pod \"lws-controller-manager-5b64dfc857-qmxs9\" (UID: \"49acfc6c-e035-435b-9886-5b7805b30ec6\") " pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:40:59.977147 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.977041 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7"] Jul 01 19:40:59.979952 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.979929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:40:59.989375 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.989352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 19:40:59.989910 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.989897 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 19:40:59.990447 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.990431 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pmcvj\"" Jul 01 19:40:59.992659 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.992646 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 19:40:59.992707 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:40:59.992670 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 19:41:00.009970 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.009949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:41:00.015648 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.015625 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7"] Jul 01 19:41:00.042945 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.042901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e38e6d6-1674-4955-8cf1-7bd27f99e565-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.043136 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.042957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e38e6d6-1674-4955-8cf1-7bd27f99e565-tmp\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.043136 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.043016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z78hv\" (UniqueName: \"kubernetes.io/projected/3e38e6d6-1674-4955-8cf1-7bd27f99e565-kube-api-access-z78hv\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.043136 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.043049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e38e6d6-1674-4955-8cf1-7bd27f99e565-manifests\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.043136 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.043068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e38e6d6-1674-4955-8cf1-7bd27f99e565-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.143684 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.143644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e38e6d6-1674-4955-8cf1-7bd27f99e565-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.143884 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.143697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e38e6d6-1674-4955-8cf1-7bd27f99e565-tmp\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.143884 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.143736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z78hv\" (UniqueName: \"kubernetes.io/projected/3e38e6d6-1674-4955-8cf1-7bd27f99e565-kube-api-access-z78hv\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.144021 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.143926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e38e6d6-1674-4955-8cf1-7bd27f99e565-manifests\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.144021 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.143972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e38e6d6-1674-4955-8cf1-7bd27f99e565-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.144304 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.144280 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e38e6d6-1674-4955-8cf1-7bd27f99e565-manifests\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.146152 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.146129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e38e6d6-1674-4955-8cf1-7bd27f99e565-tmp\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.146396 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.146379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e38e6d6-1674-4955-8cf1-7bd27f99e565-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.146438 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.146416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e38e6d6-1674-4955-8cf1-7bd27f99e565-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.159503 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.159466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z78hv\" (UniqueName: \"kubernetes.io/projected/3e38e6d6-1674-4955-8cf1-7bd27f99e565-kube-api-access-z78hv\") pod \"opendatahub-operator-controller-manager-54cdd86b5d-gb9s7\" (UID: \"3e38e6d6-1674-4955-8cf1-7bd27f99e565\") " pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.160100 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.160078 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9"] Jul 01 19:41:00.163792 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:41:00.163765 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49acfc6c_e035_435b_9886_5b7805b30ec6.slice/crio-a737e6b6e55e0324adce533019786d7ecbf936d5c837707f1483e3ed50f299cf WatchSource:0}: Error finding container a737e6b6e55e0324adce533019786d7ecbf936d5c837707f1483e3ed50f299cf: Status 404 returned error can't find the container with id a737e6b6e55e0324adce533019786d7ecbf936d5c837707f1483e3ed50f299cf Jul 01 19:41:00.289722 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.289635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:00.434485 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.434446 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7"] Jul 01 19:41:00.437984 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:41:00.437958 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e38e6d6_1674_4955_8cf1_7bd27f99e565.slice/crio-bd4f364bee12ae1f68d526c8194a790134e0d047ef4db998ed16818408203020 WatchSource:0}: Error finding container bd4f364bee12ae1f68d526c8194a790134e0d047ef4db998ed16818408203020: Status 404 returned error can't find the container with id bd4f364bee12ae1f68d526c8194a790134e0d047ef4db998ed16818408203020 Jul 01 19:41:00.860766 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.860726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" event={"ID":"49acfc6c-e035-435b-9886-5b7805b30ec6","Type":"ContainerStarted","Data":"a737e6b6e55e0324adce533019786d7ecbf936d5c837707f1483e3ed50f299cf"} Jul 01 19:41:00.861970 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:00.861943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" event={"ID":"3e38e6d6-1674-4955-8cf1-7bd27f99e565","Type":"ContainerStarted","Data":"bd4f364bee12ae1f68d526c8194a790134e0d047ef4db998ed16818408203020"} Jul 01 19:41:04.887659 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:04.887624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" event={"ID":"3e38e6d6-1674-4955-8cf1-7bd27f99e565","Type":"ContainerStarted","Data":"7015dc057c118b63b5b3cd6214bc86231be323b3bddc38271735a0a6cb15487e"} Jul 01 19:41:04.889463 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:04.889432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" event={"ID":"49acfc6c-e035-435b-9886-5b7805b30ec6","Type":"ContainerStarted","Data":"7e619c7c5d2c739b2f8cad1650737de08ee9d6d056c52b9201ae0c57a04fe7b3"} Jul 01 19:41:04.889591 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:04.889509 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:41:05.008618 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:05.008572 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" podStartSLOduration=2.349308965 podStartE2EDuration="6.008557018s" totalImagesPullingTime="3.659248053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:05.007212384 +0000 UTC m=+375.277197073" watchObservedRunningTime="2026-07-01 19:41:05.008557018 +0000 UTC m=+375.278541753" Jul 01 19:41:05.895660 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:05.895627 2563 generic.go:356] "Generic (PLEG): container finished" podID="3e38e6d6-1674-4955-8cf1-7bd27f99e565" containerID="7015dc057c118b63b5b3cd6214bc86231be323b3bddc38271735a0a6cb15487e" exitCode=0 Jul 01 19:41:05.896113 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:05.895719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" event={"ID":"3e38e6d6-1674-4955-8cf1-7bd27f99e565","Type":"ContainerDied","Data":"7015dc057c118b63b5b3cd6214bc86231be323b3bddc38271735a0a6cb15487e"} Jul 01 19:41:06.903142 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:06.903108 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" event={"ID":"3e38e6d6-1674-4955-8cf1-7bd27f99e565","Type":"ContainerStarted","Data":"2a50bc95a8cf5b94ea084606e95edac7ece653d0c1ca71d36b7a44e8dabc62d6"} Jul 01 19:41:06.903489 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:06.903238 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:06.931102 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:06.931036 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" podStartSLOduration=3.227823696 podStartE2EDuration="7.931015554s" totalImagesPullingTime="3.720505839s" totalInitContainerRuntime="982.686019ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:40:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:06.927909958 +0000 UTC m=+377.197894649" watchObservedRunningTime="2026-07-01 19:41:06.931015554 +0000 UTC m=+377.201000245" Jul 01 19:41:15.898070 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:15.898043 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b64dfc857-qmxs9" Jul 01 19:41:17.910726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:17.910697 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54cdd86b5d-gb9s7" Jul 01 19:41:29.216676 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.216636 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-54759b6cc8-nf9nq"] Jul 01 19:41:29.221219 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.221198 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.226775 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.226748 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 19:41:29.226955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.226785 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pzl2r\"" Jul 01 19:41:29.235630 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.235596 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-54759b6cc8-nf9nq"] Jul 01 19:41:29.286734 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.286700 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb-redirect-config\") pod \"dashboard-redirect-54759b6cc8-nf9nq\" (UID: \"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb\") " pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.286924 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.286775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ks84\" (UniqueName: \"kubernetes.io/projected/96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb-kube-api-access-9ks84\") pod \"dashboard-redirect-54759b6cc8-nf9nq\" (UID: \"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb\") " pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.387617 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.387577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb-redirect-config\") pod \"dashboard-redirect-54759b6cc8-nf9nq\" (UID: \"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb\") " pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.387774 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.387638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ks84\" (UniqueName: \"kubernetes.io/projected/96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb-kube-api-access-9ks84\") pod \"dashboard-redirect-54759b6cc8-nf9nq\" (UID: \"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb\") " pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.388361 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.388341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb-redirect-config\") pod \"dashboard-redirect-54759b6cc8-nf9nq\" (UID: \"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb\") " pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.399276 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.399256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ks84\" (UniqueName: \"kubernetes.io/projected/96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb-kube-api-access-9ks84\") pod \"dashboard-redirect-54759b6cc8-nf9nq\" (UID: \"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb\") " pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.531938 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.531781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" Jul 01 19:41:29.679212 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:29.679178 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-54759b6cc8-nf9nq"] Jul 01 19:41:29.682397 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:41:29.682362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ec9c8f_4a8e_48d0_bbcb_7606a362e2fb.slice/crio-7bdab163633bc0ec2d58ea55ba8b2fdd1e4bba7e56b09f18911421746e3a18fb WatchSource:0}: Error finding container 7bdab163633bc0ec2d58ea55ba8b2fdd1e4bba7e56b09f18911421746e3a18fb: Status 404 returned error can't find the container with id 7bdab163633bc0ec2d58ea55ba8b2fdd1e4bba7e56b09f18911421746e3a18fb Jul 01 19:41:30.013865 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:30.013809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" event={"ID":"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb","Type":"ContainerStarted","Data":"7bdab163633bc0ec2d58ea55ba8b2fdd1e4bba7e56b09f18911421746e3a18fb"} Jul 01 19:41:34.791340 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.791294 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj"] Jul 01 19:41:34.794644 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.794619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.807918 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.807891 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sf7wm\"" Jul 01 19:41:34.808343 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.808328 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 19:41:34.855787 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.855665 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj"] Jul 01 19:41:34.935968 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.935921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.935968 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.935972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936202 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936335 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936335 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e19faa8-fc50-4426-b8df-0bec292d096f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:34.936335 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:34.936258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56jq\" (UniqueName: \"kubernetes.io/projected/1e19faa8-fc50-4426-b8df-0bec292d096f-kube-api-access-s56jq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.036988 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.036940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e19faa8-fc50-4426-b8df-0bec292d096f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.036988 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.036987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s56jq\" (UniqueName: \"kubernetes.io/projected/1e19faa8-fc50-4426-b8df-0bec292d096f-kube-api-access-s56jq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037252 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037728 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037883 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037980 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037980 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.037980 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.037939 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e19faa8-fc50-4426-b8df-0bec292d096f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.040056 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.040028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.040329 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.040307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.044181 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.044145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" event={"ID":"96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb","Type":"ContainerStarted","Data":"b5ef8d14cd3a68bf0daab1b20cc6b07cc8f4627d39b055543129b88b8b69b742"} Jul 01 19:41:35.055727 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.055697 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e19faa8-fc50-4426-b8df-0bec292d096f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.055892 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.055802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56jq\" (UniqueName: \"kubernetes.io/projected/1e19faa8-fc50-4426-b8df-0bec292d096f-kube-api-access-s56jq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wmzrj\" (UID: \"1e19faa8-fc50-4426-b8df-0bec292d096f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.074528 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.074473 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-54759b6cc8-nf9nq" podStartSLOduration=1.18578243 podStartE2EDuration="6.074455475s" totalImagesPullingTime="4.888673045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:35.07195499 +0000 UTC m=+405.341939683" watchObservedRunningTime="2026-07-01 19:41:35.074455475 +0000 UTC m=+405.344440165" Jul 01 19:41:35.105104 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.105065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:35.276475 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.276446 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj"] Jul 01 19:41:35.279636 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:41:35.279604 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e19faa8_fc50_4426_b8df_0bec292d096f.slice/crio-da033c20d534f316ec8d6c4681a8bf6bd7848edbf759bb4cae8553e06601673b WatchSource:0}: Error finding container da033c20d534f316ec8d6c4681a8bf6bd7848edbf759bb4cae8553e06601673b: Status 404 returned error can't find the container with id da033c20d534f316ec8d6c4681a8bf6bd7848edbf759bb4cae8553e06601673b Jul 01 19:41:35.996839 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:35.996802 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l"] Jul 01 19:41:36.011196 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.011169 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.016905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.016111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 19:41:36.016905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.016136 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 19:41:36.016905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.016118 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 19:41:36.016905 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.016686 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-svbrj\"" Jul 01 19:41:36.017223 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.017043 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l"] Jul 01 19:41:36.051555 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.051480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" event={"ID":"1e19faa8-fc50-4426-b8df-0bec292d096f","Type":"ContainerStarted","Data":"da033c20d534f316ec8d6c4681a8bf6bd7848edbf759bb4cae8553e06601673b"} Jul 01 19:41:36.148963 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.148923 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6zs\" (UniqueName: \"kubernetes.io/projected/1258ffbd-d916-4b6c-bcc3-f089c100eabe-kube-api-access-wr6zs\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.149230 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.148980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1258ffbd-d916-4b6c-bcc3-f089c100eabe-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.149230 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.149018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.149230 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.149118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.149230 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.149173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.149461 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.149269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.149461 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.149333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.250588 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6zs\" (UniqueName: \"kubernetes.io/projected/1258ffbd-d916-4b6c-bcc3-f089c100eabe-kube-api-access-wr6zs\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.250588 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1258ffbd-d916-4b6c-bcc3-f089c100eabe-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.250810 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.250810 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.250955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.250955 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.251063 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.250956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.251913 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.251882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.253643 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.253591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1258ffbd-d916-4b6c-bcc3-f089c100eabe-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.253772 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.253650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.253929 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.253885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.253929 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.253910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.262695 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.262666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6zs\" (UniqueName: \"kubernetes.io/projected/1258ffbd-d916-4b6c-bcc3-f089c100eabe-kube-api-access-wr6zs\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.265034 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.264989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1258ffbd-d916-4b6c-bcc3-f089c100eabe-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bs68l\" (UID: \"1258ffbd-d916-4b6c-bcc3-f089c100eabe\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.326087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.326045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:36.651457 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:36.651417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l"] Jul 01 19:41:36.652666 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:41:36.652638 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1258ffbd_d916_4b6c_bcc3_f089c100eabe.slice/crio-22de0e97fa2c07f71bde90cfe4a345e82a944257dc7690ff3c82e06f0c196ec6 WatchSource:0}: Error finding container 22de0e97fa2c07f71bde90cfe4a345e82a944257dc7690ff3c82e06f0c196ec6: Status 404 returned error can't find the container with id 22de0e97fa2c07f71bde90cfe4a345e82a944257dc7690ff3c82e06f0c196ec6 Jul 01 19:41:37.059495 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:37.059456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" event={"ID":"1258ffbd-d916-4b6c-bcc3-f089c100eabe","Type":"ContainerStarted","Data":"22de0e97fa2c07f71bde90cfe4a345e82a944257dc7690ff3c82e06f0c196ec6"} Jul 01 19:41:38.314329 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:38.314281 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 19:41:38.314747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:38.314390 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 19:41:38.314747 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:38.314443 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 19:41:39.074715 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:39.074676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" event={"ID":"1e19faa8-fc50-4426-b8df-0bec292d096f","Type":"ContainerStarted","Data":"d10d08068867fba11b0906ef590cb6a0cdc486aca5c1eeb79d2881ea0c27728d"} Jul 01 19:41:39.106047 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:39.106008 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:39.111867 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:39.111832 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:39.135555 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:39.135491 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" podStartSLOduration=2.103266972 podStartE2EDuration="5.135463805s" totalImagesPullingTime="3.032196833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:39.131471393 +0000 UTC m=+409.401456171" watchObservedRunningTime="2026-07-01 19:41:39.135463805 +0000 UTC m=+409.405448497" Jul 01 19:41:39.321038 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:39.321001 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 19:41:39.321296 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:39.321074 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 19:41:40.081544 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.081477 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" event={"ID":"1258ffbd-d916-4b6c-bcc3-f089c100eabe","Type":"ContainerStarted","Data":"5ff688cf5baa39c6e4980f1be8c702dc9dc62e20f4d98cce4da5263df8561c9d"} Jul 01 19:41:40.081811 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.081740 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:40.081811 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.081800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:41:40.082907 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.082884 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wmzrj" Jul 01 19:41:40.083197 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.083173 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bs68l container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 19:41:40.083323 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.083225 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" podUID="1258ffbd-d916-4b6c-bcc3-f089c100eabe" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:41:40.119243 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:40.119188 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" podStartSLOduration=2.453520076 podStartE2EDuration="5.119171786s" totalImagesPullingTime="2.66565171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:41:40.118400891 +0000 UTC m=+410.388385595" watchObservedRunningTime="2026-07-01 19:41:40.119171786 +0000 UTC m=+410.389156475" Jul 01 19:41:41.086803 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:41:41.086777 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bs68l" Jul 01 19:42:36.991654 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:36.991615 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764"] Jul 01 19:42:36.994216 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:36.994200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:36.996820 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:36.996795 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:42:36.996962 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:36.996874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:42:36.997915 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:36.997897 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-56whz\"" Jul 01 19:42:37.009915 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.009891 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764"] Jul 01 19:42:37.083944 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.083908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.083944 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.083943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddcr\" (UniqueName: \"kubernetes.io/projected/818d5f18-b911-4ba3-81ff-a314d7ab8f53-kube-api-access-gddcr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.084150 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.083965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.184690 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.184647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.184690 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.184692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gddcr\" (UniqueName: \"kubernetes.io/projected/818d5f18-b911-4ba3-81ff-a314d7ab8f53-kube-api-access-gddcr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.184958 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.184722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.185060 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.185043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.185096 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.185076 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.198206 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.198181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddcr\" (UniqueName: \"kubernetes.io/projected/818d5f18-b911-4ba3-81ff-a314d7ab8f53-kube-api-access-gddcr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.303965 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.303883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:37.400319 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.400287 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9"] Jul 01 19:42:37.403084 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.403066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.424425 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.424391 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9"] Jul 01 19:42:37.454792 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.454768 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764"] Jul 01 19:42:37.488488 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.488455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.488582 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.488544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.488582 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.488571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvq2d\" (UniqueName: \"kubernetes.io/projected/183cfcaf-0ea3-474d-8309-ba14a58c084a-kube-api-access-vvq2d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.589584 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.589551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.589738 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.589614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.589738 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.589639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvq2d\" (UniqueName: \"kubernetes.io/projected/183cfcaf-0ea3-474d-8309-ba14a58c084a-kube-api-access-vvq2d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.589996 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.589975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.589996 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.589990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.599022 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.599002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvq2d\" (UniqueName: \"kubernetes.io/projected/183cfcaf-0ea3-474d-8309-ba14a58c084a-kube-api-access-vvq2d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.714404 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.714359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:37.792318 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.792276 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b"] Jul 01 19:42:37.795130 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.795108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.808113 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.808039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b"] Jul 01 19:42:37.873598 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.873576 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9"] Jul 01 19:42:37.876602 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:42:37.876572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183cfcaf_0ea3_474d_8309_ba14a58c084a.slice/crio-1985d6f1ee5eb92e62c04dab5001a541c4d02a7716ec3599b980386f2f186719 WatchSource:0}: Error finding container 1985d6f1ee5eb92e62c04dab5001a541c4d02a7716ec3599b980386f2f186719: Status 404 returned error can't find the container with id 1985d6f1ee5eb92e62c04dab5001a541c4d02a7716ec3599b980386f2f186719 Jul 01 19:42:37.892198 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.892174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.892297 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.892207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.892297 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.892239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn2qk\" (UniqueName: \"kubernetes.io/projected/bfa48c56-9fe7-492d-a943-21a68dfa5369-kube-api-access-qn2qk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.993307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.993271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.993307 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.993308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.993796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.993338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn2qk\" (UniqueName: \"kubernetes.io/projected/bfa48c56-9fe7-492d-a943-21a68dfa5369-kube-api-access-qn2qk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.993796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.993631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:37.993796 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:37.993708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:38.003432 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.003411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn2qk\" (UniqueName: \"kubernetes.io/projected/bfa48c56-9fe7-492d-a943-21a68dfa5369-kube-api-access-qn2qk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:38.105690 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.105605 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:38.208603 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.208571 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k"] Jul 01 19:42:38.214023 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.213993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.230397 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.230370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k"] Jul 01 19:42:38.253109 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.253082 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b"] Jul 01 19:42:38.255021 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:42:38.254998 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa48c56_9fe7_492d_a943_21a68dfa5369.slice/crio-0ad5c38948b9b82c45213f0753748dbe45cb905ce8abd1850f7822197eb1509e WatchSource:0}: Error finding container 0ad5c38948b9b82c45213f0753748dbe45cb905ce8abd1850f7822197eb1509e: Status 404 returned error can't find the container with id 0ad5c38948b9b82c45213f0753748dbe45cb905ce8abd1850f7822197eb1509e Jul 01 19:42:38.296789 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.296757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86w8p\" (UniqueName: \"kubernetes.io/projected/14c75aeb-8b7a-4545-baa3-ee2f67099a69-kube-api-access-86w8p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.296953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.296801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.296953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.296928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.355157 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.355127 2563 generic.go:356] "Generic (PLEG): container finished" podID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerID="8291fd494b3739175c3492cf07aea434cd0545a29576f5bef10066cf4450566b" exitCode=0 Jul 01 19:42:38.355344 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.355215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" event={"ID":"183cfcaf-0ea3-474d-8309-ba14a58c084a","Type":"ContainerDied","Data":"8291fd494b3739175c3492cf07aea434cd0545a29576f5bef10066cf4450566b"} Jul 01 19:42:38.355344 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.355273 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" event={"ID":"183cfcaf-0ea3-474d-8309-ba14a58c084a","Type":"ContainerStarted","Data":"1985d6f1ee5eb92e62c04dab5001a541c4d02a7716ec3599b980386f2f186719"} Jul 01 19:42:38.357127 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.357097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" event={"ID":"bfa48c56-9fe7-492d-a943-21a68dfa5369","Type":"ContainerStarted","Data":"59dcd2b834456a68c9faf4d0676cd72bda9011ed46fec14f62fe3e7f98684f94"} Jul 01 19:42:38.357241 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.357153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" event={"ID":"bfa48c56-9fe7-492d-a943-21a68dfa5369","Type":"ContainerStarted","Data":"0ad5c38948b9b82c45213f0753748dbe45cb905ce8abd1850f7822197eb1509e"} Jul 01 19:42:38.359108 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.359077 2563 generic.go:356] "Generic (PLEG): container finished" podID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerID="043c5349365c508fc5238fad7e2254ffee25c8a9a793486a1faa1e3e56630453" exitCode=0 Jul 01 19:42:38.359253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.359142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" event={"ID":"818d5f18-b911-4ba3-81ff-a314d7ab8f53","Type":"ContainerDied","Data":"043c5349365c508fc5238fad7e2254ffee25c8a9a793486a1faa1e3e56630453"} Jul 01 19:42:38.359253 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.359199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" event={"ID":"818d5f18-b911-4ba3-81ff-a314d7ab8f53","Type":"ContainerStarted","Data":"db06d4729e34dec1e673fbf1e3f874367b4a62c17e29bc90d28f6922f6c6ea53"} Jul 01 19:42:38.398232 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.398205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86w8p\" (UniqueName: \"kubernetes.io/projected/14c75aeb-8b7a-4545-baa3-ee2f67099a69-kube-api-access-86w8p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.398361 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.398249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.398361 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.398305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.398622 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.398602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.398677 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.398637 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.425072 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.425042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86w8p\" (UniqueName: \"kubernetes.io/projected/14c75aeb-8b7a-4545-baa3-ee2f67099a69-kube-api-access-86w8p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.526020 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.525985 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:38.666128 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:38.666104 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k"] Jul 01 19:42:38.668151 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:42:38.668124 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c75aeb_8b7a_4545_baa3_ee2f67099a69.slice/crio-7da8840ce8fb11ce40c82e5d1afbfbe9126786cf3aecb730929406d2d7d109a1 WatchSource:0}: Error finding container 7da8840ce8fb11ce40c82e5d1afbfbe9126786cf3aecb730929406d2d7d109a1: Status 404 returned error can't find the container with id 7da8840ce8fb11ce40c82e5d1afbfbe9126786cf3aecb730929406d2d7d109a1 Jul 01 19:42:39.366276 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.366199 2563 generic.go:356] "Generic (PLEG): container finished" podID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerID="2bb07918f018540d4c23b2835d86985d035c71b3234db7e05322293e417abbfe" exitCode=0 Jul 01 19:42:39.366715 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.366275 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" event={"ID":"818d5f18-b911-4ba3-81ff-a314d7ab8f53","Type":"ContainerDied","Data":"2bb07918f018540d4c23b2835d86985d035c71b3234db7e05322293e417abbfe"} Jul 01 19:42:39.368262 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.368243 2563 generic.go:356] "Generic (PLEG): container finished" podID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerID="ba9dcb3d3fc2ef87b2640df2a747777f64de41f4d542b7f1d885d1fd63903225" exitCode=0 Jul 01 19:42:39.368354 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.368298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" event={"ID":"183cfcaf-0ea3-474d-8309-ba14a58c084a","Type":"ContainerDied","Data":"ba9dcb3d3fc2ef87b2640df2a747777f64de41f4d542b7f1d885d1fd63903225"} Jul 01 19:42:39.369795 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.369774 2563 generic.go:356] "Generic (PLEG): container finished" podID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerID="27703e3ca1c2cb9e2823052af003dea57ca9a1ff6e96350c018a4b8f408a07bb" exitCode=0 Jul 01 19:42:39.369908 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.369840 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" event={"ID":"14c75aeb-8b7a-4545-baa3-ee2f67099a69","Type":"ContainerDied","Data":"27703e3ca1c2cb9e2823052af003dea57ca9a1ff6e96350c018a4b8f408a07bb"} Jul 01 19:42:39.369964 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.369901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" event={"ID":"14c75aeb-8b7a-4545-baa3-ee2f67099a69","Type":"ContainerStarted","Data":"7da8840ce8fb11ce40c82e5d1afbfbe9126786cf3aecb730929406d2d7d109a1"} Jul 01 19:42:39.371685 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.371664 2563 generic.go:356] "Generic (PLEG): container finished" podID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerID="59dcd2b834456a68c9faf4d0676cd72bda9011ed46fec14f62fe3e7f98684f94" exitCode=0 Jul 01 19:42:39.371813 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:39.371687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" event={"ID":"bfa48c56-9fe7-492d-a943-21a68dfa5369","Type":"ContainerDied","Data":"59dcd2b834456a68c9faf4d0676cd72bda9011ed46fec14f62fe3e7f98684f94"} Jul 01 19:42:40.379729 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.379697 2563 generic.go:356] "Generic (PLEG): container finished" podID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerID="fe4e07fbf8336aea7c7080a056a4b33f5018bf594dfaeed38ad9d50723eb0ffe" exitCode=0 Jul 01 19:42:40.380157 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.379879 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" event={"ID":"bfa48c56-9fe7-492d-a943-21a68dfa5369","Type":"ContainerDied","Data":"fe4e07fbf8336aea7c7080a056a4b33f5018bf594dfaeed38ad9d50723eb0ffe"} Jul 01 19:42:40.382328 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.382305 2563 generic.go:356] "Generic (PLEG): container finished" podID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerID="d4f8f192b1c44ee8d94d375fb444ab6116f9cff711beed18c61a5eb24abb7a62" exitCode=0 Jul 01 19:42:40.382471 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.382385 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" event={"ID":"818d5f18-b911-4ba3-81ff-a314d7ab8f53","Type":"ContainerDied","Data":"d4f8f192b1c44ee8d94d375fb444ab6116f9cff711beed18c61a5eb24abb7a62"} Jul 01 19:42:40.385123 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.385098 2563 generic.go:356] "Generic (PLEG): container finished" podID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerID="f222e64fde28642d68f9ccd6fb244e2046fe9fdadb61c3811ec261673c8edfa3" exitCode=0 Jul 01 19:42:40.385227 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.385191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" event={"ID":"183cfcaf-0ea3-474d-8309-ba14a58c084a","Type":"ContainerDied","Data":"f222e64fde28642d68f9ccd6fb244e2046fe9fdadb61c3811ec261673c8edfa3"} Jul 01 19:42:40.388906 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:40.388877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" event={"ID":"14c75aeb-8b7a-4545-baa3-ee2f67099a69","Type":"ContainerStarted","Data":"b8a1feeee46222c3591fc0275fd63fabf582d1fd6e4a91e1b7f79d5fb2331197"} Jul 01 19:42:41.396426 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.396394 2563 generic.go:356] "Generic (PLEG): container finished" podID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerID="b8a1feeee46222c3591fc0275fd63fabf582d1fd6e4a91e1b7f79d5fb2331197" exitCode=0 Jul 01 19:42:41.396426 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.396418 2563 generic.go:356] "Generic (PLEG): container finished" podID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerID="060d55926021fff671f0403eac2ecc8f2b2a144ff2458bc558ff93605de5a388" exitCode=0 Jul 01 19:42:41.396932 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.396450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" event={"ID":"14c75aeb-8b7a-4545-baa3-ee2f67099a69","Type":"ContainerDied","Data":"b8a1feeee46222c3591fc0275fd63fabf582d1fd6e4a91e1b7f79d5fb2331197"} Jul 01 19:42:41.396932 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.396506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" event={"ID":"14c75aeb-8b7a-4545-baa3-ee2f67099a69","Type":"ContainerDied","Data":"060d55926021fff671f0403eac2ecc8f2b2a144ff2458bc558ff93605de5a388"} Jul 01 19:42:41.398580 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.398560 2563 generic.go:356] "Generic (PLEG): container finished" podID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerID="b19bd091887d73e30b63a7d985c355b06753cb589479219c64b8a2fb39943bb0" exitCode=0 Jul 01 19:42:41.398711 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.398652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" event={"ID":"bfa48c56-9fe7-492d-a943-21a68dfa5369","Type":"ContainerDied","Data":"b19bd091887d73e30b63a7d985c355b06753cb589479219c64b8a2fb39943bb0"} Jul 01 19:42:41.572190 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.572163 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:41.575362 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.575336 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:41.734554 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.734455 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-bundle\") pod \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " Jul 01 19:42:41.734554 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.734502 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-bundle\") pod \"183cfcaf-0ea3-474d-8309-ba14a58c084a\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " Jul 01 19:42:41.734554 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.734545 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-util\") pod \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " Jul 01 19:42:41.734876 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.734564 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvq2d\" (UniqueName: \"kubernetes.io/projected/183cfcaf-0ea3-474d-8309-ba14a58c084a-kube-api-access-vvq2d\") pod \"183cfcaf-0ea3-474d-8309-ba14a58c084a\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " Jul 01 19:42:41.734876 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.734591 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-util\") pod \"183cfcaf-0ea3-474d-8309-ba14a58c084a\" (UID: \"183cfcaf-0ea3-474d-8309-ba14a58c084a\") " Jul 01 19:42:41.734876 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.734632 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gddcr\" (UniqueName: \"kubernetes.io/projected/818d5f18-b911-4ba3-81ff-a314d7ab8f53-kube-api-access-gddcr\") pod \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\" (UID: \"818d5f18-b911-4ba3-81ff-a314d7ab8f53\") " Jul 01 19:42:41.735207 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.735180 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-bundle" (OuterVolumeSpecName: "bundle") pod "183cfcaf-0ea3-474d-8309-ba14a58c084a" (UID: "183cfcaf-0ea3-474d-8309-ba14a58c084a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:41.735326 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.735206 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-bundle" (OuterVolumeSpecName: "bundle") pod "818d5f18-b911-4ba3-81ff-a314d7ab8f53" (UID: "818d5f18-b911-4ba3-81ff-a314d7ab8f53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:41.737444 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.737412 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183cfcaf-0ea3-474d-8309-ba14a58c084a-kube-api-access-vvq2d" (OuterVolumeSpecName: "kube-api-access-vvq2d") pod "183cfcaf-0ea3-474d-8309-ba14a58c084a" (UID: "183cfcaf-0ea3-474d-8309-ba14a58c084a"). InnerVolumeSpecName "kube-api-access-vvq2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:42:41.737444 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.737422 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818d5f18-b911-4ba3-81ff-a314d7ab8f53-kube-api-access-gddcr" (OuterVolumeSpecName: "kube-api-access-gddcr") pod "818d5f18-b911-4ba3-81ff-a314d7ab8f53" (UID: "818d5f18-b911-4ba3-81ff-a314d7ab8f53"). InnerVolumeSpecName "kube-api-access-gddcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:42:41.740547 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.740501 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-util" (OuterVolumeSpecName: "util") pod "183cfcaf-0ea3-474d-8309-ba14a58c084a" (UID: "183cfcaf-0ea3-474d-8309-ba14a58c084a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:41.741578 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.741556 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-util" (OuterVolumeSpecName: "util") pod "818d5f18-b911-4ba3-81ff-a314d7ab8f53" (UID: "818d5f18-b911-4ba3-81ff-a314d7ab8f53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:41.835663 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.835618 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gddcr\" (UniqueName: \"kubernetes.io/projected/818d5f18-b911-4ba3-81ff-a314d7ab8f53-kube-api-access-gddcr\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:41.835663 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.835654 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:41.835663 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.835664 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:41.835663 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.835672 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/818d5f18-b911-4ba3-81ff-a314d7ab8f53-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:41.835978 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.835681 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvq2d\" (UniqueName: \"kubernetes.io/projected/183cfcaf-0ea3-474d-8309-ba14a58c084a-kube-api-access-vvq2d\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:41.835978 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:41.835689 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183cfcaf-0ea3-474d-8309-ba14a58c084a-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:42.409097 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.409052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" event={"ID":"818d5f18-b911-4ba3-81ff-a314d7ab8f53","Type":"ContainerDied","Data":"db06d4729e34dec1e673fbf1e3f874367b4a62c17e29bc90d28f6922f6c6ea53"} Jul 01 19:42:42.409572 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.409148 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db06d4729e34dec1e673fbf1e3f874367b4a62c17e29bc90d28f6922f6c6ea53" Jul 01 19:42:42.409572 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.409276 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764" Jul 01 19:42:42.412489 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.412450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" event={"ID":"183cfcaf-0ea3-474d-8309-ba14a58c084a","Type":"ContainerDied","Data":"1985d6f1ee5eb92e62c04dab5001a541c4d02a7716ec3599b980386f2f186719"} Jul 01 19:42:42.412644 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.412511 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1985d6f1ee5eb92e62c04dab5001a541c4d02a7716ec3599b980386f2f186719" Jul 01 19:42:42.412644 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.412628 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9" Jul 01 19:42:42.552343 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.552316 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:42.587421 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.587397 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:42.743505 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.743398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-bundle\") pod \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " Jul 01 19:42:42.743505 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.743486 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn2qk\" (UniqueName: \"kubernetes.io/projected/bfa48c56-9fe7-492d-a943-21a68dfa5369-kube-api-access-qn2qk\") pod \"bfa48c56-9fe7-492d-a943-21a68dfa5369\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " Jul 01 19:42:42.743726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.743518 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-util\") pod \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " Jul 01 19:42:42.743726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.743580 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-bundle\") pod \"bfa48c56-9fe7-492d-a943-21a68dfa5369\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " Jul 01 19:42:42.743726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.743603 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-util\") pod \"bfa48c56-9fe7-492d-a943-21a68dfa5369\" (UID: \"bfa48c56-9fe7-492d-a943-21a68dfa5369\") " Jul 01 19:42:42.743726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.743625 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86w8p\" (UniqueName: \"kubernetes.io/projected/14c75aeb-8b7a-4545-baa3-ee2f67099a69-kube-api-access-86w8p\") pod \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\" (UID: \"14c75aeb-8b7a-4545-baa3-ee2f67099a69\") " Jul 01 19:42:42.744200 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.744166 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-bundle" (OuterVolumeSpecName: "bundle") pod "bfa48c56-9fe7-492d-a943-21a68dfa5369" (UID: "bfa48c56-9fe7-492d-a943-21a68dfa5369"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:42.744320 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.744221 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-bundle" (OuterVolumeSpecName: "bundle") pod "14c75aeb-8b7a-4545-baa3-ee2f67099a69" (UID: "14c75aeb-8b7a-4545-baa3-ee2f67099a69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:42.746069 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.746043 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c75aeb-8b7a-4545-baa3-ee2f67099a69-kube-api-access-86w8p" (OuterVolumeSpecName: "kube-api-access-86w8p") pod "14c75aeb-8b7a-4545-baa3-ee2f67099a69" (UID: "14c75aeb-8b7a-4545-baa3-ee2f67099a69"). InnerVolumeSpecName "kube-api-access-86w8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:42:42.746244 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.746222 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa48c56-9fe7-492d-a943-21a68dfa5369-kube-api-access-qn2qk" (OuterVolumeSpecName: "kube-api-access-qn2qk") pod "bfa48c56-9fe7-492d-a943-21a68dfa5369" (UID: "bfa48c56-9fe7-492d-a943-21a68dfa5369"). InnerVolumeSpecName "kube-api-access-qn2qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:42:42.749707 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.749674 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-util" (OuterVolumeSpecName: "util") pod "bfa48c56-9fe7-492d-a943-21a68dfa5369" (UID: "bfa48c56-9fe7-492d-a943-21a68dfa5369"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:42.750039 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.750016 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-util" (OuterVolumeSpecName: "util") pod "14c75aeb-8b7a-4545-baa3-ee2f67099a69" (UID: "14c75aeb-8b7a-4545-baa3-ee2f67099a69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:42:42.844817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.844763 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:42.844817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.844806 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:42.844817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.844815 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfa48c56-9fe7-492d-a943-21a68dfa5369-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:42.844817 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.844823 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86w8p\" (UniqueName: \"kubernetes.io/projected/14c75aeb-8b7a-4545-baa3-ee2f67099a69-kube-api-access-86w8p\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:42.845098 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.844832 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14c75aeb-8b7a-4545-baa3-ee2f67099a69-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:42.845098 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:42.844842 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn2qk\" (UniqueName: \"kubernetes.io/projected/bfa48c56-9fe7-492d-a943-21a68dfa5369-kube-api-access-qn2qk\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:42:43.420006 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:43.419972 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" Jul 01 19:42:43.420006 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:43.419999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k" event={"ID":"14c75aeb-8b7a-4545-baa3-ee2f67099a69","Type":"ContainerDied","Data":"7da8840ce8fb11ce40c82e5d1afbfbe9126786cf3aecb730929406d2d7d109a1"} Jul 01 19:42:43.420475 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:43.420046 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7da8840ce8fb11ce40c82e5d1afbfbe9126786cf3aecb730929406d2d7d109a1" Jul 01 19:42:43.421825 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:43.421799 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" Jul 01 19:42:43.421964 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:43.421820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b" event={"ID":"bfa48c56-9fe7-492d-a943-21a68dfa5369","Type":"ContainerDied","Data":"0ad5c38948b9b82c45213f0753748dbe45cb905ce8abd1850f7822197eb1509e"} Jul 01 19:42:43.421964 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:42:43.421893 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ad5c38948b9b82c45213f0753748dbe45cb905ce8abd1850f7822197eb1509e" Jul 01 19:44:17.742543 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.742507 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.742966 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="util" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.742981 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="util" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.742994 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="util" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.742999 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="util" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743011 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="extract" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743017 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="extract" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743026 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="pull" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743030 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="pull" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743038 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="extract" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743043 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="extract" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743050 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="extract" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743055 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="extract" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743063 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="util" Jul 01 19:44:17.743059 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743068 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="util" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743074 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="util" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743080 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="util" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743087 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="pull" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743092 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="pull" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743097 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="pull" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743102 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="pull" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743109 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="extract" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743114 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="extract" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743121 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="pull" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743126 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="pull" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743177 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c75aeb-8b7a-4545-baa3-ee2f67099a69" containerName="extract" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743185 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa48c56-9fe7-492d-a943-21a68dfa5369" containerName="extract" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743192 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="818d5f18-b911-4ba3-81ff-a314d7ab8f53" containerName="extract" Jul 01 19:44:17.743466 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.743198 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="183cfcaf-0ea3-474d-8309-ba14a58c084a" containerName="extract" Jul 01 19:44:17.745575 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.745558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:17.749463 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.749437 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 19:44:17.749463 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.749438 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 19:44:17.750382 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.750364 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-56whz\"" Jul 01 19:44:17.750456 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.750406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 19:44:17.763534 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.763512 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:44:17.827075 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.827040 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:44:17.869781 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.869745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gbvm\" (UniqueName: \"kubernetes.io/projected/b28aac01-c4d4-4433-9c28-f19d24dc8d20-kube-api-access-7gbvm\") pod \"limitador-limitador-54d6d988d5-vsfj4\" (UID: \"b28aac01-c4d4-4433-9c28-f19d24dc8d20\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:17.869781 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.869784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b28aac01-c4d4-4433-9c28-f19d24dc8d20-config-file\") pod \"limitador-limitador-54d6d988d5-vsfj4\" (UID: \"b28aac01-c4d4-4433-9c28-f19d24dc8d20\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:17.970632 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.970594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gbvm\" (UniqueName: \"kubernetes.io/projected/b28aac01-c4d4-4433-9c28-f19d24dc8d20-kube-api-access-7gbvm\") pod \"limitador-limitador-54d6d988d5-vsfj4\" (UID: \"b28aac01-c4d4-4433-9c28-f19d24dc8d20\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:17.970632 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.970637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b28aac01-c4d4-4433-9c28-f19d24dc8d20-config-file\") pod \"limitador-limitador-54d6d988d5-vsfj4\" (UID: \"b28aac01-c4d4-4433-9c28-f19d24dc8d20\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:17.971286 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.971267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b28aac01-c4d4-4433-9c28-f19d24dc8d20-config-file\") pod \"limitador-limitador-54d6d988d5-vsfj4\" (UID: \"b28aac01-c4d4-4433-9c28-f19d24dc8d20\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:17.980883 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:17.980840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gbvm\" (UniqueName: \"kubernetes.io/projected/b28aac01-c4d4-4433-9c28-f19d24dc8d20-kube-api-access-7gbvm\") pod \"limitador-limitador-54d6d988d5-vsfj4\" (UID: \"b28aac01-c4d4-4433-9c28-f19d24dc8d20\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:18.056046 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:18.055940 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:18.244793 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:18.244765 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:44:18.247439 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:44:18.247407 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28aac01_c4d4_4433_9c28_f19d24dc8d20.slice/crio-da832236cb4998c1d477da4a92f6a8c081df7d5c83d702602d24f36a1f6f945f WatchSource:0}: Error finding container da832236cb4998c1d477da4a92f6a8c081df7d5c83d702602d24f36a1f6f945f: Status 404 returned error can't find the container with id da832236cb4998c1d477da4a92f6a8c081df7d5c83d702602d24f36a1f6f945f Jul 01 19:44:18.914290 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:18.914253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" event={"ID":"b28aac01-c4d4-4433-9c28-f19d24dc8d20","Type":"ContainerStarted","Data":"da832236cb4998c1d477da4a92f6a8c081df7d5c83d702602d24f36a1f6f945f"} Jul 01 19:44:21.934703 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:21.934663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" event={"ID":"b28aac01-c4d4-4433-9c28-f19d24dc8d20","Type":"ContainerStarted","Data":"ebd5db8c873f35277220183e7ac94cb9e416e3e39219f3582409b396419a090c"} Jul 01 19:44:21.935162 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:21.934816 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:21.995654 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:21.995592 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" podStartSLOduration=2.315004404 podStartE2EDuration="4.99557577s" totalImagesPullingTime="2.680571366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:44:21.968275948 +0000 UTC m=+572.238260639" watchObservedRunningTime="2026-07-01 19:44:21.99557577 +0000 UTC m=+572.265560460" Jul 01 19:44:32.941797 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:32.941765 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vsfj4" Jul 01 19:44:50.189959 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.189933 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:44:50.190457 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.190359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:44:50.197327 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.197304 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:44:50.197502 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.197483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:44:50.359493 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.359459 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f"] Jul 01 19:44:50.363122 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.363099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.366559 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.366526 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:44:50.366686 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.366526 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kc497\"" Jul 01 19:44:50.367465 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.367447 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:44:50.375299 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.375278 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f"] Jul 01 19:44:50.444315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.444216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.444484 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.444323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.444484 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.444363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqskt\" (UniqueName: \"kubernetes.io/projected/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-kube-api-access-cqskt\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.544940 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.544782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.544940 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.544910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.550094 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.544966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqskt\" (UniqueName: \"kubernetes.io/projected/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-kube-api-access-cqskt\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.550094 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.545268 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.550094 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.545306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.558548 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.558522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqskt\" (UniqueName: \"kubernetes.io/projected/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-kube-api-access-cqskt\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.674844 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.674799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:50.826674 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:50.826648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f"] Jul 01 19:44:50.828657 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:44:50.828629 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b42ce6_cefa_4102_afe8_62d74d2b3a9d.slice/crio-7dc6b8b92ed2bba44b85e7238781b5624b3a2cbf88b103927914f05402127e9b WatchSource:0}: Error finding container 7dc6b8b92ed2bba44b85e7238781b5624b3a2cbf88b103927914f05402127e9b: Status 404 returned error can't find the container with id 7dc6b8b92ed2bba44b85e7238781b5624b3a2cbf88b103927914f05402127e9b Jul 01 19:44:51.081463 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:51.081375 2563 generic.go:356] "Generic (PLEG): container finished" podID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerID="4914565ab1c6e3ebff64afc277c5aea13ab17506c61817037e850b420ca26108" exitCode=0 Jul 01 19:44:51.081463 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:51.081435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" event={"ID":"77b42ce6-cefa-4102-afe8-62d74d2b3a9d","Type":"ContainerDied","Data":"4914565ab1c6e3ebff64afc277c5aea13ab17506c61817037e850b420ca26108"} Jul 01 19:44:51.081649 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:51.081487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" event={"ID":"77b42ce6-cefa-4102-afe8-62d74d2b3a9d","Type":"ContainerStarted","Data":"7dc6b8b92ed2bba44b85e7238781b5624b3a2cbf88b103927914f05402127e9b"} Jul 01 19:44:52.088872 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:52.088766 2563 generic.go:356] "Generic (PLEG): container finished" podID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerID="1f553f3ad595ae259bcf88d1bec828ef215e8e15ceaf0efa24d5a37aa9f1428f" exitCode=0 Jul 01 19:44:52.089237 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:52.088875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" event={"ID":"77b42ce6-cefa-4102-afe8-62d74d2b3a9d","Type":"ContainerDied","Data":"1f553f3ad595ae259bcf88d1bec828ef215e8e15ceaf0efa24d5a37aa9f1428f"} Jul 01 19:44:53.095201 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:53.095165 2563 generic.go:356] "Generic (PLEG): container finished" podID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerID="bc68ac4c4a5cf06531d7a17420ad93c55cbb9bba17b2e6f2c619ef18d6c343e0" exitCode=0 Jul 01 19:44:53.095588 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:53.095239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" event={"ID":"77b42ce6-cefa-4102-afe8-62d74d2b3a9d","Type":"ContainerDied","Data":"bc68ac4c4a5cf06531d7a17420ad93c55cbb9bba17b2e6f2c619ef18d6c343e0"} Jul 01 19:44:54.253681 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.253647 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:54.382550 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.382514 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-util\") pod \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " Jul 01 19:44:54.382729 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.382567 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-bundle\") pod \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " Jul 01 19:44:54.382729 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.382604 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqskt\" (UniqueName: \"kubernetes.io/projected/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-kube-api-access-cqskt\") pod \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\" (UID: \"77b42ce6-cefa-4102-afe8-62d74d2b3a9d\") " Jul 01 19:44:54.383148 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.383113 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-bundle" (OuterVolumeSpecName: "bundle") pod "77b42ce6-cefa-4102-afe8-62d74d2b3a9d" (UID: "77b42ce6-cefa-4102-afe8-62d74d2b3a9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:44:54.384772 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.384750 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-kube-api-access-cqskt" (OuterVolumeSpecName: "kube-api-access-cqskt") pod "77b42ce6-cefa-4102-afe8-62d74d2b3a9d" (UID: "77b42ce6-cefa-4102-afe8-62d74d2b3a9d"). InnerVolumeSpecName "kube-api-access-cqskt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:44:54.388638 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.388614 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-util" (OuterVolumeSpecName: "util") pod "77b42ce6-cefa-4102-afe8-62d74d2b3a9d" (UID: "77b42ce6-cefa-4102-afe8-62d74d2b3a9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:44:54.483503 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.483471 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:44:54.483503 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.483500 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqskt\" (UniqueName: \"kubernetes.io/projected/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-kube-api-access-cqskt\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:44:54.483503 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:54.483512 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77b42ce6-cefa-4102-afe8-62d74d2b3a9d-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\"" Jul 01 19:44:55.106864 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:55.106815 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" Jul 01 19:44:55.106864 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:55.106814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c82wf2f" event={"ID":"77b42ce6-cefa-4102-afe8-62d74d2b3a9d","Type":"ContainerDied","Data":"7dc6b8b92ed2bba44b85e7238781b5624b3a2cbf88b103927914f05402127e9b"} Jul 01 19:44:55.107115 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:44:55.106908 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dc6b8b92ed2bba44b85e7238781b5624b3a2cbf88b103927914f05402127e9b" Jul 01 19:46:28.448866 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:46:28.448818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:47:34.815036 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:34.814995 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:47:43.393167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393134 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-xwq52"] Jul 01 19:47:43.393557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393505 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="util" Jul 01 19:47:43.393557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393517 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="util" Jul 01 19:47:43.393557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393531 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="pull" Jul 01 19:47:43.393557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393539 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="pull" Jul 01 19:47:43.393557 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393560 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="extract" Jul 01 19:47:43.393720 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393566 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="extract" Jul 01 19:47:43.393720 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.393625 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b42ce6-cefa-4102-afe8-62d74d2b3a9d" containerName="extract" Jul 01 19:47:43.396562 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.396547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.402122 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.402100 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 19:47:43.406222 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.406200 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 19:47:43.406679 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.406647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 19:47:43.406799 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.406695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-672b9\"" Jul 01 19:47:43.419097 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.419063 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-xwq52"] Jul 01 19:47:43.463435 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.463396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.463616 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.463455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e47a57-b456-451e-b981-707e2c2224eb-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.463616 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.463524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.463616 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.463563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.463616 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.463581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6g6\" (UniqueName: \"kubernetes.io/projected/21e47a57-b456-451e-b981-707e2c2224eb-kube-api-access-lt6g6\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.564718 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.564681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.564949 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.564739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.564949 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.564757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6g6\" (UniqueName: \"kubernetes.io/projected/21e47a57-b456-451e-b981-707e2c2224eb-kube-api-access-lt6g6\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.564949 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.564777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.564949 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.564815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e47a57-b456-451e-b981-707e2c2224eb-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.565167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.565119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.565167 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.565153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.567268 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.567239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e47a57-b456-451e-b981-707e2c2224eb-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.567519 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.567502 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e47a57-b456-451e-b981-707e2c2224eb-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.573912 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.573888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6g6\" (UniqueName: \"kubernetes.io/projected/21e47a57-b456-451e-b981-707e2c2224eb-kube-api-access-lt6g6\") pod \"e2e-distinct-simulated-kserve-ff95456df-xwq52\" (UID: \"21e47a57-b456-451e-b981-707e2c2224eb\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.707158 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.707064 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:43.852196 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.852162 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-xwq52"] Jul 01 19:47:43.852870 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:47:43.852831 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e47a57_b456_451e_b981_707e2c2224eb.slice/crio-e7acdbceb1b7add9a8d246058b87d3084c30e948a43faab7741b9007bcc232dd WatchSource:0}: Error finding container e7acdbceb1b7add9a8d246058b87d3084c30e948a43faab7741b9007bcc232dd: Status 404 returned error can't find the container with id e7acdbceb1b7add9a8d246058b87d3084c30e948a43faab7741b9007bcc232dd Jul 01 19:47:43.854146 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.854129 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:47:43.971182 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:43.971099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" event={"ID":"21e47a57-b456-451e-b981-707e2c2224eb","Type":"ContainerStarted","Data":"e7acdbceb1b7add9a8d246058b87d3084c30e948a43faab7741b9007bcc232dd"} Jul 01 19:47:44.019438 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:44.019402 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:47:44.979258 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:44.979222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" event={"ID":"21e47a57-b456-451e-b981-707e2c2224eb","Type":"ContainerStarted","Data":"350008abb7d3c7c46e0bde110f2a2d3213b61b7ea7ecbfddd68bdb0742cdecaa"} Jul 01 19:47:45.001171 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:45.001117 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" podStartSLOduration=0.972395338 podStartE2EDuration="2.001101887s" totalImagesPullingTime="1.028706549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:47:44.999098669 +0000 UTC m=+775.269083358" watchObservedRunningTime="2026-07-01 19:47:45.001101887 +0000 UTC m=+775.271086577" Jul 01 19:47:53.707487 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:53.707445 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:53.708044 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:53.707518 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:53.720750 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:53.720719 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:54.038672 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:54.038576 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-xwq52" Jul 01 19:47:56.398538 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:47:56.398501 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:48:03.110277 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:03.110242 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:48:14.620064 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.619982 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj"] Jul 01 19:48:14.623370 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.623352 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.627678 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.627656 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 19:48:14.643104 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.643068 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj"] Jul 01 19:48:14.746159 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.746124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.746159 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.746164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6kp9\" (UniqueName: \"kubernetes.io/projected/88c6c454-8513-48c6-9885-b79d8e77ba15-kube-api-access-d6kp9\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.746376 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.746200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.746376 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.746218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c6c454-8513-48c6-9885-b79d8e77ba15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.746376 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.746315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.847218 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.847170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.847402 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.847224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c6c454-8513-48c6-9885-b79d8e77ba15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.847402 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.847285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.847402 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.847361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.847402 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.847390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6kp9\" (UniqueName: \"kubernetes.io/projected/88c6c454-8513-48c6-9885-b79d8e77ba15-kube-api-access-d6kp9\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.847676 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.847642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.848119 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.848092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.850364 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.850342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c6c454-8513-48c6-9885-b79d8e77ba15-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.850465 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.850380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c6c454-8513-48c6-9885-b79d8e77ba15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.857249 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.857226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6kp9\" (UniqueName: \"kubernetes.io/projected/88c6c454-8513-48c6-9885-b79d8e77ba15-kube-api-access-d6kp9\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj\" (UID: \"88c6c454-8513-48c6-9885-b79d8e77ba15\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:14.933823 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:14.933772 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:15.086707 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:15.086676 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj"] Jul 01 19:48:15.088039 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:48:15.088014 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c6c454_8513_48c6_9885_b79d8e77ba15.slice/crio-6ba37f5b5674a882f6b952c6b150ab4a82d63b59edfc6369fdc084f759d71dc7 WatchSource:0}: Error finding container 6ba37f5b5674a882f6b952c6b150ab4a82d63b59edfc6369fdc084f759d71dc7: Status 404 returned error can't find the container with id 6ba37f5b5674a882f6b952c6b150ab4a82d63b59edfc6369fdc084f759d71dc7 Jul 01 19:48:15.132542 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:15.132506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" event={"ID":"88c6c454-8513-48c6-9885-b79d8e77ba15","Type":"ContainerStarted","Data":"6ba37f5b5674a882f6b952c6b150ab4a82d63b59edfc6369fdc084f759d71dc7"} Jul 01 19:48:15.923965 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:15.923927 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:48:16.140184 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:16.140147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" event={"ID":"88c6c454-8513-48c6-9885-b79d8e77ba15","Type":"ContainerStarted","Data":"53e761168b2da1b37f9614bf79309652af9bf029d57d0271979652975ae369d2"} Jul 01 19:48:16.173386 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:16.173316 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" podStartSLOduration=1.982628716 podStartE2EDuration="2.173300525s" totalImagesPullingTime="190.671809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:16.172097803 +0000 UTC m=+806.442082513" watchObservedRunningTime="2026-07-01 19:48:16.173300525 +0000 UTC m=+806.443285217" Jul 01 19:48:24.934738 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:24.934692 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:24.935184 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:24.935039 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:24.948054 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:24.948026 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:25.199315 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:25.199232 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj" Jul 01 19:48:25.914899 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:48:25.914864 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vsfj4"] Jul 01 19:49:50.226540 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:49:50.226509 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:49:50.230009 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:49:50.229981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:49:50.234131 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:49:50.234102 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:49:50.237734 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:49:50.237711 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2btc5_e037a4b6-1b15-49ec-b2c3-8ceae40bf9a9/ovn-acl-logging/0.log" Jul 01 19:50:10.826137 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:10.826098 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-54759b6cc8-nf9nq_96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb/nginx/0.log" Jul 01 19:50:11.777243 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:11.777211 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-gb9s7_3e38e6d6-1674-4955-8cf1-7bd27f99e565/manager/0.log" Jul 01 19:50:11.785166 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:11.785135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-gb9s7_3e38e6d6-1674-4955-8cf1-7bd27f99e565/copy-manifests/0.log" Jul 01 19:50:12.921204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:12.921176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b_bfa48c56-9fe7-492d-a943-21a68dfa5369/extract/0.log" Jul 01 19:50:12.932525 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:12.932499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b_bfa48c56-9fe7-492d-a943-21a68dfa5369/util/0.log" Jul 01 19:50:12.940287 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:12.940268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b_bfa48c56-9fe7-492d-a943-21a68dfa5369/pull/0.log" Jul 01 19:50:13.052037 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.051999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9_183cfcaf-0ea3-474d-8309-ba14a58c084a/util/0.log" Jul 01 19:50:13.058962 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.058934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9_183cfcaf-0ea3-474d-8309-ba14a58c084a/pull/0.log" Jul 01 19:50:13.065304 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.065283 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9_183cfcaf-0ea3-474d-8309-ba14a58c084a/extract/0.log" Jul 01 19:50:13.179419 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.179332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k_14c75aeb-8b7a-4545-baa3-ee2f67099a69/pull/0.log" Jul 01 19:50:13.186297 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.186269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k_14c75aeb-8b7a-4545-baa3-ee2f67099a69/extract/0.log" Jul 01 19:50:13.193422 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.193404 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k_14c75aeb-8b7a-4545-baa3-ee2f67099a69/util/0.log" Jul 01 19:50:13.308497 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.308472 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764_818d5f18-b911-4ba3-81ff-a314d7ab8f53/util/0.log" Jul 01 19:50:13.315413 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.315390 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764_818d5f18-b911-4ba3-81ff-a314d7ab8f53/pull/0.log" Jul 01 19:50:13.322050 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:13.322028 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764_818d5f18-b911-4ba3-81ff-a314d7ab8f53/extract/0.log" Jul 01 19:50:14.154534 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:14.154502 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vsfj4_b28aac01-c4d4-4433-9c28-f19d24dc8d20/limitador/0.log" Jul 01 19:50:14.642896 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:14.642868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wmzrj_1e19faa8-fc50-4426-b8df-0bec292d096f/istio-proxy/0.log" Jul 01 19:50:14.775953 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:14.775924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bs68l_1258ffbd-d916-4b6c-bcc3-f089c100eabe/discovery/0.log" Jul 01 19:50:15.463726 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:15.463674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4496dc6f-dsxlr_af70a0dd-0806-4d7c-a848-f54624ce5f30/router/0.log" Jul 01 19:50:15.916564 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:15.916537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-xwq52_21e47a57-b456-451e-b981-707e2c2224eb/main/0.log" Jul 01 19:50:16.270011 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:16.269934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-fbxdj_88c6c454-8513-48c6-9885-b79d8e77ba15/main/0.log" Jul 01 19:50:23.909247 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:23.909220 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m5f64_787908ec-fa30-4a1e-9780-422791191981/global-pull-secret-syncer/0.log" Jul 01 19:50:24.154808 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:24.154772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hjmmg_bb6effec-d569-4525-b675-4fbed5d1de09/konnectivity-agent/0.log" Jul 01 19:50:24.285943 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:24.285865 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-74.ec2.internal_b82385543037b0c098fe29c9728bddc9/haproxy/0.log" Jul 01 19:50:27.929934 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:27.929893 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b_bfa48c56-9fe7-492d-a943-21a68dfa5369/extract/0.log" Jul 01 19:50:27.966181 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:27.966154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b_bfa48c56-9fe7-492d-a943-21a68dfa5369/util/0.log" Jul 01 19:50:28.002120 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.002100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsx8b_bfa48c56-9fe7-492d-a943-21a68dfa5369/pull/0.log" Jul 01 19:50:28.036934 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.036898 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9_183cfcaf-0ea3-474d-8309-ba14a58c084a/extract/0.log" Jul 01 19:50:28.061961 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.061933 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9_183cfcaf-0ea3-474d-8309-ba14a58c084a/util/0.log" Jul 01 19:50:28.087204 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.087185 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e026pf9_183cfcaf-0ea3-474d-8309-ba14a58c084a/pull/0.log" Jul 01 19:50:28.120318 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.120213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k_14c75aeb-8b7a-4545-baa3-ee2f67099a69/extract/0.log" Jul 01 19:50:28.149399 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.149361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k_14c75aeb-8b7a-4545-baa3-ee2f67099a69/util/0.log" Jul 01 19:50:28.183609 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.183584 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cr75k_14c75aeb-8b7a-4545-baa3-ee2f67099a69/pull/0.log" Jul 01 19:50:28.234987 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.234962 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764_818d5f18-b911-4ba3-81ff-a314d7ab8f53/extract/0.log" Jul 01 19:50:28.271090 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.271064 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764_818d5f18-b911-4ba3-81ff-a314d7ab8f53/util/0.log" Jul 01 19:50:28.303206 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.303184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z9764_818d5f18-b911-4ba3-81ff-a314d7ab8f53/pull/0.log" Jul 01 19:50:28.682578 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:28.682545 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vsfj4_b28aac01-c4d4-4433-9c28-f19d24dc8d20/limitador/0.log" Jul 01 19:50:30.388946 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:30.388918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-7ndg4_3f7f1f36-5ade-41e8-aa35-f0a1c17b33d8/cluster-monitoring-operator/0.log" Jul 01 19:50:30.913464 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:30.913434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5dgbf_e9677d0d-bb55-4ceb-96ff-17208ecd906e/node-exporter/0.log" Jul 01 19:50:30.947235 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:30.947207 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5dgbf_e9677d0d-bb55-4ceb-96ff-17208ecd906e/kube-rbac-proxy/0.log" Jul 01 19:50:30.978366 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:30.978343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5dgbf_e9677d0d-bb55-4ceb-96ff-17208ecd906e/init-textfile/0.log" Jul 01 19:50:33.006257 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:33.006230 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-qzbps_4818e1a6-8504-4b15-82e1-9afcc0533aae/networking-console-plugin/0.log" Jul 01 19:50:33.724723 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:33.724690 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/2.log" Jul 01 19:50:33.730249 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:33.730222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-pgw4w_0f83142e-57df-4a86-ab83-16aab214cba1/console-operator/3.log" Jul 01 19:50:34.022619 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.022531 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx"] Jul 01 19:50:34.026186 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.026163 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.029713 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.029675 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jksd4\"/\"kube-root-ca.crt\"" Jul 01 19:50:34.029713 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.029679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jksd4\"/\"openshift-service-ca.crt\"" Jul 01 19:50:34.030659 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.030638 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jksd4\"/\"default-dockercfg-cc7rg\"" Jul 01 19:50:34.039279 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.039253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx"] Jul 01 19:50:34.100874 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.100826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-lib-modules\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.101039 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.100929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-sys\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.101039 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.101002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-podres\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.101039 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.101022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnv2\" (UniqueName: \"kubernetes.io/projected/e01b4c05-3e31-4862-a94d-8e798bcf4948-kube-api-access-4rnv2\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.101150 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.101083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-proc\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201775 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-proc\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-lib-modules\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-sys\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-podres\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnv2\" (UniqueName: \"kubernetes.io/projected/e01b4c05-3e31-4862-a94d-8e798bcf4948-kube-api-access-4rnv2\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-proc\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-sys\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.201984 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.201955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-lib-modules\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.202232 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.202010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e01b4c05-3e31-4862-a94d-8e798bcf4948-podres\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.212010 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.211987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnv2\" (UniqueName: \"kubernetes.io/projected/e01b4c05-3e31-4862-a94d-8e798bcf4948-kube-api-access-4rnv2\") pod \"perf-node-gather-daemonset-p5jnx\" (UID: \"e01b4c05-3e31-4862-a94d-8e798bcf4948\") " pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.337889 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.337785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.363366 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.363342 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58bbd765cb-swhpt_c6ff3499-bdc0-447f-95c9-2ed372be0b6d/console/0.log" Jul 01 19:50:34.397098 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.397072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-qfdnc_ddcc2406-704d-4b18-8253-c79affbe2752/download-server/0.log" Jul 01 19:50:34.482426 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.482399 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx"] Jul 01 19:50:34.483705 ip-10-0-128-74 kubenswrapper[2563]: W0701 19:50:34.483676 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode01b4c05_3e31_4862_a94d_8e798bcf4948.slice/crio-98b8a3f932e3077029a9edce0e560213abfbc79b28bb71348c7c340bad84420a WatchSource:0}: Error finding container 98b8a3f932e3077029a9edce0e560213abfbc79b28bb71348c7c340bad84420a: Status 404 returned error can't find the container with id 98b8a3f932e3077029a9edce0e560213abfbc79b28bb71348c7c340bad84420a Jul 01 19:50:34.879263 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.879172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" event={"ID":"e01b4c05-3e31-4862-a94d-8e798bcf4948","Type":"ContainerStarted","Data":"5a2506dcd3cdb6bf7398fcbf1e223ce61087e612d1a6d95d63326dfb6fcb3a1f"} Jul 01 19:50:34.879263 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.879225 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:34.879263 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.879242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" event={"ID":"e01b4c05-3e31-4862-a94d-8e798bcf4948","Type":"ContainerStarted","Data":"98b8a3f932e3077029a9edce0e560213abfbc79b28bb71348c7c340bad84420a"} Jul 01 19:50:34.898381 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:34.898332 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" podStartSLOduration=0.898315765 podStartE2EDuration="898.315765ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:50:34.89564418 +0000 UTC m=+945.165628883" watchObservedRunningTime="2026-07-01 19:50:34.898315765 +0000 UTC m=+945.168300456" Jul 01 19:50:35.061650 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:35.061612 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-nj5ss_30672345-743c-4dab-8d4d-b17ad77892f7/volume-data-source-validator/0.log" Jul 01 19:50:36.186739 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:36.186694 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xcrmt_287f889d-ee47-4ded-aeb7-8658f75ed31d/dns/0.log" Jul 01 19:50:36.206982 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:36.206943 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xcrmt_287f889d-ee47-4ded-aeb7-8658f75ed31d/kube-rbac-proxy/0.log" Jul 01 19:50:36.263087 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:36.263055 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fp5fb_258d8ce3-b66c-4974-bbe2-983e951cbb8b/dns-node-resolver/0.log" Jul 01 19:50:37.020341 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:37.020293 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lphcd_da278ba8-5895-428d-80cb-a70a14546f9a/node-ca/0.log" Jul 01 19:50:38.119215 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:38.119177 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wmzrj_1e19faa8-fc50-4426-b8df-0bec292d096f/istio-proxy/0.log" Jul 01 19:50:38.167231 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:38.167197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bs68l_1258ffbd-d916-4b6c-bcc3-f089c100eabe/discovery/0.log" Jul 01 19:50:38.323916 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:38.323888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4496dc6f-dsxlr_af70a0dd-0806-4d7c-a848-f54624ce5f30/router/0.log" Jul 01 19:50:38.997502 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:38.997473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptjvk_ec602860-3dba-4d84-a58d-e392eb053e78/serve-healthcheck-canary/0.log" Jul 01 19:50:39.561190 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:39.561156 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-qn2gb_39c8ff20-44a0-4999-8b14-449cfd0cc093/insights-operator/0.log" Jul 01 19:50:39.561691 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:39.561324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-qn2gb_39c8ff20-44a0-4999-8b14-449cfd0cc093/insights-operator/1.log" Jul 01 19:50:39.590631 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:39.590595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mm2t7_7e7f522e-5b27-42bc-bb66-b05fc3285ec7/kube-rbac-proxy/0.log" Jul 01 19:50:39.627001 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:39.626974 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mm2t7_7e7f522e-5b27-42bc-bb66-b05fc3285ec7/exporter/0.log" Jul 01 19:50:39.658613 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:39.658585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mm2t7_7e7f522e-5b27-42bc-bb66-b05fc3285ec7/extractor/0.log" Jul 01 19:50:40.894570 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:40.894546 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jksd4/perf-node-gather-daemonset-p5jnx" Jul 01 19:50:42.102597 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:42.102568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-54759b6cc8-nf9nq_96ec9c8f-4a8e-48d0-bbcb-7606a362e2fb/nginx/0.log" Jul 01 19:50:42.445403 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:42.445367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-gb9s7_3e38e6d6-1674-4955-8cf1-7bd27f99e565/manager/0.log" Jul 01 19:50:42.479246 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:42.479215 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cdd86b5d-gb9s7_3e38e6d6-1674-4955-8cf1-7bd27f99e565/copy-manifests/0.log" Jul 01 19:50:43.747637 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:43.747599 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wmzrj_1e19faa8-fc50-4426-b8df-0bec292d096f/istio-proxy/0.log" Jul 01 19:50:43.785036 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:43.785003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bs68l_1258ffbd-d916-4b6c-bcc3-f089c100eabe/discovery/0.log" Jul 01 19:50:43.902331 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:43.902289 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4496dc6f-dsxlr_af70a0dd-0806-4d7c-a848-f54624ce5f30/router/0.log" Jul 01 19:50:44.501790 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:44.501765 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b64dfc857-qmxs9_49acfc6c-e035-435b-9886-5b7805b30ec6/manager/0.log" Jul 01 19:50:45.020095 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:45.020068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wmzrj_1e19faa8-fc50-4426-b8df-0bec292d096f/istio-proxy/0.log" Jul 01 19:50:45.057667 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:45.057636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bs68l_1258ffbd-d916-4b6c-bcc3-f089c100eabe/discovery/0.log" Jul 01 19:50:45.179560 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:45.179526 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c4496dc6f-dsxlr_af70a0dd-0806-4d7c-a848-f54624ce5f30/router/0.log" Jul 01 19:50:50.094491 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:50.094461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-shvqr_5e9dc957-b331-4959-b98b-72fd2150b1ea/kube-storage-version-migrator-operator/1.log" Jul 01 19:50:50.095399 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:50.095379 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-shvqr_5e9dc957-b331-4959-b98b-72fd2150b1ea/kube-storage-version-migrator-operator/0.log" Jul 01 19:50:51.476677 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:51.476648 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4fhr_d0537be0-fe7b-49e7-b048-3b7a553bd4c2/kube-multus-additional-cni-plugins/0.log" Jul 01 19:50:51.500731 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:51.500708 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4fhr_d0537be0-fe7b-49e7-b048-3b7a553bd4c2/egress-router-binary-copy/0.log" Jul 01 19:50:51.524219 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:51.524188 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4fhr_d0537be0-fe7b-49e7-b048-3b7a553bd4c2/cni-plugins/0.log" Jul 01 19:50:51.545052 ip-10-0-128-74 kubenswrapper[2563]: I0701 19:50:51.545019 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4fhr_d0537be0-fe7b-49e7-b048-3b7a553bd4c2/bond-cni-plugin/0.log"