Jul 22 18:11:45.969652 ip-10-0-128-109 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 18:11:45.969663 ip-10-0-128-109 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 18:11:45.969673 ip-10-0-128-109 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 18:11:45.970035 ip-10-0-128-109 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 18:11:56.824784 ip-10-0-128-109 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 22 18:11:56.824798 ip-10-0-128-109 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 083d4825cca943558b0cdb58fdb91a54 -- Jul 22 18:13:46.621948 ip-10-0-128-109 systemd[1]: Starting Kubernetes Kubelet... Jul 22 18:13:46.946601 ip-10-0-128-109 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:13:46.946601 ip-10-0-128-109 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 18:13:46.946601 ip-10-0-128-109 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:13:46.946601 ip-10-0-128-109 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 18:13:46.946601 ip-10-0-128-109 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:13:46.947390 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.947291 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 18:13:46.952052 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952033 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:13:46.952052 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952052 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952065 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952068 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952071 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952075 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952078 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952081 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952088 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952091 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952094 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952097 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952099 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952102 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952105 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952107 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952110 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952113 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952115 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952118 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:13:46.952124 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952121 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952124 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952126 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952129 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952132 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952135 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952138 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952141 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952143 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952146 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952149 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952152 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952154 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952156 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952159 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952162 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952164 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952167 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952169 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952179 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:13:46.952574 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952183 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952186 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952189 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952192 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952195 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952198 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952201 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952203 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952206 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952208 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952213 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952217 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952220 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952223 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952226 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952229 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952232 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952235 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952238 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:13:46.953078 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952241 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952244 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952247 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952250 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952252 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952257 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952260 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952264 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952266 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952269 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952271 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952274 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952277 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952286 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952289 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952291 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952294 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952298 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952300 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952303 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:13:46.953546 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952306 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952310 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952312 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952315 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952317 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952321 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952323 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952326 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952328 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952331 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952333 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952336 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952338 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952341 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952343 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952346 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952349 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952351 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952354 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.952356 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:13:46.954043 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953106 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953113 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953115 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953118 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953121 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953124 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953127 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953130 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953133 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953136 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953138 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953141 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953144 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953148 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953151 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953154 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953156 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953159 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953162 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953164 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:13:46.954516 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953167 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953170 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953172 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953175 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953178 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953180 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953183 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953186 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953188 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953191 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953193 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953196 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953199 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953202 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953206 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953210 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953213 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953217 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953221 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:13:46.955058 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953224 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953227 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953230 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953233 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953236 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953239 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953242 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953244 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953247 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953250 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953253 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953255 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953258 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953261 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953263 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953266 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953268 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953271 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953275 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:13:46.955527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953277 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953280 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953283 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953295 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953299 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953301 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953304 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953307 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953310 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953313 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953315 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953318 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953321 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953323 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953327 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953330 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953333 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953335 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953338 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953341 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:13:46.956104 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953344 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953346 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953349 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953352 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953354 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953358 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953362 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953365 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953368 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953371 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953373 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953376 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953379 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953382 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953384 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953387 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953389 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953392 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953394 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953397 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:13:46.956586 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953399 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953801 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953807 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953810 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953812 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953815 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953819 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953822 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953824 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953827 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953830 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953833 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953836 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953838 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953841 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953844 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953847 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953851 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953855 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:13:46.957218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953858 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953861 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953864 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953869 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953874 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953879 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953884 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953910 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953937 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953942 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953946 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953949 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953953 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953956 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953959 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953962 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953967 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953969 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953972 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953976 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:13:46.957897 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953979 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953982 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953985 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953987 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953990 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953996 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.953999 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954002 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954004 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954007 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954010 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954012 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954015 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954017 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954020 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954024 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954027 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954029 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954032 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954035 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:13:46.958402 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954039 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954042 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954045 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954048 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954051 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954054 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954057 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954060 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954062 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954065 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954068 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954071 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954074 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954076 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954079 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954082 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954084 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954087 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954090 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954092 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:13:46.958940 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954095 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954097 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954100 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954103 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954105 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954108 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954110 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954113 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954118 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954121 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954124 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954127 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954130 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954133 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954138 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954142 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954145 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954148 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954151 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954154 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:13:46.959424 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954156 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954243 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954255 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954267 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954272 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954277 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954281 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954286 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954290 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954293 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954296 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954300 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954303 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954307 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954309 2562 flags.go:64] FLAG: --cgroup-root="" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954312 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954315 2562 flags.go:64] FLAG: --client-ca-file="" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954318 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954321 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954325 2562 flags.go:64] FLAG: --cluster-domain="" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954328 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954331 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954335 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954339 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 18:13:46.959963 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954344 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954347 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954350 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954354 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954357 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954360 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954363 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954367 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954369 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954374 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954377 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954380 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954383 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954386 2562 flags.go:64] FLAG: --enable-server="true" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954389 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954394 2562 flags.go:64] FLAG: --event-burst="100" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954397 2562 flags.go:64] FLAG: --event-qps="50" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954400 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954403 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954406 2562 flags.go:64] FLAG: --eviction-hard="" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954410 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954413 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954416 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954420 2562 flags.go:64] FLAG: --eviction-soft="" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954423 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 18:13:46.960528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954426 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954429 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954432 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954435 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954438 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954441 2562 flags.go:64] FLAG: --feature-gates="" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954445 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954452 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954455 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954458 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954462 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954465 2562 flags.go:64] FLAG: --help="false" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954468 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-109.ec2.internal" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954472 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954475 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954478 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954481 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954486 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954489 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954492 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954495 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954498 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954501 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954504 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 18:13:46.961161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954507 2562 flags.go:64] FLAG: --kube-reserved="" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954510 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954513 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954516 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954519 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954524 2562 flags.go:64] FLAG: --lock-file="" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954527 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954530 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954533 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954538 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954542 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954545 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954547 2562 flags.go:64] FLAG: --logging-format="text" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954551 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954554 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954557 2562 flags.go:64] FLAG: --manifest-url="" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954560 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954565 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954569 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954573 2562 flags.go:64] FLAG: --max-pods="110" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954577 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954580 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954583 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954585 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954588 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 18:13:46.961780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954591 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954595 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954603 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954607 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954610 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954613 2562 flags.go:64] FLAG: --pod-cidr="" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954616 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954622 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954625 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954628 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954631 2562 flags.go:64] FLAG: --port="10250" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954634 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954638 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03b7bb3144dd21ce8" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954642 2562 flags.go:64] FLAG: --qos-reserved="" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954658 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954662 2562 flags.go:64] FLAG: --register-node="true" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954665 2562 flags.go:64] FLAG: --register-with-taints="" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954669 2562 flags.go:64] FLAG: --registry-burst="10" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954672 2562 flags.go:64] FLAG: --registry-qps="5" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954674 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954677 2562 flags.go:64] FLAG: --reserved-memory="" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954681 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954685 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954688 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954691 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 18:13:46.962395 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954694 2562 flags.go:64] FLAG: --runonce="false" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954697 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954701 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954704 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954707 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954710 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954713 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954716 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954719 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954722 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954725 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954728 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954731 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954734 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954736 2562 flags.go:64] FLAG: --system-cgroups="" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954739 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954745 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954748 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954750 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954755 2562 flags.go:64] FLAG: --tls-min-version="" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954758 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954761 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954765 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954767 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954770 2562 flags.go:64] FLAG: --v="2" Jul 22 18:13:46.963203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954774 2562 flags.go:64] FLAG: --version="false" Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954778 2562 flags.go:64] FLAG: --vmodule="" Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954782 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.954786 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954906 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954910 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954914 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954918 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954922 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954925 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954927 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954931 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954933 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954936 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954939 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954941 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954944 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954947 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954949 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954952 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:13:46.964412 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954954 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954957 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954959 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954962 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954964 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954967 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954972 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954975 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954978 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954980 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954983 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954985 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954988 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954990 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954993 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954995 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.954998 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955001 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955004 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955006 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:13:46.965262 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955009 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955012 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955014 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955017 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955020 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955022 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955025 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955027 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955030 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955032 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955035 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955037 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955040 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955043 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955045 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955048 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955050 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955053 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955057 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955059 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:13:46.966164 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955062 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955065 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955067 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955071 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955074 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955077 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955080 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955082 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955085 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955088 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955090 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955093 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955095 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955098 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955100 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955103 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955105 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955110 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955114 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:13:46.966925 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955117 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955120 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955122 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955125 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955127 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955130 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955133 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955135 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955138 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955140 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955143 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955147 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955149 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955153 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955157 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955160 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955164 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955167 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955169 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:13:46.967440 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955172 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955175 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955177 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955180 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.955182 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.955663 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.965166 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.965190 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.965219 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.965228 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965319 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965329 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965334 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965339 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965343 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:13:46.968063 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965348 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965352 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965357 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965361 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965366 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965370 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965374 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965379 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965383 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965387 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965391 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965395 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965400 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965404 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965409 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965413 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965418 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965422 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965427 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965430 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965435 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:13:46.968689 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965439 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965444 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965448 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965454 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965458 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965463 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965467 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965471 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965475 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965479 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965483 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965488 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965492 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965496 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965503 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965509 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965513 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965518 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965523 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:13:46.969201 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965528 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965532 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965536 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965541 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965545 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965549 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965553 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965557 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965562 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965566 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965570 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965574 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965579 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965583 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965587 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965591 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965596 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965600 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965604 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965609 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:13:46.969961 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965613 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965617 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965621 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965625 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965630 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965633 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965637 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965641 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965665 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965670 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965675 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965679 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965684 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965688 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965693 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965697 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965703 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965707 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965711 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965716 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:13:46.970639 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965720 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965725 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965729 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965734 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965738 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965742 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965746 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965753 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965761 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965768 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965773 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965777 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965781 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965786 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:13:46.971272 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.965794 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965974 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965981 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965986 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965991 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.965996 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966000 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966005 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966009 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966014 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966018 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966022 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966026 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966032 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966035 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966039 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966044 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966048 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966052 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966056 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:13:46.971638 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966060 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966064 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966069 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966073 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966076 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966081 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966085 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966090 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966096 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966100 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966104 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966108 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966113 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966117 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966122 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966126 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966130 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966134 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966139 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966143 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:13:46.972207 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966147 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966151 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966155 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966159 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966163 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966167 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966172 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966176 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966180 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966184 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966189 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966193 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966198 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966202 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966207 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966211 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966215 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966219 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966224 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:13:46.972783 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966229 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966233 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966237 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966242 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966249 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966255 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966259 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966264 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966268 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966272 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966277 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966281 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966288 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966294 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966299 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966304 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966309 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966313 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966318 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:13:46.973323 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966323 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966329 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966333 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966337 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966341 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966345 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966350 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966354 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966358 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966362 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966366 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966371 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966376 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966381 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966385 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966389 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966393 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966397 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966401 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966406 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:13:46.973841 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966411 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:46.966415 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.966424 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.966638 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.970989 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.972258 2562 server.go:1019] "Starting client certificate rotation" Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.972366 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 18:13:46.974338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.972404 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 18:13:46.975886 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.975868 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 18:13:46.977301 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.977275 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 18:13:46.986008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.985993 2562 log.go:25] "Validated CRI v1 runtime API" Jul 22 18:13:46.989019 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.989003 2562 log.go:25] "Validated CRI v1 image API" Jul 22 18:13:46.990985 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.990968 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 18:13:46.993216 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.993197 2562 fs.go:135] Filesystem UUIDs: map[170afca2-9267-4bc3-9aaa-53f07ead741d:/dev/nvme0n1p3 74608ce8-e600-4015-b5a7-cdb10e6e61fb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 22 18:13:46.993275 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.993216 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 18:13:46.998452 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.998335 2562 manager.go:216] Machine: {Timestamp:2026-07-22 18:13:46.997154719 +0000 UTC m=+0.273581043 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100396 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b92c5d0c6fee1e16526a95acdd70f SystemUUID:ec2b92c5-d0c6-fee1-e165-26a95acdd70f BootID:083d4825-cca9-4355-8b0c-db58fdb91a54 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:1d:52:94:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:1d:52:94:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:a4:66:01:05:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 18:13:46.998452 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.998446 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 18:13:46.998574 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:46.998519 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 18:13:47.001159 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.001135 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 18:13:47.001297 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.001163 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 18:13:47.002300 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.002288 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 18:13:47.002300 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.002302 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 18:13:47.002375 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.002310 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 18:13:47.002861 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.002850 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 18:13:47.003715 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.003698 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 18:13:47.004076 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.004064 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 18:13:47.007899 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.007887 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 22 18:13:47.008029 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008020 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 18:13:47.008062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008051 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 22 18:13:47.008091 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008074 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 18:13:47.008120 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008097 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 18:13:47.008120 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008110 2562 kubelet.go:398] "Adding apiserver pod source" Jul 22 18:13:47.008177 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008122 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 18:13:47.008467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008456 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 18:13:47.008507 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.008474 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 18:13:47.010303 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.010284 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 18:13:47.011610 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.011593 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 18:13:47.011736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.011633 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 18:13:47.012749 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012736 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 18:13:47.012814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012757 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 18:13:47.012814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012766 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 18:13:47.012814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012775 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 18:13:47.012814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012789 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 18:13:47.012814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012798 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 18:13:47.012814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012810 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 18:13:47.013008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012820 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 18:13:47.013008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012831 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 18:13:47.013008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012841 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 18:13:47.013008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012854 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 18:13:47.013008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.012864 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 18:13:47.013532 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.013521 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 18:13:47.013588 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.013534 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 18:13:47.016611 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.016596 2562 server.go:1268] "Started kubelet" Jul 22 18:13:47.016767 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.016705 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 18:13:47.016815 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.016792 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 18:13:47.016898 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.016874 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 18:13:47.017343 ip-10-0-128-109 systemd[1]: Started Kubernetes Kubelet. Jul 22 18:13:47.018437 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.018371 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 18:13:47.019164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.019145 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 22 18:13:47.019279 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.019230 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 18:13:47.020727 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.020698 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 18:13:47.020829 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.020810 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 18:13:47.021703 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.021678 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 18:13:47.023665 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.022835 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-109.ec2.internal.18c4af3c9152a0b8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-109.ec2.internal,UID:ip-10-0-128-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-109.ec2.internal,},FirstTimestamp:2026-07-22 18:13:47.016569016 +0000 UTC m=+0.292995339,LastTimestamp:2026-07-22 18:13:47.016569016 +0000 UTC m=+0.292995339,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-109.ec2.internal,}" Jul 22 18:13:47.025337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.025318 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 18:13:47.025337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.025332 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 18:13:47.025471 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.025403 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.025914 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.025868 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 18:13:47.025914 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.025908 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 18:13:47.026042 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.025869 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 18:13:47.026042 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026030 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 22 18:13:47.026042 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026038 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 22 18:13:47.026165 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026139 2562 factory.go:55] Registering systemd factory Jul 22 18:13:47.026165 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026156 2562 factory.go:223] Registration of the systemd container factory successfully Jul 22 18:13:47.026378 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026365 2562 factory.go:153] Registering CRI-O factory Jul 22 18:13:47.026378 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026379 2562 factory.go:223] Registration of the crio container factory successfully Jul 22 18:13:47.026481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026428 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 18:13:47.026481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026450 2562 factory.go:103] Registering Raw factory Jul 22 18:13:47.026481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026461 2562 manager.go:1196] Started watching for new ooms in manager Jul 22 18:13:47.027011 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.026998 2562 manager.go:349] Starting recovery of all containers Jul 22 18:13:47.027369 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.027349 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 18:13:47.027456 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.027440 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 18:13:47.035243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.035224 2562 manager.go:354] Recovery completed Jul 22 18:13:47.039976 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.039956 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.041678 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.041635 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.041748 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.041700 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.041748 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.041716 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.042353 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.042341 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.042713 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.042700 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 18:13:47.042761 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.042714 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 18:13:47.042761 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.042729 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 22 18:13:47.043078 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.043063 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.043114 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.043092 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.043114 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.043102 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.043855 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.043785 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-109.ec2.internal.18c4af3c92d1c30f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-109.ec2.internal,UID:ip-10-0-128-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-109.ec2.internal,},FirstTimestamp:2026-07-22 18:13:47.041678095 +0000 UTC m=+0.318104425,LastTimestamp:2026-07-22 18:13:47.041678095 +0000 UTC m=+0.318104425,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-109.ec2.internal,}" Jul 22 18:13:47.044860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.044849 2562 policy_none.go:49] "None policy: Start" Jul 22 18:13:47.044893 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.044866 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 18:13:47.044893 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.044876 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 18:13:47.046879 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.046866 2562 policy_none.go:47] "Start" Jul 22 18:13:47.048133 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.048107 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6n5h" Jul 22 18:13:47.052282 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.052214 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-109.ec2.internal.18c4af3c92d2384b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-109.ec2.internal,UID:ip-10-0-128-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-109.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-109.ec2.internal,},FirstTimestamp:2026-07-22 18:13:47.041708107 +0000 UTC m=+0.318134432,LastTimestamp:2026-07-22 18:13:47.041708107 +0000 UTC m=+0.318134432,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-109.ec2.internal,}" Jul 22 18:13:47.054737 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.054676 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-109.ec2.internal.18c4af3c92d26a85 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-109.ec2.internal,UID:ip-10-0-128-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-109.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-109.ec2.internal,},FirstTimestamp:2026-07-22 18:13:47.041720965 +0000 UTC m=+0.318147292,LastTimestamp:2026-07-22 18:13:47.041720965 +0000 UTC m=+0.318147292,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-109.ec2.internal,}" Jul 22 18:13:47.056058 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.056045 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6n5h" Jul 22 18:13:47.063518 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.063408 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-109.ec2.internal.18c4af3c92d1c30f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-109.ec2.internal.18c4af3c92d1c30f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-109.ec2.internal,UID:ip-10-0-128-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-109.ec2.internal,},FirstTimestamp:2026-07-22 18:13:47.041678095 +0000 UTC m=+0.318104425,LastTimestamp:2026-07-22 18:13:47.043079624 +0000 UTC m=+0.319505947,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-109.ec2.internal,}" Jul 22 18:13:47.080287 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080273 2562 manager.go:337] "Starting Device Plugin manager" Jul 22 18:13:47.080357 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.080305 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 18:13:47.080357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080315 2562 server.go:87] "Starting device plugin registration server" Jul 22 18:13:47.080554 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080543 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 18:13:47.080615 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080557 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 18:13:47.080670 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080624 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 18:13:47.080733 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080720 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 18:13:47.080782 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.080734 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 18:13:47.081211 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.081195 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 18:13:47.081299 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.081245 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.154217 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.154189 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 18:13:47.156363 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.155527 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 18:13:47.156363 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.155565 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 18:13:47.156363 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.155585 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 18:13:47.156363 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.155615 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 18:13:47.158035 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.158020 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:13:47.181109 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.181090 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.181835 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.181821 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.181888 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.181851 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.181888 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.181861 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.181888 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.181885 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.191003 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.190989 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.191043 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.191010 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-109.ec2.internal\": node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.221212 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.221167 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.255706 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.255687 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal"] Jul 22 18:13:47.255758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.255740 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.257080 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.257067 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.257137 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.257092 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.257137 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.257102 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.259344 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.259332 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.259464 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.259451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.259499 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.259478 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.259982 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.259968 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.260040 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.259988 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.260040 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.260000 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.260542 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.260525 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.260614 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.260556 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.260614 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.260568 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.262814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.262800 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.262880 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.262826 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:47.263422 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.263406 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:47.263501 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.263433 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:47.263501 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.263448 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:47.281293 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.281263 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-109.ec2.internal\" not found" node="ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.285606 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.285590 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-109.ec2.internal\" not found" node="ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.321729 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.321706 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.328454 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.328431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93b88c9554c3d1c5c57b49c2ee4f8f5e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-109.ec2.internal\" (UID: \"93b88c9554c3d1c5c57b49c2ee4f8f5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.328541 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.328459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6979e07120a9f54f8d29e294507849f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal\" (UID: \"6979e07120a9f54f8d29e294507849f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.328541 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.328483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6979e07120a9f54f8d29e294507849f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal\" (UID: \"6979e07120a9f54f8d29e294507849f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.422497 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.422476 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.428849 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.428835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6979e07120a9f54f8d29e294507849f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal\" (UID: \"6979e07120a9f54f8d29e294507849f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.428895 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.428858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93b88c9554c3d1c5c57b49c2ee4f8f5e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-109.ec2.internal\" (UID: \"93b88c9554c3d1c5c57b49c2ee4f8f5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.428895 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.428874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6979e07120a9f54f8d29e294507849f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal\" (UID: \"6979e07120a9f54f8d29e294507849f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.428971 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.428908 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6979e07120a9f54f8d29e294507849f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal\" (UID: \"6979e07120a9f54f8d29e294507849f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.428971 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.428932 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6979e07120a9f54f8d29e294507849f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal\" (UID: \"6979e07120a9f54f8d29e294507849f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.428971 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.428954 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93b88c9554c3d1c5c57b49c2ee4f8f5e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-109.ec2.internal\" (UID: \"93b88c9554c3d1c5c57b49c2ee4f8f5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.523250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.523199 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.583700 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.583679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.589406 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.589393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:47.624104 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.624079 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.724540 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.724514 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.825067 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.825006 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.926101 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:47.926060 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:47.972953 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.972909 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 18:13:47.973445 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:47.973119 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 18:13:48.024508 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.024482 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:13:48.026215 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:48.026196 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:48.053561 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.053539 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:13:48.056607 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.056583 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:13:48.056757 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.056619 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:13:48.056757 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.056630 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:13:48.066453 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.066424 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 18:08:47 +0000 UTC" deadline="2028-04-24 22:53:01.148439808 +0000 UTC" Jul 22 18:13:48.066453 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.066452 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15412h39m13.081992238s" Jul 22 18:13:48.127250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:48.127188 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:48.191707 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:48.191664 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b88c9554c3d1c5c57b49c2ee4f8f5e.slice/crio-f8888c766436f9c5de398648ba3e97fb65793fa32475d7c9976f592183160cf2 WatchSource:0}: Error finding container f8888c766436f9c5de398648ba3e97fb65793fa32475d7c9976f592183160cf2: Status 404 returned error can't find the container with id f8888c766436f9c5de398648ba3e97fb65793fa32475d7c9976f592183160cf2 Jul 22 18:13:48.196627 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.196613 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:13:48.227794 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:48.227766 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:48.272129 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:48.272104 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6979e07120a9f54f8d29e294507849f7.slice/crio-2f51e7464ffc62df93adb471fa41ec44a340c1a1306dd4f27ca285256053397b WatchSource:0}: Error finding container 2f51e7464ffc62df93adb471fa41ec44a340c1a1306dd4f27ca285256053397b: Status 404 returned error can't find the container with id 2f51e7464ffc62df93adb471fa41ec44a340c1a1306dd4f27ca285256053397b Jul 22 18:13:48.328197 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:48.328166 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:48.344375 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.344355 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:13:48.429145 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:48.429074 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-109.ec2.internal\" not found" Jul 22 18:13:48.514440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.514414 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:13:48.526516 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.526490 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" Jul 22 18:13:48.536217 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.536193 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 18:13:48.537131 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.537116 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" Jul 22 18:13:48.548195 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:48.548178 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 18:13:49.009581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.009470 2562 apiserver.go:52] "Watching apiserver" Jul 22 18:13:49.026743 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.026038 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 18:13:49.026743 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.026111 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 18:13:49.027304 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.027270 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal","openshift-dns/node-resolver-5cxjn","openshift-multus/multus-additional-cni-plugins-b4sch","openshift-multus/multus-cdhmc","openshift-network-operator/iptables-alerter-pwz4t","kube-system/konnectivity-agent-kjcz9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w","openshift-cluster-node-tuning-operator/tuned-sq7b8","openshift-image-registry/node-ca-8hv67","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal","openshift-multus/network-metrics-daemon-ghgbv","openshift-network-diagnostics/network-check-target-wg2fk","openshift-ovn-kubernetes/ovnkube-node-882h7","kube-system/global-pull-secret-syncer-4tw4p"] Jul 22 18:13:49.028500 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.028351 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:13:49.030269 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.030247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.033169 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.033146 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 18:13:49.034509 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.033245 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.035243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.033314 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.035243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.033357 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2h4mf\"" Jul 22 18:13:49.035243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.033499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.036172 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.036039 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 18:13:49.036497 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.036476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.037581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.037506 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.037675 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.037588 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hwr9n\"" Jul 22 18:13:49.037805 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.037787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 18:13:49.038030 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038008 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 18:13:49.038267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038250 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.038342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038309 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 18:13:49.038619 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038573 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 18:13:49.038735 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 18:13:49.039273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038860 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 18:13:49.039273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.038892 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kl2g5\"" Jul 22 18:13:49.039273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.039115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 18:13:49.039273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.039220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.039273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.039262 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.039567 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.039419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.041519 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.041480 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 18:13:49.041837 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.041818 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sp49p\"" Jul 22 18:13:49.042107 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.042083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.044218 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.044195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.044484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.044464 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.044581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.044564 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zkw2v\"" Jul 22 18:13:49.044755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.044733 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 18:13:49.044922 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.044907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.047586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.046532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.047586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.047102 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wb8c\"" Jul 22 18:13:49.047586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.047281 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 18:13:49.047586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.047421 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 18:13:49.048840 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.048823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.049062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.049037 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 18:13:49.049402 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.049380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.049510 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.049460 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:13:49.049761 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.049721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-25p2h\"" Jul 22 18:13:49.049761 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.049732 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.052481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.052460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.054161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.054142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.055318 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.055292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.055618 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.055597 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.055759 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.055734 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rbclh\"" Jul 22 18:13:49.056315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.056297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:13:49.056833 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.056811 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2r2k\"" Jul 22 18:13:49.059672 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.057516 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 18:13:49.061013 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.060991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.061245 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.061215 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:13:49.061313 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.061294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:49.061443 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.061406 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:13:49.062099 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.062080 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pvk62" Jul 22 18:13:49.069126 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.069105 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pvk62" Jul 22 18:13:49.127460 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.127430 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 18:13:49.139830 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-systemd\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovnkube-config\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcebec5d-8358-41d6-be65-79739fcafc95-cni-binary-copy\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysctl-conf\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-system-cni-dir\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-cni-bin\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-serviceca\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.139967 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/69d56011-97b9-4ee8-afe8-70eb144ffa91-hosts-file\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cb6350b-8d97-49e9-93ed-99852b8a9846-host-slash\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.139995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysconfig\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-run\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-lib-modules\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-slash\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-cnibin\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-netns\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-hostroot\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzpl\" (UniqueName: \"kubernetes.io/projected/bcebec5d-8358-41d6-be65-79739fcafc95-kube-api-access-fxzpl\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-host\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-kubernetes\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-287qq\" (UniqueName: \"kubernetes.io/projected/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-kube-api-access-287qq\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-os-release\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-var-lib-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv6lf\" (UniqueName: \"kubernetes.io/projected/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-kube-api-access-zv6lf\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.140245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/841e7253-7266-400b-bf70-a26159dd5811-dbus\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5lj\" (UniqueName: \"kubernetes.io/projected/69d56011-97b9-4ee8-afe8-70eb144ffa91-kube-api-access-7r5lj\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-socket-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-sys-fs\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-systemd\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-var-lib-kubelet\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cnibin\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovnkube-script-lib\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-k8s-cni-cncf-io\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgsm\" (UniqueName: \"kubernetes.io/projected/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-kube-api-access-zjgsm\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-registration-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a15ecf2-1500-4bcb-9afd-4117ed026545-konnectivity-ca\") pod \"konnectivity-agent-kjcz9\" (UID: \"6a15ecf2-1500-4bcb-9afd-4117ed026545\") " pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysctl-d\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-run-ovn-kubernetes\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.140822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-host\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-cni-multus\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79b9013f-b904-4842-912f-072c58ee258b-etc-tuned\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-kubelet\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-cni-bin\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovn-node-metrics-cert\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/841e7253-7266-400b-bf70-a26159dd5811-kubelet-config\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-device-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a15ecf2-1500-4bcb-9afd-4117ed026545-agent-certs\") pod \"konnectivity-agent-kjcz9\" (UID: \"6a15ecf2-1500-4bcb-9afd-4117ed026545\") " pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdg95\" (UniqueName: \"kubernetes.io/projected/79b9013f-b904-4842-912f-072c58ee258b-kube-api-access-vdg95\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-systemd-units\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcebec5d-8358-41d6-be65-79739fcafc95-multus-daemon-config\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.141360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9cb6350b-8d97-49e9-93ed-99852b8a9846-iptables-alerter-script\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpp9x\" (UniqueName: \"kubernetes.io/projected/9cb6350b-8d97-49e9-93ed-99852b8a9846-kube-api-access-bpp9x\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79b9013f-b904-4842-912f-072c58ee258b-tmp\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-ovn\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-cni-netd\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.140973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-etc-kubernetes\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69d56011-97b9-4ee8-afe8-70eb144ffa91-tmp-dir\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqpd\" (UniqueName: \"kubernetes.io/projected/ce166cb2-e97b-4723-8510-978686ac1f3c-kube-api-access-fvqpd\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-log-socket\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-system-cni-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-cni-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-run-netns\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-env-overrides\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141213 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-conf-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-etc-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-node-log\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-os-release\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-socket-dir-parent\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-kubelet\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-multus-certs\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-modprobe-d\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-sys\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.142949 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.141471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw8p5\" (UniqueName: \"kubernetes.io/projected/c996f33e-649f-4022-8b76-2ee8f365222e-kube-api-access-pw8p5\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.162373 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.162322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" event={"ID":"6979e07120a9f54f8d29e294507849f7","Type":"ContainerStarted","Data":"2f51e7464ffc62df93adb471fa41ec44a340c1a1306dd4f27ca285256053397b"} Jul 22 18:13:49.165883 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.165859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" event={"ID":"93b88c9554c3d1c5c57b49c2ee4f8f5e","Type":"ContainerStarted","Data":"f8888c766436f9c5de398648ba3e97fb65793fa32475d7c9976f592183160cf2"} Jul 22 18:13:49.242634 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.242634 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9cb6350b-8d97-49e9-93ed-99852b8a9846-iptables-alerter-script\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpp9x\" (UniqueName: \"kubernetes.io/projected/9cb6350b-8d97-49e9-93ed-99852b8a9846-kube-api-access-bpp9x\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79b9013f-b904-4842-912f-072c58ee258b-tmp\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-ovn\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-cni-netd\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.242837 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:49.242860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-etc-kubernetes\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.243245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69d56011-97b9-4ee8-afe8-70eb144ffa91-tmp-dir\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.243245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqpd\" (UniqueName: \"kubernetes.io/projected/ce166cb2-e97b-4723-8510-978686ac1f3c-kube-api-access-fvqpd\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.243245 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.242919 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:13:49.742901187 +0000 UTC m=+3.019327513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:49.243399 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.243278 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 18:13:49.243586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.243558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9cb6350b-8d97-49e9-93ed-99852b8a9846-iptables-alerter-script\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.243880 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.243801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.243954 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.243890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-ovn\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.243954 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.243928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-cni-netd\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244080 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244061 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-etc-kubernetes\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244130 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.242954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-log-socket\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244184 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244127 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-log-socket\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244184 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-system-cni-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244184 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-cni-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244312 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.244312 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-run-netns\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244312 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-env-overrides\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-conf-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-etc-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-node-log\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.244424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-os-release\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-socket-dir-parent\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-kubelet\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-multus-certs\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-system-cni-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.244570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-modprobe-d\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-sys\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244707 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-modprobe-d\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw8p5\" (UniqueName: \"kubernetes.io/projected/c996f33e-649f-4022-8b76-2ee8f365222e-kube-api-access-pw8p5\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-systemd\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244826 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-run-netns\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovnkube-config\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.244946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcebec5d-8358-41d6-be65-79739fcafc95-cni-binary-copy\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysctl-conf\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-system-cni-dir\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245064 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69d56011-97b9-4ee8-afe8-70eb144ffa91-tmp-dir\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-cni-bin\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-serviceca\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/69d56011-97b9-4ee8-afe8-70eb144ffa91-hosts-file\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cb6350b-8d97-49e9-93ed-99852b8a9846-host-slash\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysconfig\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-run\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-env-overrides\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245386 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245367 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-conf-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-lib-modules\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-slash\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-etc-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-cnibin\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245479 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-node-log\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-netns\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-hostroot\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245546 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-os-release\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzpl\" (UniqueName: \"kubernetes.io/projected/bcebec5d-8358-41d6-be65-79739fcafc95-kube-api-access-fxzpl\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245592 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-kubelet\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-host\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-kubernetes\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245717 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-socket-dir-parent\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245750 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-multus-certs\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-287qq\" (UniqueName: \"kubernetes.io/projected/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-kube-api-access-287qq\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-os-release\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.245917 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245844 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245872 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-var-lib-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv6lf\" (UniqueName: \"kubernetes.io/projected/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-kube-api-access-zv6lf\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysconfig\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.245961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/841e7253-7266-400b-bf70-a26159dd5811-dbus\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5lj\" (UniqueName: \"kubernetes.io/projected/69d56011-97b9-4ee8-afe8-70eb144ffa91-kube-api-access-7r5lj\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-socket-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246065 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-multus-cni-dir\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-sys-fs\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246330 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-socket-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246344 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-cnibin\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246401 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-slash\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246422 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-run\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246458 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-sys-fs\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-systemd\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-sys\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-systemd\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246636 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-systemd\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.246736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-hostroot\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246862 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-netns\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246933 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-host\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-var-lib-kubelet\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247229 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcebec5d-8358-41d6-be65-79739fcafc95-cni-binary-copy\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.246908 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-kubernetes\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247209 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-lib-modules\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/841e7253-7266-400b-bf70-a26159dd5811-dbus\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247327 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-var-lib-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247398 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/69d56011-97b9-4ee8-afe8-70eb144ffa91-hosts-file\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cnibin\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.247498 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247487 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovnkube-config\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovnkube-script-lib\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247625 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysctl-conf\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-k8s-cni-cncf-io\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgsm\" (UniqueName: \"kubernetes.io/projected/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-kube-api-access-zjgsm\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247793 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-serviceca\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-registration-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247837 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-system-cni-dir\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a15ecf2-1500-4bcb-9afd-4117ed026545-konnectivity-ca\") pod \"konnectivity-agent-kjcz9\" (UID: \"6a15ecf2-1500-4bcb-9afd-4117ed026545\") " pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysctl-d\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247947 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-run-openvswitch\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.248098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.247981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-run-ovn-kubernetes\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248208 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-os-release\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-host\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-registration-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-run-ovn-kubernetes\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248327 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248395 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-run-k8s-cni-cncf-io\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-cni-multus\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248465 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cb6350b-8d97-49e9-93ed-99852b8a9846-host-slash\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-var-lib-kubelet\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248572 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cnibin\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-cni-multus\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79b9013f-b904-4842-912f-072c58ee258b-etc-tuned\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcebec5d-8358-41d6-be65-79739fcafc95-host-var-lib-cni-bin\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.248776 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-kubelet\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-host\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-cni-bin\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248840 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a15ecf2-1500-4bcb-9afd-4117ed026545-konnectivity-ca\") pod \"konnectivity-agent-kjcz9\" (UID: \"6a15ecf2-1500-4bcb-9afd-4117ed026545\") " pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248903 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-kubelet\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248893 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-host-cni-bin\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248934 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.248954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovn-node-metrics-cert\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/841e7253-7266-400b-bf70-a26159dd5811-kubelet-config\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249054 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79b9013f-b904-4842-912f-072c58ee258b-etc-sysctl-d\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249067 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-device-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249102 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovnkube-script-lib\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a15ecf2-1500-4bcb-9afd-4117ed026545-agent-certs\") pod \"konnectivity-agent-kjcz9\" (UID: \"6a15ecf2-1500-4bcb-9afd-4117ed026545\") " pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249131 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/841e7253-7266-400b-bf70-a26159dd5811-kubelet-config\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdg95\" (UniqueName: \"kubernetes.io/projected/79b9013f-b904-4842-912f-072c58ee258b-kube-api-access-vdg95\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-systemd-units\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.249462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249327 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c996f33e-649f-4022-8b76-2ee8f365222e-device-dir\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcebec5d-8358-41d6-be65-79739fcafc95-multus-daemon-config\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-systemd-units\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.249752 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.249919 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.250176 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:49.750128506 +0000 UTC m=+3.026554819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:49.250328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.250299 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcebec5d-8358-41d6-be65-79739fcafc95-multus-daemon-config\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.251531 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.251508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79b9013f-b904-4842-912f-072c58ee258b-tmp\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.253508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpp9x\" (UniqueName: \"kubernetes.io/projected/9cb6350b-8d97-49e9-93ed-99852b8a9846-kube-api-access-bpp9x\") pod \"iptables-alerter-pwz4t\" (UID: \"9cb6350b-8d97-49e9-93ed-99852b8a9846\") " pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.253724 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a15ecf2-1500-4bcb-9afd-4117ed026545-agent-certs\") pod \"konnectivity-agent-kjcz9\" (UID: \"6a15ecf2-1500-4bcb-9afd-4117ed026545\") " pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.253934 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79b9013f-b904-4842-912f-072c58ee258b-etc-tuned\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.254250 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-ovn-node-metrics-cert\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.254608 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.254636 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.254676 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.254748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:49.754722939 +0000 UTC m=+3.031149253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.255365 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw8p5\" (UniqueName: \"kubernetes.io/projected/c996f33e-649f-4022-8b76-2ee8f365222e-kube-api-access-pw8p5\") pod \"aws-ebs-csi-driver-node-fpk6w\" (UID: \"c996f33e-649f-4022-8b76-2ee8f365222e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.256333 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzpl\" (UniqueName: \"kubernetes.io/projected/bcebec5d-8358-41d6-be65-79739fcafc95-kube-api-access-fxzpl\") pod \"multus-cdhmc\" (UID: \"bcebec5d-8358-41d6-be65-79739fcafc95\") " pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.257761 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv6lf\" (UniqueName: \"kubernetes.io/projected/30189d1d-f1c2-4f4c-9208-6cd6c295ca87-kube-api-access-zv6lf\") pod \"ovnkube-node-882h7\" (UID: \"30189d1d-f1c2-4f4c-9208-6cd6c295ca87\") " pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.258103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-287qq\" (UniqueName: \"kubernetes.io/projected/1f6a9bd9-ec12-4d8a-9012-121d69a053e6-kube-api-access-287qq\") pod \"multus-additional-cni-plugins-b4sch\" (UID: \"1f6a9bd9-ec12-4d8a-9012-121d69a053e6\") " pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.258103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqpd\" (UniqueName: \"kubernetes.io/projected/ce166cb2-e97b-4723-8510-978686ac1f3c-kube-api-access-fvqpd\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.258339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5lj\" (UniqueName: \"kubernetes.io/projected/69d56011-97b9-4ee8-afe8-70eb144ffa91-kube-api-access-7r5lj\") pod \"node-resolver-5cxjn\" (UID: \"69d56011-97b9-4ee8-afe8-70eb144ffa91\") " pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.258695 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.258540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgsm\" (UniqueName: \"kubernetes.io/projected/1b59067d-eaf3-43d8-919d-2a6b9c20c6fe-kube-api-access-zjgsm\") pod \"node-ca-8hv67\" (UID: \"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe\") " pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.259579 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.259560 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdg95\" (UniqueName: \"kubernetes.io/projected/79b9013f-b904-4842-912f-072c58ee258b-kube-api-access-vdg95\") pod \"tuned-sq7b8\" (UID: \"79b9013f-b904-4842-912f-072c58ee258b\") " pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.353234 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.353168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" Jul 22 18:13:49.361084 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.361065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b4sch" Jul 22 18:13:49.370694 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.370672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:13:49.376332 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.376314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdhmc" Jul 22 18:13:49.385190 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.385175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwz4t" Jul 22 18:13:49.392767 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.392745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:13:49.400281 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.400265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8hv67" Jul 22 18:13:49.408801 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.408782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5cxjn" Jul 22 18:13:49.413367 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.413351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" Jul 22 18:13:49.753762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.753678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:49.753762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.753722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:49.753942 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.753828 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:49.753942 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.753843 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:49.753942 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.753904 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:13:50.753880355 +0000 UTC m=+4.030306665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:49.753942 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.753928 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:50.753913915 +0000 UTC m=+4.030340227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:49.854850 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:49.854817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:49.855027 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.855009 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:13:49.855098 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.855034 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:13:49.855098 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.855047 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:49.855201 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:49.855116 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:50.855093745 +0000 UTC m=+4.131520068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:50.072366 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:50.072294 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:08:49 +0000 UTC" deadline="2028-04-12 02:28:56.78412597 +0000 UTC" Jul 22 18:13:50.072366 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:50.072324 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15104h15m6.711805658s" Jul 22 18:13:50.155932 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:50.155902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:50.156091 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.156062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:13:50.295784 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:50.295748 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6a9bd9_ec12_4d8a_9012_121d69a053e6.slice/crio-80cf83fb6df9d540cea5e8f7225e266b8509a0d6a559985c01bc618944f89c5f WatchSource:0}: Error finding container 80cf83fb6df9d540cea5e8f7225e266b8509a0d6a559985c01bc618944f89c5f: Status 404 returned error can't find the container with id 80cf83fb6df9d540cea5e8f7225e266b8509a0d6a559985c01bc618944f89c5f Jul 22 18:13:50.301001 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:13:50.300966 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc996f33e_649f_4022_8b76_2ee8f365222e.slice/crio-8c092b03f98e24b41031f1cfd48def4145b79709031b29b63189ac803f483d79 WatchSource:0}: Error finding container 8c092b03f98e24b41031f1cfd48def4145b79709031b29b63189ac803f483d79: Status 404 returned error can't find the container with id 8c092b03f98e24b41031f1cfd48def4145b79709031b29b63189ac803f483d79 Jul 22 18:13:50.761432 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:50.761160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:50.761432 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:50.761387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:50.761624 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.761294 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:50.761624 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.761489 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:50.761624 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.761520 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:52.761492892 +0000 UTC m=+6.037919206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:50.761624 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.761543 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:13:52.761532358 +0000 UTC m=+6.037958678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:50.862355 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:50.862319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:50.862538 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.862475 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:13:50.862538 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.862495 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:13:50.862538 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.862508 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:50.862723 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:50.862566 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:52.862547911 +0000 UTC m=+6.138974245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:51.072729 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.072595 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:08:49 +0000 UTC" deadline="2028-02-26 14:37:35.506726086 +0000 UTC" Jul 22 18:13:51.072729 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.072638 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14012h23m44.434093616s" Jul 22 18:13:51.158406 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.158375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:51.158584 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:51.158515 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:13:51.159020 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.158999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:51.159140 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:51.159114 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:13:51.172026 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.171959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjcz9" event={"ID":"6a15ecf2-1500-4bcb-9afd-4117ed026545","Type":"ContainerStarted","Data":"ed177ad900b1c27fc8292a5a41065783f5974ded87fd0cc091bd4b10a41a9e0e"} Jul 22 18:13:51.174416 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.174305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" event={"ID":"79b9013f-b904-4842-912f-072c58ee258b","Type":"ContainerStarted","Data":"4cb290a12dbf4671657174a086e717dff2f7d6f4e4b17de903a2f111f5c05916"} Jul 22 18:13:51.177763 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.177735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" event={"ID":"c996f33e-649f-4022-8b76-2ee8f365222e","Type":"ContainerStarted","Data":"8c092b03f98e24b41031f1cfd48def4145b79709031b29b63189ac803f483d79"} Jul 22 18:13:51.181052 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.181027 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerStarted","Data":"80cf83fb6df9d540cea5e8f7225e266b8509a0d6a559985c01bc618944f89c5f"} Jul 22 18:13:51.188109 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.188086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" event={"ID":"93b88c9554c3d1c5c57b49c2ee4f8f5e","Type":"ContainerStarted","Data":"0d4d8f813679a00f335c16bb84d41a9e927702e51b7b176792200795b5a15181"} Jul 22 18:13:51.192588 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.192564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8hv67" event={"ID":"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe","Type":"ContainerStarted","Data":"c9e397dd13d8fda667b494623b9bc964fcc7222c6648a27396fc3a729c5d6a80"} Jul 22 18:13:51.195106 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.195083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"11cf78fdf0b8977acf0245d307face1c11471fa4b778a4da9e933a22ce0ee82c"} Jul 22 18:13:51.200396 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.200372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdhmc" event={"ID":"bcebec5d-8358-41d6-be65-79739fcafc95","Type":"ContainerStarted","Data":"20e2f75df0b2670732fb8468758cf03f6f16a77f269d352a2c2ededde286cd50"} Jul 22 18:13:51.204912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.204885 2562 generic.go:356] "Generic (PLEG): container finished" podID="6979e07120a9f54f8d29e294507849f7" containerID="338e2a59c994878329df7c6b945026a37ecd50f21e2e49616779fe63d0659336" exitCode=0 Jul 22 18:13:51.205010 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.204962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" event={"ID":"6979e07120a9f54f8d29e294507849f7","Type":"ContainerDied","Data":"338e2a59c994878329df7c6b945026a37ecd50f21e2e49616779fe63d0659336"} Jul 22 18:13:51.213517 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.212323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwz4t" event={"ID":"9cb6350b-8d97-49e9-93ed-99852b8a9846","Type":"ContainerStarted","Data":"56fb381a070b27f04f3603c0c4a6a36c42dc0d532f9e76c96434b682e53bd2cc"} Jul 22 18:13:51.221148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.221071 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-109.ec2.internal" podStartSLOduration=3.221053856 podStartE2EDuration="3.221053856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:13:51.204601194 +0000 UTC m=+4.481027527" watchObservedRunningTime="2026-07-22 18:13:51.221053856 +0000 UTC m=+4.497480194" Jul 22 18:13:51.221847 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:51.221820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5cxjn" event={"ID":"69d56011-97b9-4ee8-afe8-70eb144ffa91","Type":"ContainerStarted","Data":"df7db6713d95cf51882b9ff4ac9d0f0c6329bda80e189de96a4949576ab220b3"} Jul 22 18:13:52.156358 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:52.155874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:52.156358 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.155999 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:13:52.244913 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:52.244835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" event={"ID":"6979e07120a9f54f8d29e294507849f7","Type":"ContainerStarted","Data":"33cbb330da4bc8a518fa0d4c1b9cf0796c68ce1f5022ba7123e2961f6081bd46"} Jul 22 18:13:52.782611 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:52.782571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:52.782795 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:52.782618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:52.782867 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.782807 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:52.782928 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.782871 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:13:56.782850846 +0000 UTC m=+10.059277162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:52.783267 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.783246 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:52.783382 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.783303 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:56.783286843 +0000 UTC m=+10.059713169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:52.883639 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:52.883596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:52.883832 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.883778 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:13:52.883832 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.883807 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:13:52.883832 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.883823 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:52.883980 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:52.883886 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:13:56.883867924 +0000 UTC m=+10.160294239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:53.156106 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:53.156035 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:53.156268 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:53.156174 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:13:53.157156 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:53.156912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:53.157156 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:53.157045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:13:54.156823 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:54.156753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:54.157013 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:54.156922 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:13:55.158674 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:55.158585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:55.159183 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:55.158738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:13:55.159183 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:55.159085 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:55.159183 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:55.159173 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:13:56.156181 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:56.156027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:56.156181 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.156160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:13:56.817883 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:56.817840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:56.818282 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:56.817894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:56.818282 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.818034 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:56.818282 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.818088 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:04.818074139 +0000 UTC m=+18.094500451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:13:56.818481 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.818459 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:56.818519 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.818502 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:04.818491132 +0000 UTC m=+18.094917444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:13:56.918576 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:56.918543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:56.918786 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.918701 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:13:56.918786 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.918719 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:13:56.918786 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.918733 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:56.918942 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:56.918790 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:04.918771913 +0000 UTC m=+18.195198226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:13:57.158934 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:57.158364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:57.158934 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:57.158498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:13:57.159147 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:57.158993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:57.159147 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:57.159089 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:13:58.156443 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:58.155965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:13:58.156443 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:58.156097 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:13:59.158285 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:59.158248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:13:59.158760 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:59.158376 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:13:59.158760 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:13:59.158751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:13:59.158876 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:13:59.158837 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:00.156864 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:00.156820 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:00.157054 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:00.156954 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:01.156826 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:01.156792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:01.157176 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:01.156912 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:01.157176 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:01.156944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:01.157176 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:01.156999 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:02.156154 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:02.156118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:02.156322 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:02.156254 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:03.158985 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:03.158951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:03.159404 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:03.159088 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:03.159404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:03.159148 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:03.159404 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:03.159263 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:04.156315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:04.156280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:04.156522 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.156411 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:04.877932 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:04.877889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:04.878363 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:04.877943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:04.878363 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.878053 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:04.878363 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.878054 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:04.878363 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.878109 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:20.878093179 +0000 UTC m=+34.154519489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:04.878363 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.878150 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:20.878116648 +0000 UTC m=+34.154542977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:04.979179 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:04.979134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:04.979340 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.979320 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:04.979385 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.979342 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:04.979385 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.979353 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:04.979457 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:04.979403 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:20.979389255 +0000 UTC m=+34.255815566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:05.159851 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:05.159772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:05.159851 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:05.159808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:05.160049 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:05.159864 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:05.160049 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:05.160011 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:06.156005 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:06.155972 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:06.156452 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:06.156099 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:07.157389 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:07.157349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:07.157835 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:07.157467 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:07.157835 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:07.157525 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:07.157835 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:07.157687 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:08.156346 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:08.156311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:08.156527 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:08.156440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:09.156020 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:09.155984 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:09.156020 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:09.156013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:09.156772 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:09.156111 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:09.156772 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:09.156227 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:10.156679 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.156363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:10.157416 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:10.156797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:10.294054 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.293977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5cxjn" event={"ID":"69d56011-97b9-4ee8-afe8-70eb144ffa91","Type":"ContainerStarted","Data":"cfd729ab401a6a390053abcf1b4a48eb8702c52b6f91e74851864ce5252f9cae"} Jul 22 18:14:10.295857 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.295805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjcz9" event={"ID":"6a15ecf2-1500-4bcb-9afd-4117ed026545","Type":"ContainerStarted","Data":"4b4172aa5eb960b459172b38868062886daf77de218cf21b6bf208c66b1dc491"} Jul 22 18:14:10.297999 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.297968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" event={"ID":"79b9013f-b904-4842-912f-072c58ee258b","Type":"ContainerStarted","Data":"b2f10906ded4fafa64d467af43174775b67955e4c3da67e6d23eb4322fbd7439"} Jul 22 18:14:10.299603 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.299566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" event={"ID":"c996f33e-649f-4022-8b76-2ee8f365222e","Type":"ContainerStarted","Data":"b07326a6fb5c374e21e4d8e94278bc1f9efcb611ef3d021c7c83f6dbe674859f"} Jul 22 18:14:10.301149 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.301124 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9bd9-ec12-4d8a-9012-121d69a053e6" containerID="a1364fb5aef0e3afd7f2dd5b8a5bad4a3415734d76230522b366ff008ae06eec" exitCode=0 Jul 22 18:14:10.301253 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.301202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerDied","Data":"a1364fb5aef0e3afd7f2dd5b8a5bad4a3415734d76230522b366ff008ae06eec"} Jul 22 18:14:10.302834 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.302753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8hv67" event={"ID":"1b59067d-eaf3-43d8-919d-2a6b9c20c6fe","Type":"ContainerStarted","Data":"a6133db0bd2360f5813d2d9901eeb556569edd68f596447f61a7c3e22232951b"} Jul 22 18:14:10.305787 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.305773 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:14:10.306128 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306105 2562 generic.go:356] "Generic (PLEG): container finished" podID="30189d1d-f1c2-4f4c-9208-6cd6c295ca87" containerID="a58b804f11a220ece5e9eb42de748e20abbbdd12435b1d6a6e1a98ee38025e73" exitCode=1 Jul 22 18:14:10.306241 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"a6856dbdd5064ee7e16ed8d469ce7ddb225611b3e0b3cf70c9b3cc2b110d48c9"} Jul 22 18:14:10.306305 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"bb30a6766471d6de98ce117926a6615622508ee23ea3a7f78dd4264a94397b27"} Jul 22 18:14:10.306364 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306335 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"f84b5519d7fbf8a7b36f383da402651fd32a53c249fee542d09186c3a8c42705"} Jul 22 18:14:10.306417 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"6ec5da6a79e514f5156b14f75ea62c3be91fbdf386c03476966b2b38b8801aae"} Jul 22 18:14:10.306477 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerDied","Data":"a58b804f11a220ece5e9eb42de748e20abbbdd12435b1d6a6e1a98ee38025e73"} Jul 22 18:14:10.306529 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.306485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"eb6ff673e8b8398897c14b7d5cc801eff719b37950fe6ac68aab0cdf37f5feb6"} Jul 22 18:14:10.307667 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.307633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdhmc" event={"ID":"bcebec5d-8358-41d6-be65-79739fcafc95","Type":"ContainerStarted","Data":"7ccb652d3bd9d9571c6468918d5b380e44d1604b1d84f31d64e11f9c43bb4223"} Jul 22 18:14:10.307889 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.307846 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-109.ec2.internal" podStartSLOduration=22.307830512 podStartE2EDuration="22.307830512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:13:52.259805956 +0000 UTC m=+5.536232292" watchObservedRunningTime="2026-07-22 18:14:10.307830512 +0000 UTC m=+23.584256846" Jul 22 18:14:10.320537 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.320504 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5cxjn" podStartSLOduration=4.372679705 podStartE2EDuration="23.320492796s" totalImagesPullingTime="18.947813091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:10.307411002 +0000 UTC m=+23.583837339" watchObservedRunningTime="2026-07-22 18:14:10.320492796 +0000 UTC m=+23.596919128" Jul 22 18:14:10.339017 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.338980 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kjcz9" podStartSLOduration=4.391066032 podStartE2EDuration="23.338969625s" totalImagesPullingTime="18.947903593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:10.320065435 +0000 UTC m=+23.596491797" watchObservedRunningTime="2026-07-22 18:14:10.338969625 +0000 UTC m=+23.615395957" Jul 22 18:14:10.351281 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.351252 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8hv67" podStartSLOduration=4.320108398 podStartE2EDuration="23.351242083s" totalImagesPullingTime="19.031133685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:10.351180345 +0000 UTC m=+23.627606675" watchObservedRunningTime="2026-07-22 18:14:10.351242083 +0000 UTC m=+23.627668416" Jul 22 18:14:10.366722 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.366689 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sq7b8" podStartSLOduration=4.335126285 podStartE2EDuration="23.366679751s" totalImagesPullingTime="19.031553466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:10.366326529 +0000 UTC m=+23.642752862" watchObservedRunningTime="2026-07-22 18:14:10.366679751 +0000 UTC m=+23.643106083" Jul 22 18:14:10.392540 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:10.392506 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cdhmc" podStartSLOduration=4.361348995 podStartE2EDuration="23.392497498s" totalImagesPullingTime="19.031148503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:10.392068727 +0000 UTC m=+23.668495059" watchObservedRunningTime="2026-07-22 18:14:10.392497498 +0000 UTC m=+23.668923831" Jul 22 18:14:11.038784 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.038757 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 18:14:11.093780 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.093681 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T18:14:11.038778939Z","UUID":"259192bf-703e-4ab0-b7c6-5482e24c76e1","Handler":null,"Name":"","Endpoint":""} Jul 22 18:14:11.095185 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.095166 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 18:14:11.095350 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.095207 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 18:14:11.156499 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.156469 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:11.156675 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.156503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:11.156675 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:11.156591 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:11.157151 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:11.156742 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:11.312591 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.312088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwz4t" event={"ID":"9cb6350b-8d97-49e9-93ed-99852b8a9846","Type":"ContainerStarted","Data":"be72c884dafedc5eefbc7fc694c25788743353a76c888d7a055a149495c3fcb3"} Jul 22 18:14:11.314149 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:11.314121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" event={"ID":"c996f33e-649f-4022-8b76-2ee8f365222e","Type":"ContainerStarted","Data":"3214c61f7dc7bc140602f010bdc0e89d2c83e121d4a68c96dd828d2f92ae7daf"} Jul 22 18:14:12.156470 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:12.156443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:12.156634 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:12.156572 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:12.319692 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:12.319666 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:14:12.320197 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:12.320168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"bb1b73e640677e6b81709ce718ed4af7e63cf249992b1ef0d3faea87ee8c7672"} Jul 22 18:14:13.157018 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:13.156833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:13.157284 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:13.156847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:13.157284 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:13.157114 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:13.157284 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:13.157205 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:13.325112 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:13.325080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" event={"ID":"c996f33e-649f-4022-8b76-2ee8f365222e","Type":"ContainerStarted","Data":"3da62c267b3224b96cd68adefc6f5cfd5890fba34c8821a0b0cbaafa00d960af"} Jul 22 18:14:13.342148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:13.342102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pwz4t" podStartSLOduration=7.396927552 podStartE2EDuration="26.342083428s" totalImagesPullingTime="18.945155876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:11.32600006 +0000 UTC m=+24.602426394" watchObservedRunningTime="2026-07-22 18:14:13.342083428 +0000 UTC m=+26.618509773" Jul 22 18:14:13.342327 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:13.342242 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpk6w" podStartSLOduration=4.636367772 podStartE2EDuration="26.342233488s" totalImagesPullingTime="21.705865716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:13.341907279 +0000 UTC m=+26.618333611" watchObservedRunningTime="2026-07-22 18:14:13.342233488 +0000 UTC m=+26.618659826" Jul 22 18:14:14.156733 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:14.156692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:14.156952 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:14.156829 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:14.854161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:14.854132 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:14:14.854812 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:14.854797 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:14:15.159524 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.159368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:15.159624 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.159427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:15.159624 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:15.159610 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:15.159773 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:15.159750 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:15.331518 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.331429 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9bd9-ec12-4d8a-9012-121d69a053e6" containerID="45fe3c391b2c9ed2bf1de084b783dffb52b11b8de3b4f5ef6051ea07df110959" exitCode=0 Jul 22 18:14:15.331691 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.331525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerDied","Data":"45fe3c391b2c9ed2bf1de084b783dffb52b11b8de3b4f5ef6051ea07df110959"} Jul 22 18:14:15.335171 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.335153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:14:15.335493 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.335469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"60a2a022bf2800d45136c3e40d3db62c938e94e04ca22bf86e178dce8a39b6c3"} Jul 22 18:14:15.335743 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.335722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:14:15.335833 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.335773 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:14:15.335833 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.335814 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:14:15.335919 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.335888 2562 scope.go:117] "RemoveContainer" containerID="a58b804f11a220ece5e9eb42de748e20abbbdd12435b1d6a6e1a98ee38025e73" Jul 22 18:14:15.336357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.336333 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kjcz9" Jul 22 18:14:15.351783 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.351762 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:14:15.351961 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:15.351945 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:14:16.156043 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.156015 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:16.156414 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:16.156124 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:16.341346 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.341318 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:14:16.341767 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.341732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" event={"ID":"30189d1d-f1c2-4f4c-9208-6cd6c295ca87","Type":"ContainerStarted","Data":"2dab273bf68aadfd461099e322c6a30fcf4bffa5c024f746fc3db2daf21d9dca"} Jul 22 18:14:16.341881 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.341810 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 18:14:16.368297 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.368248 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" podStartSLOduration=10.299990174 podStartE2EDuration="29.368230958s" totalImagesPullingTime="19.068240784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:16.367110059 +0000 UTC m=+29.643536391" watchObservedRunningTime="2026-07-22 18:14:16.368230958 +0000 UTC m=+29.644657269" Jul 22 18:14:16.786590 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.786555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4tw4p"] Jul 22 18:14:16.786741 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.786699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:16.786830 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:16.786809 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:16.789855 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.789809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wg2fk"] Jul 22 18:14:16.789987 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.789977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:16.790078 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:16.790061 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:16.790479 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.790448 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ghgbv"] Jul 22 18:14:16.790579 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:16.790557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:16.790700 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:16.790681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:17.011583 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:17.011489 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:14:17.346280 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:17.346201 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9bd9-ec12-4d8a-9012-121d69a053e6" containerID="fd58f15b33abbe86b7ab624aa832e3cb4514bdb5eae8e0f9f64beeac8951c21a" exitCode=0 Jul 22 18:14:17.346643 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:17.346285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerDied","Data":"fd58f15b33abbe86b7ab624aa832e3cb4514bdb5eae8e0f9f64beeac8951c21a"} Jul 22 18:14:18.155803 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:18.155768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:18.155803 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:18.155808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:18.156031 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:18.155861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:18.156031 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:18.155872 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:18.156031 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:18.155933 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:18.156149 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:18.156023 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:19.354332 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:19.354133 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9bd9-ec12-4d8a-9012-121d69a053e6" containerID="bf675a18c60dedbd910647fe52d95f65b300e7232466b3c5ba3da196174c30ea" exitCode=0 Jul 22 18:14:19.354332 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:19.354212 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerDied","Data":"bf675a18c60dedbd910647fe52d95f65b300e7232466b3c5ba3da196174c30ea"} Jul 22 18:14:20.156488 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:20.156448 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:20.156693 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.156577 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg2fk" podUID="78dea8d9-9dc9-411e-82c7-11342ab9f360" Jul 22 18:14:20.156693 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:20.156685 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:20.156829 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.156803 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4tw4p" podUID="841e7253-7266-400b-bf70-a26159dd5811" Jul 22 18:14:20.156908 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:20.156843 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:20.156972 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.156927 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:14:20.900091 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:20.900012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:20.900091 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:20.900055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:20.900622 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.900172 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:20.900622 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.900177 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:20.900622 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.900240 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:52.900221891 +0000 UTC m=+66.176648206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:20.900622 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:20.900258 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret podName:841e7253-7266-400b-bf70-a26159dd5811 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:52.900249145 +0000 UTC m=+66.176675460 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret") pod "global-pull-secret-syncer-4tw4p" (UID: "841e7253-7266-400b-bf70-a26159dd5811") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:21.000529 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:21.000502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:21.000723 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:21.000626 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:21.000723 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:21.000642 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:21.000723 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:21.000668 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rbbzt for pod openshift-network-diagnostics/network-check-target-wg2fk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:21.000723 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:21.000719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt podName:78dea8d9-9dc9-411e-82c7-11342ab9f360 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:53.000706717 +0000 UTC m=+66.277133040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbbzt" (UniqueName: "kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt") pod "network-check-target-wg2fk" (UID: "78dea8d9-9dc9-411e-82c7-11342ab9f360") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:22.091043 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.091017 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-109.ec2.internal" event="NodeReady" Jul 22 18:14:22.091461 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.091165 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 18:14:22.126686 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.126640 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv"] Jul 22 18:14:22.129097 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.129074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.129703 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.129684 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c54b7fbd-zdnrb"] Jul 22 18:14:22.131343 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.131323 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lhft2\"" Jul 22 18:14:22.131442 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.131349 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 18:14:22.131442 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.131378 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 18:14:22.132204 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.132186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.134475 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.134448 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 18:14:22.134563 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.134493 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pfg7p\"" Jul 22 18:14:22.135103 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.135085 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 18:14:22.135193 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.135119 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 18:14:22.138954 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.138936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv"] Jul 22 18:14:22.143414 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.143389 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tfrrf"] Jul 22 18:14:22.146073 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.145787 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 18:14:22.146751 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.146733 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.149747 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.149724 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rrx5x"] Jul 22 18:14:22.150028 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.150006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 18:14:22.150113 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.150060 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 18:14:22.150113 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.150012 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 18:14:22.150281 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.150016 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7ttjh\"" Jul 22 18:14:22.153361 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.153342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c54b7fbd-zdnrb"] Jul 22 18:14:22.153451 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.153442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.153692 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.153639 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfrrf"] Jul 22 18:14:22.155501 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.155485 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 18:14:22.155583 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.155517 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttgch\"" Jul 22 18:14:22.155722 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.155703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:22.155824 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.155779 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 18:14:22.155957 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.155942 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:22.156016 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.155968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:22.158109 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.157898 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 18:14:22.158581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.158362 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 18:14:22.158581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.158417 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 18:14:22.158581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.158449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjc8f\"" Jul 22 18:14:22.158785 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.158729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sjds\"" Jul 22 18:14:22.158881 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.158859 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 18:14:22.162818 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.162797 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rrx5x"] Jul 22 18:14:22.209112 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjkfl\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-kube-api-access-mjkfl\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41061829-7e06-4e65-94c7-e29b592f734e-ca-trust-extracted\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.209247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209371 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-trusted-ca\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209371 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.209371 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-installation-pull-secrets\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209494 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-image-registry-private-configuration\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209494 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-registry-certificates\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.209494 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.209467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-bound-sa-token\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.289218 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.289183 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:22.310041 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjkfl\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-kube-api-access-mjkfl\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.310194 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4cf2973-e2b8-48d5-9acd-06882d28e20c-tmp-dir\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.310194 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41061829-7e06-4e65-94c7-e29b592f734e-ca-trust-extracted\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.310194 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71042e40-23dc-407a-87df-81c07653fb62-cert\") pod \"ingress-canary-tfrrf\" (UID: \"71042e40-23dc-407a-87df-81c07653fb62\") " pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.310359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f6g6\" (UniqueName: \"kubernetes.io/projected/71042e40-23dc-407a-87df-81c07653fb62-kube-api-access-6f6g6\") pod \"ingress-canary-tfrrf\" (UID: \"71042e40-23dc-407a-87df-81c07653fb62\") " pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.310359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.310359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.310359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.310359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stvvr\" (UniqueName: \"kubernetes.io/projected/d4cf2973-e2b8-48d5-9acd-06882d28e20c-kube-api-access-stvvr\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.310381 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-trusted-ca\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.310420 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.310435 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cf2973-e2b8-48d5-9acd-06882d28e20c-config-volume\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.310492 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:22.810473198 +0000 UTC m=+36.086899510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-installation-pull-secrets\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-image-registry-private-configuration\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.310589 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-registry-certificates\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.311094 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-bound-sa-token\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.311094 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.310829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:22.810810133 +0000 UTC m=+36.087236447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:22.311094 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.310878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41061829-7e06-4e65-94c7-e29b592f734e-ca-trust-extracted\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.311499 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.311458 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-registry-certificates\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.311617 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.311540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.311942 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.311921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-trusted-ca\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.315050 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.315029 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-installation-pull-secrets\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.315165 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.315073 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-image-registry-private-configuration\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.319492 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.319430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-bound-sa-token\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.319760 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.319737 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjkfl\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-kube-api-access-mjkfl\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.375160 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.375121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:22.411932 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.411899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71042e40-23dc-407a-87df-81c07653fb62-cert\") pod \"ingress-canary-tfrrf\" (UID: \"71042e40-23dc-407a-87df-81c07653fb62\") " pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.412062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.411935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f6g6\" (UniqueName: \"kubernetes.io/projected/71042e40-23dc-407a-87df-81c07653fb62-kube-api-access-6f6g6\") pod \"ingress-canary-tfrrf\" (UID: \"71042e40-23dc-407a-87df-81c07653fb62\") " pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.412062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.411977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.412062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.411993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stvvr\" (UniqueName: \"kubernetes.io/projected/d4cf2973-e2b8-48d5-9acd-06882d28e20c-kube-api-access-stvvr\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.412210 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.412089 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:22.412210 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.412155 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:22.912134174 +0000 UTC m=+36.188560503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:22.412210 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.412178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cf2973-e2b8-48d5-9acd-06882d28e20c-config-volume\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.412355 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.412235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4cf2973-e2b8-48d5-9acd-06882d28e20c-tmp-dir\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.412585 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.412566 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4cf2973-e2b8-48d5-9acd-06882d28e20c-tmp-dir\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.412823 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.412804 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4cf2973-e2b8-48d5-9acd-06882d28e20c-config-volume\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.419141 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.419120 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71042e40-23dc-407a-87df-81c07653fb62-cert\") pod \"ingress-canary-tfrrf\" (UID: \"71042e40-23dc-407a-87df-81c07653fb62\") " pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.420867 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.420841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stvvr\" (UniqueName: \"kubernetes.io/projected/d4cf2973-e2b8-48d5-9acd-06882d28e20c-kube-api-access-stvvr\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.421062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.421037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f6g6\" (UniqueName: \"kubernetes.io/projected/71042e40-23dc-407a-87df-81c07653fb62-kube-api-access-6f6g6\") pod \"ingress-canary-tfrrf\" (UID: \"71042e40-23dc-407a-87df-81c07653fb62\") " pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.462210 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.462152 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tfrrf" Jul 22 18:14:22.816025 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.815938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:22.816025 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.815986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:22.816250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.816083 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:22.816250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.816106 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:22.816250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.816117 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:22.816250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.816157 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:23.816139967 +0000 UTC m=+37.092566282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:22.816250 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.816173 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:23.816166856 +0000 UTC m=+37.092593167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:22.916802 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:22.916769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:22.916979 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.916931 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:22.917080 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:22.917007 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:23.916990895 +0000 UTC m=+37.193417206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:23.797537 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:23.797308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tfrrf"] Jul 22 18:14:23.800917 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:14:23.800885 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71042e40_23dc_407a_87df_81c07653fb62.slice/crio-da3b3c281f1a2be96c79d2c93728a71f50a70dc1fb0289a9d3ef57c3a7e3bab7 WatchSource:0}: Error finding container da3b3c281f1a2be96c79d2c93728a71f50a70dc1fb0289a9d3ef57c3a7e3bab7: Status 404 returned error can't find the container with id da3b3c281f1a2be96c79d2c93728a71f50a70dc1fb0289a9d3ef57c3a7e3bab7 Jul 22 18:14:23.826471 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:23.826448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:23.826553 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:23.826481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:23.826609 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.826597 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:23.826678 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.826613 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:23.826678 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.826616 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:23.826753 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.826690 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:25.826668275 +0000 UTC m=+39.103094587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:23.826753 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.826713 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:25.826705186 +0000 UTC m=+39.103131498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:23.927541 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:23.927513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:23.927716 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.927693 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:23.927802 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:23.927769 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:25.927748415 +0000 UTC m=+39.204174726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:24.367487 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:24.367453 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9bd9-ec12-4d8a-9012-121d69a053e6" containerID="1a97f26dce5653b5c3591f2c327b0b7e7ee1ee41d6742c6a15f68f0b820a4c3e" exitCode=0 Jul 22 18:14:24.367683 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:24.367522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerDied","Data":"1a97f26dce5653b5c3591f2c327b0b7e7ee1ee41d6742c6a15f68f0b820a4c3e"} Jul 22 18:14:24.368693 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:24.368672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfrrf" event={"ID":"71042e40-23dc-407a-87df-81c07653fb62","Type":"ContainerStarted","Data":"da3b3c281f1a2be96c79d2c93728a71f50a70dc1fb0289a9d3ef57c3a7e3bab7"} Jul 22 18:14:25.374263 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:25.374230 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9bd9-ec12-4d8a-9012-121d69a053e6" containerID="4f77c09754fc19549de316fce297e273303dda39994de4af38ad21f481789110" exitCode=0 Jul 22 18:14:25.374686 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:25.374308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerDied","Data":"4f77c09754fc19549de316fce297e273303dda39994de4af38ad21f481789110"} Jul 22 18:14:25.844350 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:25.844316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:25.844350 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:25.844354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:25.844569 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.844468 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:25.844569 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.844528 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:25.844569 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.844539 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:25.844569 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.844543 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:29.844522516 +0000 UTC m=+43.120948833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:25.844569 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.844573 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:29.844562628 +0000 UTC m=+43.120988956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:25.945543 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:25.945515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:25.945704 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.945677 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:25.945760 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:25.945734 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:29.945720676 +0000 UTC m=+43.222146987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:26.381915 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:26.381873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b4sch" event={"ID":"1f6a9bd9-ec12-4d8a-9012-121d69a053e6","Type":"ContainerStarted","Data":"f77b658052a0c3639076c862f1c5f7c5d63d99a6b40ec7962fb6f791134a6a7e"} Jul 22 18:14:26.410664 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:26.410601 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b4sch" podStartSLOduration=9.112011631 podStartE2EDuration="39.410584271s" totalImagesPullingTime="30.29857264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:26.410326366 +0000 UTC m=+39.686752822" watchObservedRunningTime="2026-07-22 18:14:26.410584271 +0000 UTC m=+39.687010605" Jul 22 18:14:26.533349 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:26.533322 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:26.637520 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:26.637438 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:26.995136 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:26.995100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:27.094579 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:27.094538 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.387778 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:28.387750 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tfrrf" event={"ID":"71042e40-23dc-407a-87df-81c07653fb62","Type":"ContainerStarted","Data":"d5b87f56463d068a04a403db0feaef0c03393385a6717311d849a46db67ebdcf"} Jul 22 18:14:28.403736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:28.403685 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tfrrf" podStartSLOduration=2.82574705 podStartE2EDuration="6.40366905s" totalImagesPullingTime="3.577922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:28.403581145 +0000 UTC m=+41.680007477" watchObservedRunningTime="2026-07-22 18:14:28.40366905 +0000 UTC m=+41.680095380" Jul 22 18:14:29.875356 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:29.875316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:29.875356 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:29.875352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:29.875755 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.875452 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:29.875755 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.875452 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:29.875755 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.875463 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:29.875755 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.875527 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:37.875506665 +0000 UTC m=+51.151932976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:29.875755 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.875542 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:37.875535946 +0000 UTC m=+51.151962257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:29.975593 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:29.975562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:29.975747 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.975728 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:29.975806 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:29.975796 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:37.975781657 +0000 UTC m=+51.252207972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:37.933405 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:37.933360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:37.933405 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:37.933399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:37.933892 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:37.933523 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:37.933892 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:37.933550 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:37.933892 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:37.933564 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:37.933892 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:37.933592 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:53.933575613 +0000 UTC m=+67.210001928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:37.933892 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:37.933615 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:14:53.933598508 +0000 UTC m=+67.210024840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:38.034136 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:38.034102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:38.034313 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:38.034210 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:38.034313 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:38.034258 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:14:54.034245154 +0000 UTC m=+67.310671465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:48.360088 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:48.360054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-882h7" Jul 22 18:14:52.944212 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:52.944159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:52.944212 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:52.944209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:14:52.946427 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:52.946406 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 18:14:52.946538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:52.946449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 18:14:52.955278 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:52.955254 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:14:52.955350 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:52.955326 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:15:56.955310664 +0000 UTC m=+130.231736974 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : secret "metrics-daemon-secret" not found Jul 22 18:14:52.958765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:52.958750 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/841e7253-7266-400b-bf70-a26159dd5811-original-pull-secret\") pod \"global-pull-secret-syncer-4tw4p\" (UID: \"841e7253-7266-400b-bf70-a26159dd5811\") " pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:53.044830 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.044790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:53.047400 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.047380 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 18:14:53.056928 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.056912 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 18:14:53.067996 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.067971 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbbzt\" (UniqueName: \"kubernetes.io/projected/78dea8d9-9dc9-411e-82c7-11342ab9f360-kube-api-access-rbbzt\") pod \"network-check-target-wg2fk\" (UID: \"78dea8d9-9dc9-411e-82c7-11342ab9f360\") " pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:53.077484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.077465 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sjds\"" Jul 22 18:14:53.086245 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.086220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:53.087447 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.087431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4tw4p" Jul 22 18:14:53.230470 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.230442 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4tw4p"] Jul 22 18:14:53.247044 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.247019 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wg2fk"] Jul 22 18:14:53.249969 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:14:53.249943 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dea8d9_9dc9_411e_82c7_11342ab9f360.slice/crio-cc57aaaf7f6a0f42d7c52f08f3c4f449e9350e5053a0471320e80957843d5f25 WatchSource:0}: Error finding container cc57aaaf7f6a0f42d7c52f08f3c4f449e9350e5053a0471320e80957843d5f25: Status 404 returned error can't find the container with id cc57aaaf7f6a0f42d7c52f08f3c4f449e9350e5053a0471320e80957843d5f25 Jul 22 18:14:53.446874 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.446841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4tw4p" event={"ID":"841e7253-7266-400b-bf70-a26159dd5811","Type":"ContainerStarted","Data":"3d2447f3c41a071588a1ab67aeda2531b7668086f91be0c2d883aba377eae642"} Jul 22 18:14:53.447938 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.447913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wg2fk" event={"ID":"78dea8d9-9dc9-411e-82c7-11342ab9f360","Type":"ContainerStarted","Data":"cc57aaaf7f6a0f42d7c52f08f3c4f449e9350e5053a0471320e80957843d5f25"} Jul 22 18:14:53.951243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.951205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:14:53.951243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:53.951242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:14:53.951672 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:53.951361 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:14:53.951672 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:53.951424 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:15:25.951408512 +0000 UTC m=+99.227834823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:14:53.951672 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:53.951366 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:14:53.951672 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:53.951473 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:14:53.951672 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:53.951515 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:15:25.951504405 +0000 UTC m=+99.227930716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:14:54.052274 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:54.052234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:14:54.052470 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:54.052399 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:54.052526 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:14:54.052477 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:15:26.052456433 +0000 UTC m=+99.328882747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:14:59.465315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:59.465276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4tw4p" event={"ID":"841e7253-7266-400b-bf70-a26159dd5811","Type":"ContainerStarted","Data":"6bcb3d37f3a8d10b24ba5bcb3a995eeb3d193d210f0ff0c3285600aed4f8e17a"} Jul 22 18:14:59.466687 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:59.466640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wg2fk" event={"ID":"78dea8d9-9dc9-411e-82c7-11342ab9f360","Type":"ContainerStarted","Data":"dab4495bf6c2d67985e7bc24b881627dce073cfd75d7904211c85671a04456aa"} Jul 22 18:14:59.466812 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:59.466759 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:14:59.480537 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:59.480496 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4tw4p" podStartSLOduration=66.922039297 podStartE2EDuration="1m12.480483338s" totalImagesPullingTime="5.558444041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:59.479811026 +0000 UTC m=+72.756237361" watchObservedRunningTime="2026-07-22 18:14:59.480483338 +0000 UTC m=+72.756909670" Jul 22 18:14:59.493202 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:14:59.493161 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wg2fk" podStartSLOduration=66.964292953 podStartE2EDuration="1m12.493152342s" totalImagesPullingTime="5.528859389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:59.492528258 +0000 UTC m=+72.768954590" watchObservedRunningTime="2026-07-22 18:14:59.493152342 +0000 UTC m=+72.769578653" Jul 22 18:15:25.986164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:15:25.986125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:15:25.986164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:15:25.986165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:15:25.986683 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:25.986274 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:15:25.986683 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:25.986277 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:15:25.986683 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:25.986285 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:15:25.986683 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:25.986355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:16:29.98633751 +0000 UTC m=+163.262763825 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:15:25.986683 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:25.986369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:16:29.986362777 +0000 UTC m=+163.262789088 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:15:26.087183 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:15:26.087155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:15:26.087339 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:26.087255 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:15:26.087339 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:26.087306 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:16:30.087292234 +0000 UTC m=+163.363718545 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:15:30.474454 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:15:30.474422 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wg2fk" Jul 22 18:15:57.001922 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:15:57.001870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:15:57.002483 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:57.002010 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:15:57.002483 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:15:57.002095 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:17:59.002072246 +0000 UTC m=+252.278498558 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : secret "metrics-daemon-secret" not found Jul 22 18:16:25.143939 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:25.143891 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" podUID="fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e" Jul 22 18:16:25.155098 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:25.155065 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" podUID="41061829-7e06-4e65-94c7-e29b592f734e" Jul 22 18:16:25.168459 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:25.168433 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rrx5x" podUID="d4cf2973-e2b8-48d5-9acd-06882d28e20c" Jul 22 18:16:25.181757 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:25.181729 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:16:25.670065 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:25.670026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:16:25.670247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:25.670082 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrx5x" Jul 22 18:16:25.670247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:25.670095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:16:30.027625 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:30.027587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:16:30.027625 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:30.027627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:16:30.028083 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.027757 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:16:30.028083 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.027755 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 18:16:30.028083 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.027824 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert podName:fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e nodeName:}" failed. No retries permitted until 2026-07-22 18:18:32.027808129 +0000 UTC m=+285.304234441 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-zrrvv" (UID: "fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e") : secret "networking-console-plugin-cert" not found Jul 22 18:16:30.028083 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.027768 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c54b7fbd-zdnrb: secret "image-registry-tls" not found Jul 22 18:16:30.028083 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.027896 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls podName:41061829-7e06-4e65-94c7-e29b592f734e nodeName:}" failed. No retries permitted until 2026-07-22 18:18:32.027883468 +0000 UTC m=+285.304309778 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls") pod "image-registry-5c54b7fbd-zdnrb" (UID: "41061829-7e06-4e65-94c7-e29b592f734e") : secret "image-registry-tls" not found Jul 22 18:16:30.128951 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:30.128915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:16:30.129118 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.129065 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:16:30.129158 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:16:30.129128 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls podName:d4cf2973-e2b8-48d5-9acd-06882d28e20c nodeName:}" failed. No retries permitted until 2026-07-22 18:18:32.129113686 +0000 UTC m=+285.405539996 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls") pod "dns-default-rrx5x" (UID: "d4cf2973-e2b8-48d5-9acd-06882d28e20c") : secret "dns-default-metrics-tls" not found Jul 22 18:16:39.156421 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:16:39.156318 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:17:59.024166 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:17:59.024119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:17:59.024642 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:17:59.024253 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:17:59.024642 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:17:59.024324 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs podName:ce166cb2-e97b-4723-8510-978686ac1f3c nodeName:}" failed. No retries permitted until 2026-07-22 18:20:01.024309375 +0000 UTC m=+374.300735687 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs") pod "network-metrics-daemon-ghgbv" (UID: "ce166cb2-e97b-4723-8510-978686ac1f3c") : secret "metrics-daemon-secret" not found Jul 22 18:18:02.503056 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.503014 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb"] Jul 22 18:18:02.505822 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.505802 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5"] Jul 22 18:18:02.505934 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.505917 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.508342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.508323 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lmnt7\"" Jul 22 18:18:02.508447 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.508363 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.508447 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.508391 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-wq85t"] Jul 22 18:18:02.508447 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.508413 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 18:18:02.508600 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.508543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:02.509019 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.509002 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.509098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.509062 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 18:18:02.511317 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.511232 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.511317 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.511267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 18:18:02.511501 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.511391 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s7btk\"" Jul 22 18:18:02.511501 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.511472 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-fq4vs"] Jul 22 18:18:02.511759 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.511602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.513424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.512824 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.515732 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.515436 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 18:18:02.515828 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.515805 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.517873 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.515689 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.517873 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.516701 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-49f4c\"" Jul 22 18:18:02.517873 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.516803 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 18:18:02.519032 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.519013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.519777 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.519758 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb"] Jul 22 18:18:02.520933 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.520913 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-fq4vs"] Jul 22 18:18:02.522220 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.522167 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.522315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.522219 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 18:18:02.523089 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.523067 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 18:18:02.523264 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.523248 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 18:18:02.523862 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.523723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.524197 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.524179 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-75wpr\"" Jul 22 18:18:02.524764 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.524745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5"] Jul 22 18:18:02.525921 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.525894 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-wq85t"] Jul 22 18:18:02.529000 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.528980 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 18:18:02.548382 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-tmp\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.548472 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-serving-cert\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.548472 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/395ba236-b2fd-4618-b81d-0b3197655ee3-config\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.548584 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-snapshots\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.548584 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bsr\" (UniqueName: \"kubernetes.io/projected/5cb00344-8229-4898-a462-3d8f27d2908a-kube-api-access-49bsr\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:02.548707 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzw5j\" (UniqueName: \"kubernetes.io/projected/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-kube-api-access-vzw5j\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.548707 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/395ba236-b2fd-4618-b81d-0b3197655ee3-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.548707 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvcz\" (UniqueName: \"kubernetes.io/projected/395ba236-b2fd-4618-b81d-0b3197655ee3-kube-api-access-qnvcz\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.548707 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-serving-cert\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.548901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.548901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-service-ca-bundle\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.548901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:02.548901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-trusted-ca\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.548901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-config\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.549062 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.548928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9dk\" (UniqueName: \"kubernetes.io/projected/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-kube-api-access-hk9dk\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.595337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.595311 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d7786fd84-b4hdj"] Jul 22 18:18:02.598309 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.598291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.600399 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.600381 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 18:18:02.600470 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.600427 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.600616 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.600604 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 18:18:02.601083 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.601067 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 18:18:02.601310 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.601296 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 18:18:02.601502 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.601489 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fhk4d\"" Jul 22 18:18:02.601962 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.601927 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.617969 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.617942 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d7786fd84-b4hdj"] Jul 22 18:18:02.649844 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9dk\" (UniqueName: \"kubernetes.io/projected/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-kube-api-access-hk9dk\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.649948 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcw2d\" (UniqueName: \"kubernetes.io/projected/e884571b-741d-409d-9680-c76118c21c40-kube-api-access-kcw2d\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.649948 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-tmp\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.649948 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-serving-cert\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.649948 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-default-certificate\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.650101 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.650101 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.649989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.650101 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/395ba236-b2fd-4618-b81d-0b3197655ee3-config\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.650247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-stats-auth\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.650247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-snapshots\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.650247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bsr\" (UniqueName: \"kubernetes.io/projected/5cb00344-8229-4898-a462-3d8f27d2908a-kube-api-access-49bsr\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:02.650247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzw5j\" (UniqueName: \"kubernetes.io/projected/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-kube-api-access-vzw5j\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.650247 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/395ba236-b2fd-4618-b81d-0b3197655ee3-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650256 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-tmp\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvcz\" (UniqueName: \"kubernetes.io/projected/395ba236-b2fd-4618-b81d-0b3197655ee3-kube-api-access-qnvcz\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-serving-cert\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-service-ca-bundle\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-trusted-ca\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.650484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.650440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-config\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.650985 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:02.650542 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 18:18:02.650985 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:02.650604 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls podName:5cb00344-8229-4898-a462-3d8f27d2908a nodeName:}" failed. No retries permitted until 2026-07-22 18:18:03.150586644 +0000 UTC m=+256.427012955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r8kg5" (UID: "5cb00344-8229-4898-a462-3d8f27d2908a") : secret "samples-operator-tls" not found Jul 22 18:18:02.651172 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.651088 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/395ba236-b2fd-4618-b81d-0b3197655ee3-config\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.651613 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.651585 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-config\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.651732 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.651637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-service-ca-bundle\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.651793 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.651746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-snapshots\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.652270 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.652251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-trusted-ca\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.652517 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.652495 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.652861 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.652846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-serving-cert\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.652960 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.652842 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/395ba236-b2fd-4618-b81d-0b3197655ee3-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.653005 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.652988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-serving-cert\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.661423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.661404 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzw5j\" (UniqueName: \"kubernetes.io/projected/0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf-kube-api-access-vzw5j\") pod \"insights-operator-555d9d7885-wq85t\" (UID: \"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf\") " pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.689622 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.689591 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9dk\" (UniqueName: \"kubernetes.io/projected/6e4d1f5d-ae4a-4183-bf42-7882a004f2ae-kube-api-access-hk9dk\") pod \"console-operator-565b7b569d-fq4vs\" (UID: \"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae\") " pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.689726 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.689692 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvcz\" (UniqueName: \"kubernetes.io/projected/395ba236-b2fd-4618-b81d-0b3197655ee3-kube-api-access-qnvcz\") pod \"service-ca-operator-5bcbc94c78-9plsb\" (UID: \"395ba236-b2fd-4618-b81d-0b3197655ee3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.690106 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.690084 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bsr\" (UniqueName: \"kubernetes.io/projected/5cb00344-8229-4898-a462-3d8f27d2908a-kube-api-access-49bsr\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:02.751142 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.751114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcw2d\" (UniqueName: \"kubernetes.io/projected/e884571b-741d-409d-9680-c76118c21c40-kube-api-access-kcw2d\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.751251 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.751157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-default-certificate\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.751251 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.751184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.751364 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.751288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.751364 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:02.751303 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:03.251284682 +0000 UTC m=+256.527711013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : configmap references non-existent config key: service-ca.crt Jul 22 18:18:02.751364 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.751350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-stats-auth\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.751364 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:02.751359 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:18:02.751523 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:02.751411 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:03.251400276 +0000 UTC m=+256.527826605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : secret "router-metrics-certs-default" not found Jul 22 18:18:02.753400 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.753352 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-default-certificate\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.753467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.753427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-stats-auth\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.759359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.759343 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcw2d\" (UniqueName: \"kubernetes.io/projected/e884571b-741d-409d-9680-c76118c21c40-kube-api-access-kcw2d\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:02.819527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.819508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" Jul 22 18:18:02.834667 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.834633 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-wq85t" Jul 22 18:18:02.838475 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.838461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:02.976505 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.976478 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb"] Jul 22 18:18:02.979815 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:02.979786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395ba236_b2fd_4618_b81d_0b3197655ee3.slice/crio-cc94582c7e8e2bd9e36aa9d17512049ae55d1faba0ff4d5a6aa0c8bf3cd3254c WatchSource:0}: Error finding container cc94582c7e8e2bd9e36aa9d17512049ae55d1faba0ff4d5a6aa0c8bf3cd3254c: Status 404 returned error can't find the container with id cc94582c7e8e2bd9e36aa9d17512049ae55d1faba0ff4d5a6aa0c8bf3cd3254c Jul 22 18:18:02.984098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.984018 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-fq4vs"] Jul 22 18:18:02.986218 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:02.986188 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4d1f5d_ae4a_4183_bf42_7882a004f2ae.slice/crio-af29f8b083e9603c79d8b8122af8b1f71d57b2f8ae37d7ac144b08604df409aa WatchSource:0}: Error finding container af29f8b083e9603c79d8b8122af8b1f71d57b2f8ae37d7ac144b08604df409aa: Status 404 returned error can't find the container with id af29f8b083e9603c79d8b8122af8b1f71d57b2f8ae37d7ac144b08604df409aa Jul 22 18:18:02.996090 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:02.996069 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-wq85t"] Jul 22 18:18:02.998808 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:02.998788 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a892e02_63f8_4ab6_8ceb_7d7b75cdf9cf.slice/crio-71ca45072972647aaa0755ae144e3e7ba0f789f34e8af99c2b92acda1b57e632 WatchSource:0}: Error finding container 71ca45072972647aaa0755ae144e3e7ba0f789f34e8af99c2b92acda1b57e632: Status 404 returned error can't find the container with id 71ca45072972647aaa0755ae144e3e7ba0f789f34e8af99c2b92acda1b57e632 Jul 22 18:18:03.154484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:03.154398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:03.154630 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:03.154556 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 18:18:03.154630 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:03.154620 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls podName:5cb00344-8229-4898-a462-3d8f27d2908a nodeName:}" failed. No retries permitted until 2026-07-22 18:18:04.15460347 +0000 UTC m=+257.431029783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r8kg5" (UID: "5cb00344-8229-4898-a462-3d8f27d2908a") : secret "samples-operator-tls" not found Jul 22 18:18:03.255568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:03.255534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:03.255568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:03.255566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:03.255786 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:03.255714 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:18:03.255786 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:03.255729 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:04.255710062 +0000 UTC m=+257.532136381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : configmap references non-existent config key: service-ca.crt Jul 22 18:18:03.255786 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:03.255753 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:04.255742389 +0000 UTC m=+257.532168700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : secret "router-metrics-certs-default" not found Jul 22 18:18:03.899170 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:03.899127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" event={"ID":"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae","Type":"ContainerStarted","Data":"af29f8b083e9603c79d8b8122af8b1f71d57b2f8ae37d7ac144b08604df409aa"} Jul 22 18:18:03.900854 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:03.900831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-wq85t" event={"ID":"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf","Type":"ContainerStarted","Data":"71ca45072972647aaa0755ae144e3e7ba0f789f34e8af99c2b92acda1b57e632"} Jul 22 18:18:03.902223 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:03.902176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" event={"ID":"395ba236-b2fd-4618-b81d-0b3197655ee3","Type":"ContainerStarted","Data":"cc94582c7e8e2bd9e36aa9d17512049ae55d1faba0ff4d5a6aa0c8bf3cd3254c"} Jul 22 18:18:04.164223 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:04.164143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:04.164383 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:04.164260 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 18:18:04.164383 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:04.164327 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls podName:5cb00344-8229-4898-a462-3d8f27d2908a nodeName:}" failed. No retries permitted until 2026-07-22 18:18:06.164311663 +0000 UTC m=+259.440737976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r8kg5" (UID: "5cb00344-8229-4898-a462-3d8f27d2908a") : secret "samples-operator-tls" not found Jul 22 18:18:04.265499 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:04.265457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:04.265499 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:04.265507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:04.265788 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:04.265617 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:18:04.265788 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:04.265699 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:06.265679807 +0000 UTC m=+259.542106125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : secret "router-metrics-certs-default" not found Jul 22 18:18:04.265788 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:04.265758 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:06.265736722 +0000 UTC m=+259.542163055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : configmap references non-existent config key: service-ca.crt Jul 22 18:18:06.183221 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.183190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:06.183722 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:06.183338 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 18:18:06.183722 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:06.183396 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls podName:5cb00344-8229-4898-a462-3d8f27d2908a nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.183378641 +0000 UTC m=+263.459804965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r8kg5" (UID: "5cb00344-8229-4898-a462-3d8f27d2908a") : secret "samples-operator-tls" not found Jul 22 18:18:06.284380 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.284342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:06.284539 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.284393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:06.284539 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:06.284524 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.28450789 +0000 UTC m=+263.560934201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : configmap references non-existent config key: service-ca.crt Jul 22 18:18:06.284686 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:06.284557 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:18:06.284686 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:06.284612 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.284596726 +0000 UTC m=+263.561023043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : secret "router-metrics-certs-default" not found Jul 22 18:18:06.913273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.913242 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/0.log" Jul 22 18:18:06.913456 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.913292 2562 generic.go:356] "Generic (PLEG): container finished" podID="6e4d1f5d-ae4a-4183-bf42-7882a004f2ae" containerID="574fcfa9151f6df878a789fe1f34131a60b5f6c0ad217b07c835486b30aa0e47" exitCode=255 Jul 22 18:18:06.913456 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.913382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" event={"ID":"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae","Type":"ContainerDied","Data":"574fcfa9151f6df878a789fe1f34131a60b5f6c0ad217b07c835486b30aa0e47"} Jul 22 18:18:06.913643 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.913597 2562 scope.go:117] "RemoveContainer" containerID="574fcfa9151f6df878a789fe1f34131a60b5f6c0ad217b07c835486b30aa0e47" Jul 22 18:18:06.914964 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.914940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-wq85t" event={"ID":"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf","Type":"ContainerStarted","Data":"ca44a63ca9d903a01187ad13673a780aefbfa3f494e29541d75bd62c14b84ce7"} Jul 22 18:18:06.916437 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.916419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" event={"ID":"395ba236-b2fd-4618-b81d-0b3197655ee3","Type":"ContainerStarted","Data":"c85c28548745125acc1803914b6a38d98a787881229db98d8516dd519c752964"} Jul 22 18:18:06.951171 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.951121 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-wq85t" podStartSLOduration=1.855415216 podStartE2EDuration="4.951103698s" totalImagesPullingTime="3.095688482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:06.950099285 +0000 UTC m=+260.226525621" watchObservedRunningTime="2026-07-22 18:18:06.951103698 +0000 UTC m=+260.227530012" Jul 22 18:18:06.964904 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:06.964841 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" podStartSLOduration=1.845552007 podStartE2EDuration="4.964823022s" totalImagesPullingTime="3.119271015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:06.964601913 +0000 UTC m=+260.241028247" watchObservedRunningTime="2026-07-22 18:18:06.964823022 +0000 UTC m=+260.241249355" Jul 22 18:18:07.273004 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.270844 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qnt4z"] Jul 22 18:18:07.274868 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.274839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.277677 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.277635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d82fz\"" Jul 22 18:18:07.278901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.278879 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 18:18:07.278997 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.278913 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 18:18:07.291257 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.291237 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qnt4z"] Jul 22 18:18:07.292120 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.292098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.292220 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.292125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fbd8674-8887-4489-9855-8d07f85be979-data-volume\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.292220 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.292157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.292354 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.292334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fbd8674-8887-4489-9855-8d07f85be979-crio-socket\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.292406 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.292375 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrjlj\" (UniqueName: \"kubernetes.io/projected/2fbd8674-8887-4489-9855-8d07f85be979-kube-api-access-zrjlj\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.392743 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.392708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.392792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fbd8674-8887-4489-9855-8d07f85be979-crio-socket\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.392812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrjlj\" (UniqueName: \"kubernetes.io/projected/2fbd8674-8887-4489-9855-8d07f85be979-kube-api-access-zrjlj\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.392826 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.392846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.392864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fbd8674-8887-4489-9855-8d07f85be979-data-volume\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.392894 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:07.892873931 +0000 UTC m=+261.169300248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : configmap "kube-rbac-proxy" not found Jul 22 18:18:07.392930 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.392921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fbd8674-8887-4489-9855-8d07f85be979-crio-socket\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.393284 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.392967 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.393284 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.393019 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:07.893001802 +0000 UTC m=+261.169428113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.393284 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.393137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fbd8674-8887-4489-9855-8d07f85be979-data-volume\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.401964 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.401933 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrjlj\" (UniqueName: \"kubernetes.io/projected/2fbd8674-8887-4489-9855-8d07f85be979-kube-api-access-zrjlj\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.896787 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.896752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.896938 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.896801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:07.896938 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.896875 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:07.896938 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.896909 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.896938 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.896933 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:08.896917984 +0000 UTC m=+262.173344294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : configmap "kube-rbac-proxy" not found Jul 22 18:18:07.897088 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.896981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:08.896963922 +0000 UTC m=+262.173390234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.905884 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.905855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw"] Jul 22 18:18:07.908882 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.908868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" Jul 22 18:18:07.911557 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.911537 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 22 18:18:07.911675 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.911611 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 22 18:18:07.912451 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.912433 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wld99\"" Jul 22 18:18:07.918865 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.918848 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw"] Jul 22 18:18:07.920801 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.920778 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:18:07.921203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.921187 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/0.log" Jul 22 18:18:07.921285 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.921224 2562 generic.go:356] "Generic (PLEG): container finished" podID="6e4d1f5d-ae4a-4183-bf42-7882a004f2ae" containerID="fd99d8e1d381b64febcc9983080e9d77e8de37b2827a47221354a62d8ffaffff" exitCode=255 Jul 22 18:18:07.921333 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.921308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" event={"ID":"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae","Type":"ContainerDied","Data":"fd99d8e1d381b64febcc9983080e9d77e8de37b2827a47221354a62d8ffaffff"} Jul 22 18:18:07.921381 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.921360 2562 scope.go:117] "RemoveContainer" containerID="574fcfa9151f6df878a789fe1f34131a60b5f6c0ad217b07c835486b30aa0e47" Jul 22 18:18:07.921721 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.921702 2562 scope.go:117] "RemoveContainer" containerID="fd99d8e1d381b64febcc9983080e9d77e8de37b2827a47221354a62d8ffaffff" Jul 22 18:18:07.921905 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:07.921877 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-fq4vs_openshift-console-operator(6e4d1f5d-ae4a-4183-bf42-7882a004f2ae)\"" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" podUID="6e4d1f5d-ae4a-4183-bf42-7882a004f2ae" Jul 22 18:18:07.997554 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:07.997527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8rn\" (UniqueName: \"kubernetes.io/projected/2bc4a80d-c9de-40d3-9c29-01e3af5b68b4-kube-api-access-rc8rn\") pod \"migrator-7cc9c7ffd7-sr9pw\" (UID: \"2bc4a80d-c9de-40d3-9c29-01e3af5b68b4\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" Jul 22 18:18:08.099380 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.099344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8rn\" (UniqueName: \"kubernetes.io/projected/2bc4a80d-c9de-40d3-9c29-01e3af5b68b4-kube-api-access-rc8rn\") pod \"migrator-7cc9c7ffd7-sr9pw\" (UID: \"2bc4a80d-c9de-40d3-9c29-01e3af5b68b4\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" Jul 22 18:18:08.107552 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.107528 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8rn\" (UniqueName: \"kubernetes.io/projected/2bc4a80d-c9de-40d3-9c29-01e3af5b68b4-kube-api-access-rc8rn\") pod \"migrator-7cc9c7ffd7-sr9pw\" (UID: \"2bc4a80d-c9de-40d3-9c29-01e3af5b68b4\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" Jul 22 18:18:08.217144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.217110 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" Jul 22 18:18:08.340314 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.340283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw"] Jul 22 18:18:08.343453 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:08.343425 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc4a80d_c9de_40d3_9c29_01e3af5b68b4.slice/crio-7ea8707ed580572a00e78fc00923b74f9854d977aac2ef2eda313789b51ca4dd WatchSource:0}: Error finding container 7ea8707ed580572a00e78fc00923b74f9854d977aac2ef2eda313789b51ca4dd: Status 404 returned error can't find the container with id 7ea8707ed580572a00e78fc00923b74f9854d977aac2ef2eda313789b51ca4dd Jul 22 18:18:08.905838 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.905799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:08.906021 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.905856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:08.906021 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:08.905930 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:08.906021 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:08.905942 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:08.906021 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:08.906002 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.905985532 +0000 UTC m=+264.182411844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:08.906021 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:08.906017 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.90601069 +0000 UTC m=+264.182437000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : configmap "kube-rbac-proxy" not found Jul 22 18:18:08.926018 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.925986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" event={"ID":"2bc4a80d-c9de-40d3-9c29-01e3af5b68b4","Type":"ContainerStarted","Data":"7ea8707ed580572a00e78fc00923b74f9854d977aac2ef2eda313789b51ca4dd"} Jul 22 18:18:08.927409 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.927389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:18:08.927706 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:08.927693 2562 scope.go:117] "RemoveContainer" containerID="fd99d8e1d381b64febcc9983080e9d77e8de37b2827a47221354a62d8ffaffff" Jul 22 18:18:08.927856 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:08.927838 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-fq4vs_openshift-console-operator(6e4d1f5d-ae4a-4183-bf42-7882a004f2ae)\"" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" podUID="6e4d1f5d-ae4a-4183-bf42-7882a004f2ae" Jul 22 18:18:09.047347 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:09.047312 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5cxjn_69d56011-97b9-4ee8-afe8-70eb144ffa91/dns-node-resolver/0.log" Jul 22 18:18:09.931559 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:09.931523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" event={"ID":"2bc4a80d-c9de-40d3-9c29-01e3af5b68b4","Type":"ContainerStarted","Data":"b4631f3d0999693c34ce192d3a44a3b22483f4734bed02247f85516d52f0bcf1"} Jul 22 18:18:09.931955 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:09.931624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" event={"ID":"2bc4a80d-c9de-40d3-9c29-01e3af5b68b4","Type":"ContainerStarted","Data":"07bf485586b47d2678ae487ecdb086e608738036e70d22bff59291ce8fd3ab6e"} Jul 22 18:18:09.963234 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:09.963189 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sr9pw" podStartSLOduration=1.755315089 podStartE2EDuration="2.963173566s" totalImagesPullingTime="1.207858477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:09.963069699 +0000 UTC m=+263.239496032" watchObservedRunningTime="2026-07-22 18:18:09.963173566 +0000 UTC m=+263.239599908" Jul 22 18:18:10.043664 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:10.043621 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8hv67_1b59067d-eaf3-43d8-919d-2a6b9c20c6fe/node-ca/0.log" Jul 22 18:18:10.218578 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:10.218498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:10.218742 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.218699 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 18:18:10.218798 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.218757 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls podName:5cb00344-8229-4898-a462-3d8f27d2908a nodeName:}" failed. No retries permitted until 2026-07-22 18:18:18.21874241 +0000 UTC m=+271.495168720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-r8kg5" (UID: "5cb00344-8229-4898-a462-3d8f27d2908a") : secret "samples-operator-tls" not found Jul 22 18:18:10.319887 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:10.319855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:10.320066 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:10.319895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:10.320066 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.320030 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:18.320012187 +0000 UTC m=+271.596438498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : configmap references non-existent config key: service-ca.crt Jul 22 18:18:10.320066 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.320052 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 18:18:10.320201 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.320103 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:18.320087088 +0000 UTC m=+271.596513402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : secret "router-metrics-certs-default" not found Jul 22 18:18:10.924924 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:10.924885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:10.925119 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:10.924935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:10.925119 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.925000 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:10.925119 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.925031 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:10.925119 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.925047 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:14.925033726 +0000 UTC m=+268.201460037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : configmap "kube-rbac-proxy" not found Jul 22 18:18:10.925119 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:10.925092 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:14.925078169 +0000 UTC m=+268.201504484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:11.245598 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:11.245572 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfrrf_71042e40-23dc-407a-87df-81c07653fb62/serve-healthcheck-canary/0.log" Jul 22 18:18:12.839714 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:12.839616 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:12.839714 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:12.839696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:12.840098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:12.840015 2562 scope.go:117] "RemoveContainer" containerID="fd99d8e1d381b64febcc9983080e9d77e8de37b2827a47221354a62d8ffaffff" Jul 22 18:18:12.840169 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:12.840149 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-fq4vs_openshift-console-operator(6e4d1f5d-ae4a-4183-bf42-7882a004f2ae)\"" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" podUID="6e4d1f5d-ae4a-4183-bf42-7882a004f2ae" Jul 22 18:18:14.957826 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:14.957792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:14.958219 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:14.957837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:14.958219 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:14.957900 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:14.958219 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:14.957924 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:14.958219 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:14.957961 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:22.957939791 +0000 UTC m=+276.234366101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : configmap "kube-rbac-proxy" not found Jul 22 18:18:14.958219 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:14.957981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:22.957967955 +0000 UTC m=+276.234394266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:18.284083 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.284045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:18.286521 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.286501 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cb00344-8229-4898-a462-3d8f27d2908a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-r8kg5\" (UID: \"5cb00344-8229-4898-a462-3d8f27d2908a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:18.384909 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.384869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:18.384909 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.384909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:18.385169 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:18.385154 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle podName:e884571b-741d-409d-9680-c76118c21c40 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:34.385134227 +0000 UTC m=+287.661560542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle") pod "router-default-5d7786fd84-b4hdj" (UID: "e884571b-741d-409d-9680-c76118c21c40") : configmap references non-existent config key: service-ca.crt Jul 22 18:18:18.387369 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.387339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e884571b-741d-409d-9680-c76118c21c40-metrics-certs\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:18.428360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.428325 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" Jul 22 18:18:18.551639 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.551617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5"] Jul 22 18:18:18.958909 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:18.958876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" event={"ID":"5cb00344-8229-4898-a462-3d8f27d2908a","Type":"ContainerStarted","Data":"61bcc550c8201237d248166efe9665988a2e7e9edd43a12b9401f43ebea9a9b5"} Jul 22 18:18:20.966454 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:20.966416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" event={"ID":"5cb00344-8229-4898-a462-3d8f27d2908a","Type":"ContainerStarted","Data":"6ecb93ad701d89127aa83294c2b131bb3cdf989ed5bf41228079024bd114ca99"} Jul 22 18:18:20.966914 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:20.966468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" event={"ID":"5cb00344-8229-4898-a462-3d8f27d2908a","Type":"ContainerStarted","Data":"4f0a9b2dd2d7e4b9decb80b253b7a14a2f5fe13cc29a634be51293e89c6eb34d"} Jul 22 18:18:20.985267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:20.982189 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-r8kg5" podStartSLOduration=17.371952547 podStartE2EDuration="18.982170017s" totalImagesPullingTime="1.61021747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:20.98057618 +0000 UTC m=+274.257002536" watchObservedRunningTime="2026-07-22 18:18:20.982170017 +0000 UTC m=+274.258596352" Jul 22 18:18:23.021099 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:23.021064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:23.021595 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:23.021117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:23.021595 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:23.021229 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:23.021595 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:23.021294 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls podName:2fbd8674-8887-4489-9855-8d07f85be979 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:39.021276885 +0000 UTC m=+292.297703196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qnt4z" (UID: "2fbd8674-8887-4489-9855-8d07f85be979") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:23.021843 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:23.021733 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fbd8674-8887-4489-9855-8d07f85be979-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:24.156531 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:24.156495 2562 scope.go:117] "RemoveContainer" containerID="fd99d8e1d381b64febcc9983080e9d77e8de37b2827a47221354a62d8ffaffff" Jul 22 18:18:24.979002 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:24.978975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:18:24.979190 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:24.979051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" event={"ID":"6e4d1f5d-ae4a-4183-bf42-7882a004f2ae","Type":"ContainerStarted","Data":"631d4815425adcd0d31be4854243e74ed2a56e69c31f2c1da67fb8e33fef858a"} Jul 22 18:18:24.979374 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:24.979355 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:24.995873 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:24.995830 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" podStartSLOduration=19.890747231 podStartE2EDuration="22.995807116s" totalImagesPullingTime="3.105059885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:24.995768733 +0000 UTC m=+278.272195066" watchObservedRunningTime="2026-07-22 18:18:24.995807116 +0000 UTC m=+278.272233448" Jul 22 18:18:25.626808 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:25.626775 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-fq4vs" Jul 22 18:18:28.670511 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:28.670458 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rrx5x" podUID="d4cf2973-e2b8-48d5-9acd-06882d28e20c" Jul 22 18:18:28.670958 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:28.670517 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" podUID="fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e" Jul 22 18:18:28.670958 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:28.670640 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" podUID="41061829-7e06-4e65-94c7-e29b592f734e" Jul 22 18:18:28.990698 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:28.990673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:18:28.990878 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:28.990672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:18:28.990878 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:28.990675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrx5x" Jul 22 18:18:32.097599 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.097552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:18:32.097599 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.097600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:18:32.100139 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.100109 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"image-registry-5c54b7fbd-zdnrb\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:18:32.100253 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.100149 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrrvv\" (UID: \"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:18:32.198919 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.198875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:18:32.201095 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.201069 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4cf2973-e2b8-48d5-9acd-06882d28e20c-metrics-tls\") pod \"dns-default-rrx5x\" (UID: \"d4cf2973-e2b8-48d5-9acd-06882d28e20c\") " pod="openshift-dns/dns-default-rrx5x" Jul 22 18:18:32.294584 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.294555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pfg7p\"" Jul 22 18:18:32.294752 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.294599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttgch\"" Jul 22 18:18:32.294752 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.294628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lhft2\"" Jul 22 18:18:32.302612 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.302595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrx5x" Jul 22 18:18:32.302612 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.302603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" Jul 22 18:18:32.302724 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.302633 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:18:32.455844 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.455816 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rrx5x"] Jul 22 18:18:32.458670 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:32.458624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cf2973_e2b8_48d5_9acd_06882d28e20c.slice/crio-56127cf834ae20091bc411c9b91db1b997bce2fbf454e5e5b0da34f16ba80768 WatchSource:0}: Error finding container 56127cf834ae20091bc411c9b91db1b997bce2fbf454e5e5b0da34f16ba80768: Status 404 returned error can't find the container with id 56127cf834ae20091bc411c9b91db1b997bce2fbf454e5e5b0da34f16ba80768 Jul 22 18:18:32.469470 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.469448 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c54b7fbd-zdnrb"] Jul 22 18:18:32.472410 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:32.472385 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41061829_7e06_4e65_94c7_e29b592f734e.slice/crio-0c36555335696472434967bb10541490d4d7b010e825ef4bd2980a25d906e5c7 WatchSource:0}: Error finding container 0c36555335696472434967bb10541490d4d7b010e825ef4bd2980a25d906e5c7: Status 404 returned error can't find the container with id 0c36555335696472434967bb10541490d4d7b010e825ef4bd2980a25d906e5c7 Jul 22 18:18:32.483107 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:32.483084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv"] Jul 22 18:18:32.486564 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:32.486541 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca7bdbe_76eb_4dda_9d75_fe6a29e1f75e.slice/crio-fb6baba0d9a0a11d2ca7c013866c545f7e76266b7581862c105c2514286f9973 WatchSource:0}: Error finding container fb6baba0d9a0a11d2ca7c013866c545f7e76266b7581862c105c2514286f9973: Status 404 returned error can't find the container with id fb6baba0d9a0a11d2ca7c013866c545f7e76266b7581862c105c2514286f9973 Jul 22 18:18:33.007619 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:33.007582 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" event={"ID":"41061829-7e06-4e65-94c7-e29b592f734e","Type":"ContainerStarted","Data":"c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3"} Jul 22 18:18:33.007837 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:33.007640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" event={"ID":"41061829-7e06-4e65-94c7-e29b592f734e","Type":"ContainerStarted","Data":"0c36555335696472434967bb10541490d4d7b010e825ef4bd2980a25d906e5c7"} Jul 22 18:18:33.007837 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:33.007708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:18:33.009331 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:33.009297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrx5x" event={"ID":"d4cf2973-e2b8-48d5-9acd-06882d28e20c","Type":"ContainerStarted","Data":"56127cf834ae20091bc411c9b91db1b997bce2fbf454e5e5b0da34f16ba80768"} Jul 22 18:18:33.010432 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:33.010408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" event={"ID":"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e","Type":"ContainerStarted","Data":"fb6baba0d9a0a11d2ca7c013866c545f7e76266b7581862c105c2514286f9973"} Jul 22 18:18:33.031193 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:33.031144 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" podStartSLOduration=286.031126165 podStartE2EDuration="4m46.031126165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:33.029297415 +0000 UTC m=+286.305723769" watchObservedRunningTime="2026-07-22 18:18:33.031126165 +0000 UTC m=+286.307552499" Jul 22 18:18:34.015404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:34.015360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" event={"ID":"fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e","Type":"ContainerStarted","Data":"5e6b96ca3119e2e63d22058e3d856879d9c810ec333717025ccaa418ff70a14a"} Jul 22 18:18:34.031283 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:34.031228 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrrvv" podStartSLOduration=274.967903759 podStartE2EDuration="4m36.031210676s" totalImagesPullingTime="1.063306917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:34.030233138 +0000 UTC m=+287.306659471" watchObservedRunningTime="2026-07-22 18:18:34.031210676 +0000 UTC m=+287.307637008" Jul 22 18:18:34.418758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:34.418667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:34.419351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:34.419319 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e884571b-741d-409d-9680-c76118c21c40-service-ca-bundle\") pod \"router-default-5d7786fd84-b4hdj\" (UID: \"e884571b-741d-409d-9680-c76118c21c40\") " pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:34.706493 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:34.706468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:34.879361 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:34.879324 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d7786fd84-b4hdj"] Jul 22 18:18:34.881890 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:34.881857 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode884571b_741d_409d_9680_c76118c21c40.slice/crio-6f775436b6b53af01a304ba9c17c3458fa05a953820b2ee5e7eb54711181f9f1 WatchSource:0}: Error finding container 6f775436b6b53af01a304ba9c17c3458fa05a953820b2ee5e7eb54711181f9f1: Status 404 returned error can't find the container with id 6f775436b6b53af01a304ba9c17c3458fa05a953820b2ee5e7eb54711181f9f1 Jul 22 18:18:35.020940 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.020861 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrx5x" event={"ID":"d4cf2973-e2b8-48d5-9acd-06882d28e20c","Type":"ContainerStarted","Data":"d2a1aa605e503c2315f78f1e75336ec1a1bd6eb382fe5f82e0cd5215c81241fe"} Jul 22 18:18:35.020940 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.020922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrx5x" event={"ID":"d4cf2973-e2b8-48d5-9acd-06882d28e20c","Type":"ContainerStarted","Data":"a3462df5ebdaa76c2cda9f4302f6cfa9edaafb3cfbb17334e20dbf9997c18262"} Jul 22 18:18:35.021400 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.020972 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rrx5x" Jul 22 18:18:35.022300 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.022275 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" event={"ID":"e884571b-741d-409d-9680-c76118c21c40","Type":"ContainerStarted","Data":"cc1fdfedc308ba337578906527fc2ff6b71be66186dc176efeb3178c984a2960"} Jul 22 18:18:35.022422 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.022323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" event={"ID":"e884571b-741d-409d-9680-c76118c21c40","Type":"ContainerStarted","Data":"6f775436b6b53af01a304ba9c17c3458fa05a953820b2ee5e7eb54711181f9f1"} Jul 22 18:18:35.053323 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.053276 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rrx5x" podStartSLOduration=250.860003086 podStartE2EDuration="4m13.053263744s" totalImagesPullingTime="2.193260658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:35.052110775 +0000 UTC m=+288.328537111" watchObservedRunningTime="2026-07-22 18:18:35.053263744 +0000 UTC m=+288.329690077" Jul 22 18:18:35.084480 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.084435 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" podStartSLOduration=33.084420768 podStartE2EDuration="33.084420768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:35.083452755 +0000 UTC m=+288.359879111" watchObservedRunningTime="2026-07-22 18:18:35.084420768 +0000 UTC m=+288.360847101" Jul 22 18:18:35.706790 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.706756 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:35.709290 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:35.709268 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:36.030451 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:36.030367 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:36.031698 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:36.031674 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d7786fd84-b4hdj" Jul 22 18:18:39.053688 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:39.053635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:39.056053 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:39.056031 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fbd8674-8887-4489-9855-8d07f85be979-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnt4z\" (UID: \"2fbd8674-8887-4489-9855-8d07f85be979\") " pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:39.083150 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:39.083122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qnt4z" Jul 22 18:18:39.212202 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:39.212127 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qnt4z"] Jul 22 18:18:39.215958 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:39.215935 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbd8674_8887_4489_9855_8d07f85be979.slice/crio-ebba7a097c5b851135008b2dc005e65d4b76458ee52b6a9991ea3477d58d0dd8 WatchSource:0}: Error finding container ebba7a097c5b851135008b2dc005e65d4b76458ee52b6a9991ea3477d58d0dd8: Status 404 returned error can't find the container with id ebba7a097c5b851135008b2dc005e65d4b76458ee52b6a9991ea3477d58d0dd8 Jul 22 18:18:40.046367 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.046305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnt4z" event={"ID":"2fbd8674-8887-4489-9855-8d07f85be979","Type":"ContainerStarted","Data":"ebba7a097c5b851135008b2dc005e65d4b76458ee52b6a9991ea3477d58d0dd8"} Jul 22 18:18:40.482591 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.482560 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-rql6j"] Jul 22 18:18:40.486144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.486092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.489421 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.489396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 22 18:18:40.489527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.489402 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 18:18:40.489527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.489402 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 22 18:18:40.489791 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.489770 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v6hcn\"" Jul 22 18:18:40.489791 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.489785 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 18:18:40.489977 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.489785 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 18:18:40.497275 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.497254 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-rql6j"] Jul 22 18:18:40.565170 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.565139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzpp2\" (UniqueName: \"kubernetes.io/projected/83354a77-283f-498c-ac33-06347f5d9aae-kube-api-access-bzpp2\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.565326 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.565189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83354a77-283f-498c-ac33-06347f5d9aae-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.565326 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.565234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.565326 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.565267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.666439 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.666404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzpp2\" (UniqueName: \"kubernetes.io/projected/83354a77-283f-498c-ac33-06347f5d9aae-kube-api-access-bzpp2\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.666439 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.666451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83354a77-283f-498c-ac33-06347f5d9aae-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.666754 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.666496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.666754 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.666532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.666754 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:40.666688 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 22 18:18:40.666916 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:40.666757 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-tls podName:83354a77-283f-498c-ac33-06347f5d9aae nodeName:}" failed. No retries permitted until 2026-07-22 18:18:41.166736201 +0000 UTC m=+294.443162526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-rql6j" (UID: "83354a77-283f-498c-ac33-06347f5d9aae") : secret "prometheus-operator-tls" not found Jul 22 18:18:40.667300 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.667272 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83354a77-283f-498c-ac33-06347f5d9aae-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.669327 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.669307 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:40.677472 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:40.677449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzpp2\" (UniqueName: \"kubernetes.io/projected/83354a77-283f-498c-ac33-06347f5d9aae-kube-api-access-bzpp2\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:41.176282 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:41.176249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:41.179051 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:41.179012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/83354a77-283f-498c-ac33-06347f5d9aae-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-rql6j\" (UID: \"83354a77-283f-498c-ac33-06347f5d9aae\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:41.397916 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:41.397885 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" Jul 22 18:18:42.156894 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:42.156855 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ghgbv" podUID="ce166cb2-e97b-4723-8510-978686ac1f3c" Jul 22 18:18:44.059464 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:44.059442 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-rql6j"] Jul 22 18:18:44.063690 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:44.063623 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83354a77_283f_498c_ac33_06347f5d9aae.slice/crio-fd6c7967005a3c192085e0354eff51a66ab3478689b8302d5203d842128863a6 WatchSource:0}: Error finding container fd6c7967005a3c192085e0354eff51a66ab3478689b8302d5203d842128863a6: Status 404 returned error can't find the container with id fd6c7967005a3c192085e0354eff51a66ab3478689b8302d5203d842128863a6 Jul 22 18:18:45.032414 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:45.032384 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rrx5x" Jul 22 18:18:45.072714 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:45.072674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnt4z" event={"ID":"2fbd8674-8887-4489-9855-8d07f85be979","Type":"ContainerStarted","Data":"b76ac1b199ee18a4834037d41b049b741bab276bc5dff833f42c4a36061f4679"} Jul 22 18:18:45.074226 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:45.074191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" event={"ID":"83354a77-283f-498c-ac33-06347f5d9aae","Type":"ContainerStarted","Data":"fd6c7967005a3c192085e0354eff51a66ab3478689b8302d5203d842128863a6"} Jul 22 18:18:46.079293 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:46.079259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" event={"ID":"83354a77-283f-498c-ac33-06347f5d9aae","Type":"ContainerStarted","Data":"9c1c4b3e638c2e03e74ace41b78b8dbb707d6a913f122b99430bd59f95935ec5"} Jul 22 18:18:47.702614 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:47.702589 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:18:47.703173 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:47.703144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:18:47.708360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:47.708344 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:18:47.708909 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:47.708889 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:18:47.714513 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:47.714497 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 18:18:48.089066 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:48.088984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnt4z" event={"ID":"2fbd8674-8887-4489-9855-8d07f85be979","Type":"ContainerStarted","Data":"e9219227d6be139af060317d7843f2c01270cb2f11d391cf566672e4c3998d8a"} Jul 22 18:18:48.090597 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:48.090572 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" event={"ID":"83354a77-283f-498c-ac33-06347f5d9aae","Type":"ContainerStarted","Data":"024a0b8a2011f6941ef12c9bf1ba790d3efc9075c7c2930df8981113e84a492f"} Jul 22 18:18:49.811579 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.811529 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-rql6j" podStartSLOduration=8.225032693 podStartE2EDuration="9.811510383s" totalImagesPullingTime="1.58647769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:48.106048837 +0000 UTC m=+301.382475170" watchObservedRunningTime="2026-07-22 18:18:49.811510383 +0000 UTC m=+303.087936695" Jul 22 18:18:49.812178 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.811863 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7"] Jul 22 18:18:49.816860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.816839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.819619 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.819593 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 18:18:49.819619 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.819611 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 18:18:49.819814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.819644 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x8hm8\"" Jul 22 18:18:49.825666 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.825585 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7"] Jul 22 18:18:49.839586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.839559 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t4b29"] Jul 22 18:18:49.847467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.847446 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.850352 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.850328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-sys\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.850464 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.850410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.850929 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.850901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851050 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.850958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.851050 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.850987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-textfile\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851050 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmvnz\" (UniqueName: \"kubernetes.io/projected/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-kube-api-access-mmvnz\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.851214 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-root\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851214 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-wtmp\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851214 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmsk\" (UniqueName: \"kubernetes.io/projected/73c10ce5-84e3-4eed-8570-3051ea61d561-kube-api-access-pqmsk\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j2mzc\"" Jul 22 18:18:49.851337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851275 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 18:18:49.851337 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-tls\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851548 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c10ce5-84e3-4eed-8570-3051ea61d561-metrics-client-ca\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.851548 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 18:18:49.851642 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.851642 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.851609 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 18:18:49.952183 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-sys\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952183 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.952423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.952423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-textfile\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmvnz\" (UniqueName: \"kubernetes.io/projected/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-kube-api-access-mmvnz\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.952423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-sys\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952423 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:49.952376 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:49.952433 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-tls podName:96b2daf7-5e18-4998-8ca5-0ff843afd0ab nodeName:}" failed. No retries permitted until 2026-07-22 18:18:50.452416136 +0000 UTC m=+303.728842463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-b62c7" (UID: "96b2daf7-5e18-4998-8ca5-0ff843afd0ab") : secret "openshift-state-metrics-tls" not found Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-root\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-wtmp\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-root\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmsk\" (UniqueName: \"kubernetes.io/projected/73c10ce5-84e3-4eed-8570-3051ea61d561-kube-api-access-pqmsk\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-textfile\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-wtmp\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-tls\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.952762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c10ce5-84e3-4eed-8570-3051ea61d561-metrics-client-ca\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.953258 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:49.952782 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 18:18:49.953258 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:49.952830 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-tls podName:73c10ce5-84e3-4eed-8570-3051ea61d561 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:50.452813974 +0000 UTC m=+303.729240285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-tls") pod "node-exporter-t4b29" (UID: "73c10ce5-84e3-4eed-8570-3051ea61d561") : secret "node-exporter-tls" not found Jul 22 18:18:49.953258 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.953258 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952901 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.953258 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.952997 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.953586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.953299 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73c10ce5-84e3-4eed-8570-3051ea61d561-metrics-client-ca\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.955390 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.955369 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.955501 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.955481 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:49.963986 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.963939 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmsk\" (UniqueName: \"kubernetes.io/projected/73c10ce5-84e3-4eed-8570-3051ea61d561-kube-api-access-pqmsk\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:49.964259 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:49.964241 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmvnz\" (UniqueName: \"kubernetes.io/projected/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-kube-api-access-mmvnz\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:50.457281 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.457241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-tls\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:50.457483 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.457340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:50.460153 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.460118 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73c10ce5-84e3-4eed-8570-3051ea61d561-node-exporter-tls\") pod \"node-exporter-t4b29\" (UID: \"73c10ce5-84e3-4eed-8570-3051ea61d561\") " pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:50.460299 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.460275 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/96b2daf7-5e18-4998-8ca5-0ff843afd0ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-b62c7\" (UID: \"96b2daf7-5e18-4998-8ca5-0ff843afd0ab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:50.729262 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.729182 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" Jul 22 18:18:50.758330 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.758301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4b29" Jul 22 18:18:50.886216 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.886185 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:18:50.894638 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.894610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.897180 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897019 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 18:18:50.897180 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897149 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 18:18:50.897410 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897383 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 18:18:50.897493 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 18:18:50.897571 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 18:18:50.897636 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897583 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 18:18:50.897636 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897585 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 18:18:50.897756 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897707 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 18:18:50.897852 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897835 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ccdrf\"" Jul 22 18:18:50.897918 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.897877 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 18:18:50.904555 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.904531 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:18:50.962296 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-out\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-web-config\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-volume\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:50.962809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:50.962768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhd5x\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-kube-api-access-dhd5x\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064078 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.063989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-out\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064078 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-web-config\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064078 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-volume\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhd5x\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-kube-api-access-dhd5x\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.064568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.066557 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064592 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.066557 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.064683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.066557 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.065588 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.066557 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:51.066336 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 22 18:18:51.066557 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:18:51.066407 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls podName:74cd8c5d-351d-4b87-bd01-8effc5eef078 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:51.56638418 +0000 UTC m=+304.842810496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078") : secret "alertmanager-main-tls" not found Jul 22 18:18:51.066928 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.066885 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.067712 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.067680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.068936 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.068896 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-web-config\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.069103 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.069056 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-out\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.069565 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.069354 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.069673 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.069578 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.070154 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.070116 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.070800 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.070778 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.070918 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.070809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-volume\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.073254 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.073234 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhd5x\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-kube-api-access-dhd5x\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.268714 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:51.268676 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c10ce5_84e3_4eed_8570_3051ea61d561.slice/crio-742ea8ba3e5334921a8c9a5f8f69b4bff7acd3575d704abf80b683c6f918774a WatchSource:0}: Error finding container 742ea8ba3e5334921a8c9a5f8f69b4bff7acd3575d704abf80b683c6f918774a: Status 404 returned error can't find the container with id 742ea8ba3e5334921a8c9a5f8f69b4bff7acd3575d704abf80b683c6f918774a Jul 22 18:18:51.270502 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.270480 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:18:51.391130 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.391101 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7"] Jul 22 18:18:51.394121 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:51.394095 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b2daf7_5e18_4998_8ca5_0ff843afd0ab.slice/crio-9057dbf2d5446ab38c419887d6046fc1d128fc91ec3108d265f5a5478606635c WatchSource:0}: Error finding container 9057dbf2d5446ab38c419887d6046fc1d128fc91ec3108d265f5a5478606635c: Status 404 returned error can't find the container with id 9057dbf2d5446ab38c419887d6046fc1d128fc91ec3108d265f5a5478606635c Jul 22 18:18:51.568374 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.568339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.571259 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.571231 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.808630 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.808593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:18:51.967446 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:51.967402 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:18:51.970673 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:51.970626 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74cd8c5d_351d_4b87_bd01_8effc5eef078.slice/crio-b051929ac1fe50aac999326b9785ab545e85b21ceb8705126e4e9cd10974b04b WatchSource:0}: Error finding container b051929ac1fe50aac999326b9785ab545e85b21ceb8705126e4e9cd10974b04b: Status 404 returned error can't find the container with id b051929ac1fe50aac999326b9785ab545e85b21ceb8705126e4e9cd10974b04b Jul 22 18:18:52.109929 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.109837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnt4z" event={"ID":"2fbd8674-8887-4489-9855-8d07f85be979","Type":"ContainerStarted","Data":"ac47c0b704959c99085e6f1178cc5c43c6eeb4d94b11a1840a7282a575986230"} Jul 22 18:18:52.111454 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.111415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4b29" event={"ID":"73c10ce5-84e3-4eed-8570-3051ea61d561","Type":"ContainerStarted","Data":"742ea8ba3e5334921a8c9a5f8f69b4bff7acd3575d704abf80b683c6f918774a"} Jul 22 18:18:52.113710 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.113683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" event={"ID":"96b2daf7-5e18-4998-8ca5-0ff843afd0ab","Type":"ContainerStarted","Data":"a3d8f1ed5ac0917bf2a675681317aa205907a30bd1bbd899bc5f960c07ee27bc"} Jul 22 18:18:52.113829 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.113741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" event={"ID":"96b2daf7-5e18-4998-8ca5-0ff843afd0ab","Type":"ContainerStarted","Data":"ecea4ea7bb58b06babdadb82ce471f7a24856bb8deeac17247d1eb0f0702a066"} Jul 22 18:18:52.113829 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.113807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" event={"ID":"96b2daf7-5e18-4998-8ca5-0ff843afd0ab","Type":"ContainerStarted","Data":"9057dbf2d5446ab38c419887d6046fc1d128fc91ec3108d265f5a5478606635c"} Jul 22 18:18:52.115348 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.115324 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"b051929ac1fe50aac999326b9785ab545e85b21ceb8705126e4e9cd10974b04b"} Jul 22 18:18:52.130749 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.130526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qnt4z" podStartSLOduration=33.140147299 podStartE2EDuration="45.130505719s" totalImagesPullingTime="11.99035842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:52.126824363 +0000 UTC m=+305.403250697" watchObservedRunningTime="2026-07-22 18:18:52.130505719 +0000 UTC m=+305.406932054" Jul 22 18:18:52.307736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.307692 2562 patch_prober.go:28] interesting pod/image-registry-5c54b7fbd-zdnrb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 18:18:52.307861 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:52.307754 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" podUID="41061829-7e06-4e65-94c7-e29b592f734e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 18:18:53.124141 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:53.124047 2562 generic.go:356] "Generic (PLEG): container finished" podID="73c10ce5-84e3-4eed-8570-3051ea61d561" containerID="8c2e13ee9ee99ffaea5e575a112162b7a80ced7ae82af00894406321030c3f22" exitCode=0 Jul 22 18:18:53.124584 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:53.124371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4b29" event={"ID":"73c10ce5-84e3-4eed-8570-3051ea61d561","Type":"ContainerDied","Data":"8c2e13ee9ee99ffaea5e575a112162b7a80ced7ae82af00894406321030c3f22"} Jul 22 18:18:53.127094 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:53.127058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" event={"ID":"96b2daf7-5e18-4998-8ca5-0ff843afd0ab","Type":"ContainerStarted","Data":"3e7ef22165a824cf285b1b516569371879ec5067833ca3ff1a492e4ddf119691"} Jul 22 18:18:53.158046 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:53.157992 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-b62c7" podStartSLOduration=3.027403879 podStartE2EDuration="4.157975901s" totalImagesPullingTime="1.130572022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:53.155990052 +0000 UTC m=+306.432416408" watchObservedRunningTime="2026-07-22 18:18:53.157975901 +0000 UTC m=+306.434402234" Jul 22 18:18:54.020275 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:54.020193 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:18:54.132866 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:54.132828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4b29" event={"ID":"73c10ce5-84e3-4eed-8570-3051ea61d561","Type":"ContainerStarted","Data":"a458748eff003d1a718faa1724e657f984d85773e5862694ed504c1f55733b90"} Jul 22 18:18:54.133348 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:54.132907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4b29" event={"ID":"73c10ce5-84e3-4eed-8570-3051ea61d561","Type":"ContainerStarted","Data":"8d5232f6e17e7569218ad2963f1adb91bd38f5f1bf4ba86473efbb3b4278b37d"} Jul 22 18:18:54.134671 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:54.134617 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34" exitCode=0 Jul 22 18:18:54.134782 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:54.134696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34"} Jul 22 18:18:54.157353 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:54.157283 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t4b29" podStartSLOduration=4.090037745 podStartE2EDuration="5.157269196s" totalImagesPullingTime="990.703244ms" totalInitContainerRuntime="76.528207ms" isStatefulPod=true podCreationTimestamp="2026-07-22 18:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:54.1561312 +0000 UTC m=+307.432557532" watchObservedRunningTime="2026-07-22 18:18:54.157269196 +0000 UTC m=+307.433695528" Jul 22 18:18:55.070756 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.070718 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cff7c6899-cw7hp"] Jul 22 18:18:55.074320 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.074299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.077915 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.077189 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 18:18:55.077915 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.077232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 18:18:55.077915 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.077426 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 18:18:55.077915 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.077892 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 18:18:55.078886 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.078413 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 18:18:55.078886 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.078521 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7lspc\"" Jul 22 18:18:55.087000 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.085619 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 18:18:55.088918 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.088897 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cff7c6899-cw7hp"] Jul 22 18:18:55.099422 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf825\" (UniqueName: \"kubernetes.io/projected/90c209a1-ec35-46c0-a326-862416b3a7b2-kube-api-access-gf825\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099523 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099523 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-telemeter-client-tls\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099523 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-metrics-client-ca\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099626 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-federate-client-tls\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099626 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-serving-certs-ca-bundle\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099626 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-secret-telemeter-client\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.099761 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.099667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.156667 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.156617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:18:55.200411 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf825\" (UniqueName: \"kubernetes.io/projected/90c209a1-ec35-46c0-a326-862416b3a7b2-kube-api-access-gf825\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200576 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200576 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-telemeter-client-tls\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200576 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-metrics-client-ca\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200576 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-federate-client-tls\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200817 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-serving-certs-ca-bundle\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200817 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-secret-telemeter-client\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.200817 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.200747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.201521 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.201463 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-metrics-client-ca\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.201641 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.201575 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-serving-certs-ca-bundle\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.201641 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.201622 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90c209a1-ec35-46c0-a326-862416b3a7b2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.203623 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.203584 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-telemeter-client-tls\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.204186 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.204162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.204298 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.204238 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-secret-telemeter-client\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.204347 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.204301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90c209a1-ec35-46c0-a326-862416b3a7b2-federate-client-tls\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.208503 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.208484 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf825\" (UniqueName: \"kubernetes.io/projected/90c209a1-ec35-46c0-a326-862416b3a7b2-kube-api-access-gf825\") pod \"telemeter-client-7cff7c6899-cw7hp\" (UID: \"90c209a1-ec35-46c0-a326-862416b3a7b2\") " pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.389735 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.389666 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" Jul 22 18:18:55.876941 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:55.876858 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cff7c6899-cw7hp"] Jul 22 18:18:55.879182 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:55.879147 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c209a1_ec35_46c0_a326_862416b3a7b2.slice/crio-98cf5511680f410ebd8507602718f664f6149d9fef25d8c395b10ae36d13f85a WatchSource:0}: Error finding container 98cf5511680f410ebd8507602718f664f6149d9fef25d8c395b10ae36d13f85a: Status 404 returned error can't find the container with id 98cf5511680f410ebd8507602718f664f6149d9fef25d8c395b10ae36d13f85a Jul 22 18:18:56.119528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.119502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fc88f4fd-24hph"] Jul 22 18:18:56.124243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.123900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.126894 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.126441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 18:18:56.126894 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.126528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 18:18:56.126894 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.126700 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 18:18:56.126894 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.126710 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 18:18:56.126894 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.126715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 18:18:56.126894 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.126784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kzbg6\"" Jul 22 18:18:56.127139 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.127029 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 18:18:56.127198 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.127183 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 18:18:56.130814 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.130795 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 18:18:56.133596 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.133578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fc88f4fd-24hph"] Jul 22 18:18:56.149438 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.149409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a"} Jul 22 18:18:56.149565 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.149477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e"} Jul 22 18:18:56.149565 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.149504 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1"} Jul 22 18:18:56.149565 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.149527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136"} Jul 22 18:18:56.150783 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.150760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" event={"ID":"90c209a1-ec35-46c0-a326-862416b3a7b2","Type":"ContainerStarted","Data":"98cf5511680f410ebd8507602718f664f6149d9fef25d8c395b10ae36d13f85a"} Jul 22 18:18:56.209740 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.209701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-service-ca\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.209740 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.209742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-oauth-serving-cert\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.210211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.209849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-oauth-config\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.210211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.209936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-config\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.210211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.209990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69fks\" (UniqueName: \"kubernetes.io/projected/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-kube-api-access-69fks\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.210211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.210078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-serving-cert\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.210211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.210111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-trusted-ca-bundle\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-oauth-config\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-config\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69fks\" (UniqueName: \"kubernetes.io/projected/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-kube-api-access-69fks\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-serving-cert\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-trusted-ca-bundle\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-service-ca\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.311538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.311385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-oauth-serving-cert\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.312190 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.312135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-config\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.312317 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.312294 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-service-ca\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.312384 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.312336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-oauth-serving-cert\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.312384 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.312363 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-trusted-ca-bundle\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.313831 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.313815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-oauth-config\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.314315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.314300 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-serving-cert\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.321445 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.321419 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69fks\" (UniqueName: \"kubernetes.io/projected/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-kube-api-access-69fks\") pod \"console-85fc88f4fd-24hph\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.449203 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.449158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:18:56.594448 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:56.594368 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fc88f4fd-24hph"] Jul 22 18:18:56.597417 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:18:56.597390 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b90cc4_f4d4_43c6_abf2_1578a55dafc3.slice/crio-2c137af52b9ef35db1a6c8f82156d6c4651ed978acf58b4fa94de8429ed81047 WatchSource:0}: Error finding container 2c137af52b9ef35db1a6c8f82156d6c4651ed978acf58b4fa94de8429ed81047: Status 404 returned error can't find the container with id 2c137af52b9ef35db1a6c8f82156d6c4651ed978acf58b4fa94de8429ed81047 Jul 22 18:18:57.164615 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:57.164579 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b"} Jul 22 18:18:57.164809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:57.164674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerStarted","Data":"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a"} Jul 22 18:18:57.164809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:57.164767 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc88f4fd-24hph" event={"ID":"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3","Type":"ContainerStarted","Data":"2c137af52b9ef35db1a6c8f82156d6c4651ed978acf58b4fa94de8429ed81047"} Jul 22 18:18:57.189289 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:57.189230 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.371471716 podStartE2EDuration="7.189208828s" totalImagesPullingTime="3.801065054s" totalInitContainerRuntime="16.672058ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:57.18786792 +0000 UTC m=+310.464294253" watchObservedRunningTime="2026-07-22 18:18:57.189208828 +0000 UTC m=+310.465635162" Jul 22 18:18:57.451398 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:18:57.451300 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c54b7fbd-zdnrb"] Jul 22 18:19:00.181215 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:00.181180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" event={"ID":"90c209a1-ec35-46c0-a326-862416b3a7b2","Type":"ContainerStarted","Data":"fbe2027756ccaa434f9c2506659f7aa41dc1fd59d3a15e6bcdc72c995c4b64f2"} Jul 22 18:19:00.181604 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:00.181288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" event={"ID":"90c209a1-ec35-46c0-a326-862416b3a7b2","Type":"ContainerStarted","Data":"dcea052c04b755f65ff8268741f302d951da9cfb8f3d5d868a3fed346eab4822"} Jul 22 18:19:00.181604 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:00.181326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" event={"ID":"90c209a1-ec35-46c0-a326-862416b3a7b2","Type":"ContainerStarted","Data":"96c4e87af07ccf1e70c5523d2cb866f38a269bc4c9127a37b8bf8b31ac21cf0a"} Jul 22 18:19:00.182755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:00.182732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc88f4fd-24hph" event={"ID":"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3","Type":"ContainerStarted","Data":"ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4"} Jul 22 18:19:00.206999 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:00.206953 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cff7c6899-cw7hp" podStartSLOduration=1.520082097 podStartE2EDuration="5.206939006s" totalImagesPullingTime="3.686856909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:00.205885721 +0000 UTC m=+313.482312056" watchObservedRunningTime="2026-07-22 18:19:00.206939006 +0000 UTC m=+313.483365338" Jul 22 18:19:00.223291 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:00.223243 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85fc88f4fd-24hph" podStartSLOduration=1.247858907 podStartE2EDuration="4.22322589s" totalImagesPullingTime="2.975366983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:00.222771611 +0000 UTC m=+313.499197953" watchObservedRunningTime="2026-07-22 18:19:00.22322589 +0000 UTC m=+313.499652224" Jul 22 18:19:01.137821 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.137790 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fc88f4fd-24hph"] Jul 22 18:19:01.172634 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.172603 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8699b787-wspfd"] Jul 22 18:19:01.176195 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.176175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.188827 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.188806 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8699b787-wspfd"] Jul 22 18:19:01.259933 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.259901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fx8l\" (UniqueName: \"kubernetes.io/projected/152432b7-1dc3-4570-ba96-93c016c69aca-kube-api-access-7fx8l\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.260687 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.260663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-serving-cert\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.260868 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.260842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-console-config\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.261165 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.261131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-trusted-ca-bundle\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.261259 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.261171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-oauth-serving-cert\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.261349 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.261319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-oauth-config\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.261550 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.261527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-service-ca\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362246 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-serving-cert\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-console-config\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-trusted-ca-bundle\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-oauth-serving-cert\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-oauth-config\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-service-ca\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.362696 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.362611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fx8l\" (UniqueName: \"kubernetes.io/projected/152432b7-1dc3-4570-ba96-93c016c69aca-kube-api-access-7fx8l\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.363168 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.363136 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-console-config\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.363277 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.363250 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-service-ca\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.363467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.363444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-trusted-ca-bundle\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.363504 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.363455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-oauth-serving-cert\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.365000 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.364969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-serving-cert\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.365116 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.365095 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-oauth-config\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.370109 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.370088 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fx8l\" (UniqueName: \"kubernetes.io/projected/152432b7-1dc3-4570-ba96-93c016c69aca-kube-api-access-7fx8l\") pod \"console-5c8699b787-wspfd\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.486391 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.486345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:01.648465 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:01.648441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8699b787-wspfd"] Jul 22 18:19:01.650693 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:19:01.650641 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152432b7_1dc3_4570_ba96_93c016c69aca.slice/crio-11af1badedfe288d70cdba42257b3976606159c70d7eca82923c460ac94ce32a WatchSource:0}: Error finding container 11af1badedfe288d70cdba42257b3976606159c70d7eca82923c460ac94ce32a: Status 404 returned error can't find the container with id 11af1badedfe288d70cdba42257b3976606159c70d7eca82923c460ac94ce32a Jul 22 18:19:02.192698 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:02.192642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8699b787-wspfd" event={"ID":"152432b7-1dc3-4570-ba96-93c016c69aca","Type":"ContainerStarted","Data":"b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9"} Jul 22 18:19:02.193254 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:02.193229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8699b787-wspfd" event={"ID":"152432b7-1dc3-4570-ba96-93c016c69aca","Type":"ContainerStarted","Data":"11af1badedfe288d70cdba42257b3976606159c70d7eca82923c460ac94ce32a"} Jul 22 18:19:02.227400 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:02.227344 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8699b787-wspfd" podStartSLOduration=1.227321342 podStartE2EDuration="1.227321342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:02.225979064 +0000 UTC m=+315.502405384" watchObservedRunningTime="2026-07-22 18:19:02.227321342 +0000 UTC m=+315.503747676" Jul 22 18:19:06.450305 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:06.450266 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:19:11.486735 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:11.486704 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:11.487110 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:11.486790 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:11.491713 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:11.491692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:12.234362 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:12.234335 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:19:17.251067 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:17.250987 2562 generic.go:356] "Generic (PLEG): container finished" podID="395ba236-b2fd-4618-b81d-0b3197655ee3" containerID="c85c28548745125acc1803914b6a38d98a787881229db98d8516dd519c752964" exitCode=0 Jul 22 18:19:17.251067 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:17.251027 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" event={"ID":"395ba236-b2fd-4618-b81d-0b3197655ee3","Type":"ContainerDied","Data":"c85c28548745125acc1803914b6a38d98a787881229db98d8516dd519c752964"} Jul 22 18:19:17.251481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:17.251368 2562 scope.go:117] "RemoveContainer" containerID="c85c28548745125acc1803914b6a38d98a787881229db98d8516dd519c752964" Jul 22 18:19:18.257502 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:18.257467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9plsb" event={"ID":"395ba236-b2fd-4618-b81d-0b3197655ee3","Type":"ContainerStarted","Data":"8ca3781c51b4982e43b674cdc8052ea88a3f6de735977597dd50f3af61458167"} Jul 22 18:19:22.484673 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:22.484612 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" podUID="41061829-7e06-4e65-94c7-e29b592f734e" containerName="registry" containerID="cri-o://c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3" gracePeriod=30 Jul 22 18:19:23.266502 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.266477 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:19:23.277946 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.277923 2562 generic.go:356] "Generic (PLEG): container finished" podID="41061829-7e06-4e65-94c7-e29b592f734e" containerID="c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3" exitCode=0 Jul 22 18:19:23.278065 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.277960 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" Jul 22 18:19:23.278065 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.278006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" event={"ID":"41061829-7e06-4e65-94c7-e29b592f734e","Type":"ContainerDied","Data":"c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3"} Jul 22 18:19:23.278065 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.278053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c54b7fbd-zdnrb" event={"ID":"41061829-7e06-4e65-94c7-e29b592f734e","Type":"ContainerDied","Data":"0c36555335696472434967bb10541490d4d7b010e825ef4bd2980a25d906e5c7"} Jul 22 18:19:23.278191 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.278068 2562 scope.go:117] "RemoveContainer" containerID="c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3" Jul 22 18:19:23.290336 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.290321 2562 scope.go:117] "RemoveContainer" containerID="c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3" Jul 22 18:19:23.290617 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:19:23.290591 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3\": container with ID starting with c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3 not found: ID does not exist" containerID="c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3" Jul 22 18:19:23.290686 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.290624 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3"} err="failed to get container status \"c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3\": rpc error: code = NotFound desc = could not find container \"c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3\": container with ID starting with c895432b3125585bcbdad6b88790f0765c74bbb02367ae47bc4cf411111638a3 not found: ID does not exist" Jul 22 18:19:23.360823 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.360784 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-bound-sa-token\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.360980 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.360861 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjkfl\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-kube-api-access-mjkfl\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.360980 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.360898 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.360980 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.360929 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-trusted-ca\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.360980 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.360970 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-image-registry-private-configuration\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.361187 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.361004 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41061829-7e06-4e65-94c7-e29b592f734e-ca-trust-extracted\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.361187 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.361041 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-registry-certificates\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.361187 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.361068 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-installation-pull-secrets\") pod \"41061829-7e06-4e65-94c7-e29b592f734e\" (UID: \"41061829-7e06-4e65-94c7-e29b592f734e\") " Jul 22 18:19:23.361821 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.361742 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:23.361821 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.361481 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:23.363784 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.363721 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:23.363784 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.363721 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-kube-api-access-mjkfl" (OuterVolumeSpecName: "kube-api-access-mjkfl") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "kube-api-access-mjkfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:23.363784 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.363866 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:23.364113 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.363978 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:19:23.364113 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.364057 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:19:23.369595 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.369565 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41061829-7e06-4e65-94c7-e29b592f734e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "41061829-7e06-4e65-94c7-e29b592f734e" (UID: "41061829-7e06-4e65-94c7-e29b592f734e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:19:23.462572 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462542 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjkfl\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-kube-api-access-mjkfl\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462572 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462568 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-registry-tls\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462572 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462579 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-trusted-ca\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462589 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-image-registry-private-configuration\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462598 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41061829-7e06-4e65-94c7-e29b592f734e-ca-trust-extracted\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462606 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41061829-7e06-4e65-94c7-e29b592f734e-registry-certificates\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462616 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41061829-7e06-4e65-94c7-e29b592f734e-installation-pull-secrets\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.462819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.462624 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41061829-7e06-4e65-94c7-e29b592f734e-bound-sa-token\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:23.599150 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.599120 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c54b7fbd-zdnrb"] Jul 22 18:19:23.603248 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:23.603225 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c54b7fbd-zdnrb"] Jul 22 18:19:25.161156 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:25.161124 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41061829-7e06-4e65-94c7-e29b592f734e" path="/var/lib/kubelet/pods/41061829-7e06-4e65-94c7-e29b592f734e/volumes" Jul 22 18:19:27.215444 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.215395 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85fc88f4fd-24hph" podUID="c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" containerName="console" containerID="cri-o://ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4" gracePeriod=15 Jul 22 18:19:27.296898 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.296869 2562 generic.go:356] "Generic (PLEG): container finished" podID="0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf" containerID="ca44a63ca9d903a01187ad13673a780aefbfa3f494e29541d75bd62c14b84ce7" exitCode=0 Jul 22 18:19:27.297045 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.296950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-wq85t" event={"ID":"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf","Type":"ContainerDied","Data":"ca44a63ca9d903a01187ad13673a780aefbfa3f494e29541d75bd62c14b84ce7"} Jul 22 18:19:27.297346 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.297320 2562 scope.go:117] "RemoveContainer" containerID="ca44a63ca9d903a01187ad13673a780aefbfa3f494e29541d75bd62c14b84ce7" Jul 22 18:19:27.470885 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.470821 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:19:27.597683 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.597642 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-oauth-config\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.597851 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.597699 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69fks\" (UniqueName: \"kubernetes.io/projected/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-kube-api-access-69fks\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.597851 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.597736 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-service-ca\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.597925 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.597842 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-config\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.597925 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.597918 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-trusted-ca-bundle\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.598017 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.597978 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-oauth-serving-cert\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.598064 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.598052 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-serving-cert\") pod \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\" (UID: \"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3\") " Jul 22 18:19:27.598107 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.598078 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:27.598359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.598318 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-service-ca\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:27.598461 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.598399 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:27.598525 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.598470 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:27.598571 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.598531 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-config" (OuterVolumeSpecName: "console-config") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:27.600200 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.600178 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:19:27.600303 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.600289 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-kube-api-access-69fks" (OuterVolumeSpecName: "kube-api-access-69fks") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "kube-api-access-69fks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:27.600508 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.600493 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" (UID: "c8b90cc4-f4d4-43c6-abf2-1578a55dafc3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:19:27.699717 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.699688 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-serving-cert\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:27.699717 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.699713 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-oauth-config\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:27.699717 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.699724 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69fks\" (UniqueName: \"kubernetes.io/projected/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-kube-api-access-69fks\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:27.699717 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.699733 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-console-config\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:27.699965 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.699750 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-trusted-ca-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:27.699965 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:27.699766 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3-oauth-serving-cert\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:19:28.301990 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.301950 2562 generic.go:356] "Generic (PLEG): container finished" podID="c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" containerID="ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4" exitCode=0 Jul 22 18:19:28.302418 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.302005 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc88f4fd-24hph" Jul 22 18:19:28.302418 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.302043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc88f4fd-24hph" event={"ID":"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3","Type":"ContainerDied","Data":"ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4"} Jul 22 18:19:28.302418 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.302091 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc88f4fd-24hph" event={"ID":"c8b90cc4-f4d4-43c6-abf2-1578a55dafc3","Type":"ContainerDied","Data":"2c137af52b9ef35db1a6c8f82156d6c4651ed978acf58b4fa94de8429ed81047"} Jul 22 18:19:28.302418 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.302111 2562 scope.go:117] "RemoveContainer" containerID="ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4" Jul 22 18:19:28.304009 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.303987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-wq85t" event={"ID":"0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf","Type":"ContainerStarted","Data":"0eb2eb06a94a4e97fa4dfb0a3f3834248b9feeeb20eca141fabdd95497766dcb"} Jul 22 18:19:28.311099 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.311083 2562 scope.go:117] "RemoveContainer" containerID="ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4" Jul 22 18:19:28.311338 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:19:28.311319 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4\": container with ID starting with ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4 not found: ID does not exist" containerID="ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4" Jul 22 18:19:28.311396 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.311348 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4"} err="failed to get container status \"ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4\": rpc error: code = NotFound desc = could not find container \"ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4\": container with ID starting with ca39262ea79bf378f986251de35f0c5ef94220d5abcfedb2067cfd9bb7175fc4 not found: ID does not exist" Jul 22 18:19:28.332951 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.332928 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fc88f4fd-24hph"] Jul 22 18:19:28.336926 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:28.336906 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85fc88f4fd-24hph"] Jul 22 18:19:29.161305 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:19:29.161271 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" path="/var/lib/kubelet/pods/c8b90cc4-f4d4-43c6-abf2-1578a55dafc3/volumes" Jul 22 18:20:01.086642 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:01.086586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:20:01.089013 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:01.088992 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce166cb2-e97b-4723-8510-978686ac1f3c-metrics-certs\") pod \"network-metrics-daemon-ghgbv\" (UID: \"ce166cb2-e97b-4723-8510-978686ac1f3c\") " pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:20:01.159897 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:01.159866 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjc8f\"" Jul 22 18:20:01.167630 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:01.167611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ghgbv" Jul 22 18:20:01.314465 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:01.314431 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ghgbv"] Jul 22 18:20:01.317478 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:20:01.317449 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce166cb2_e97b_4723_8510_978686ac1f3c.slice/crio-0df5a784df1fd7212ae4171de7c5a06bcb8bae17cb2cccfc362a24d587d655de WatchSource:0}: Error finding container 0df5a784df1fd7212ae4171de7c5a06bcb8bae17cb2cccfc362a24d587d655de: Status 404 returned error can't find the container with id 0df5a784df1fd7212ae4171de7c5a06bcb8bae17cb2cccfc362a24d587d655de Jul 22 18:20:01.441784 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:01.441753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ghgbv" event={"ID":"ce166cb2-e97b-4723-8510-978686ac1f3c","Type":"ContainerStarted","Data":"0df5a784df1fd7212ae4171de7c5a06bcb8bae17cb2cccfc362a24d587d655de"} Jul 22 18:20:03.452148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:03.452112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ghgbv" event={"ID":"ce166cb2-e97b-4723-8510-978686ac1f3c","Type":"ContainerStarted","Data":"d694a4a9be991f69c27b76da33511d97d4b91de0e1d22762efd41e6d5dd55ef8"} Jul 22 18:20:03.452518 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:03.452184 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ghgbv" event={"ID":"ce166cb2-e97b-4723-8510-978686ac1f3c","Type":"ContainerStarted","Data":"ab146008299c8b1ba4847d833c93b8b905108b229313a1a746580e4d5bba43f6"} Jul 22 18:20:03.467463 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:03.467418 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ghgbv" podStartSLOduration=374.650066136 podStartE2EDuration="6m16.467402896s" totalImagesPullingTime="1.81733676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:20:03.466072555 +0000 UTC m=+376.742498899" watchObservedRunningTime="2026-07-22 18:20:03.467402896 +0000 UTC m=+376.743829254" Jul 22 18:20:10.154634 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.154602 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:20:10.155042 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.154930 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="alertmanager" containerID="cri-o://fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136" gracePeriod=120 Jul 22 18:20:10.155042 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.154983 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-metric" containerID="cri-o://4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a" gracePeriod=120 Jul 22 18:20:10.155042 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.155022 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-web" containerID="cri-o://33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e" gracePeriod=120 Jul 22 18:20:10.155219 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.155039 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="config-reloader" containerID="cri-o://8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1" gracePeriod=120 Jul 22 18:20:10.155219 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.155099 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy" containerID="cri-o://7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a" gracePeriod=120 Jul 22 18:20:10.155219 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.155079 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="prom-label-proxy" containerID="cri-o://d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b" gracePeriod=120 Jul 22 18:20:10.486849 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486820 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b" exitCode=0 Jul 22 18:20:10.486849 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486844 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a" exitCode=0 Jul 22 18:20:10.486849 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486850 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1" exitCode=0 Jul 22 18:20:10.486849 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486856 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136" exitCode=0 Jul 22 18:20:10.487117 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486904 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b"} Jul 22 18:20:10.487117 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a"} Jul 22 18:20:10.487117 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.486996 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1"} Jul 22 18:20:10.487117 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:10.487020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136"} Jul 22 18:20:11.404579 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.404556 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.493319 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493242 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a" exitCode=0 Jul 22 18:20:11.493319 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493267 2562 generic.go:356] "Generic (PLEG): container finished" podID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerID="33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e" exitCode=0 Jul 22 18:20:11.493483 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493325 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.493483 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a"} Jul 22 18:20:11.493483 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e"} Jul 22 18:20:11.493483 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74cd8c5d-351d-4b87-bd01-8effc5eef078","Type":"ContainerDied","Data":"b051929ac1fe50aac999326b9785ab545e85b21ceb8705126e4e9cd10974b04b"} Jul 22 18:20:11.493483 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.493475 2562 scope.go:117] "RemoveContainer" containerID="d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b" Jul 22 18:20:11.501360 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.501341 2562 scope.go:117] "RemoveContainer" containerID="4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a" Jul 22 18:20:11.508290 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.508276 2562 scope.go:117] "RemoveContainer" containerID="7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a" Jul 22 18:20:11.515030 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.515009 2562 scope.go:117] "RemoveContainer" containerID="33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e" Jul 22 18:20:11.521640 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.521625 2562 scope.go:117] "RemoveContainer" containerID="8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1" Jul 22 18:20:11.528214 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.528195 2562 scope.go:117] "RemoveContainer" containerID="fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136" Jul 22 18:20:11.535023 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.535008 2562 scope.go:117] "RemoveContainer" containerID="1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34" Jul 22 18:20:11.541414 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.541397 2562 scope.go:117] "RemoveContainer" containerID="d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b" Jul 22 18:20:11.541638 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.541622 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b\": container with ID starting with d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b not found: ID does not exist" containerID="d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b" Jul 22 18:20:11.541714 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.541687 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b"} err="failed to get container status \"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b\": rpc error: code = NotFound desc = could not find container \"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b\": container with ID starting with d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b not found: ID does not exist" Jul 22 18:20:11.541714 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.541713 2562 scope.go:117] "RemoveContainer" containerID="4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a" Jul 22 18:20:11.541933 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.541920 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a\": container with ID starting with 4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a not found: ID does not exist" containerID="4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a" Jul 22 18:20:11.541978 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.541936 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a"} err="failed to get container status \"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a\": rpc error: code = NotFound desc = could not find container \"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a\": container with ID starting with 4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a not found: ID does not exist" Jul 22 18:20:11.541978 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.541948 2562 scope.go:117] "RemoveContainer" containerID="7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a" Jul 22 18:20:11.542161 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.542144 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a\": container with ID starting with 7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a not found: ID does not exist" containerID="7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a" Jul 22 18:20:11.542221 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542170 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a"} err="failed to get container status \"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a\": rpc error: code = NotFound desc = could not find container \"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a\": container with ID starting with 7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a not found: ID does not exist" Jul 22 18:20:11.542221 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542192 2562 scope.go:117] "RemoveContainer" containerID="33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e" Jul 22 18:20:11.542410 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.542396 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e\": container with ID starting with 33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e not found: ID does not exist" containerID="33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e" Jul 22 18:20:11.542462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542413 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e"} err="failed to get container status \"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e\": rpc error: code = NotFound desc = could not find container \"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e\": container with ID starting with 33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e not found: ID does not exist" Jul 22 18:20:11.542462 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542424 2562 scope.go:117] "RemoveContainer" containerID="8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1" Jul 22 18:20:11.542595 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.542580 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1\": container with ID starting with 8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1 not found: ID does not exist" containerID="8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1" Jul 22 18:20:11.542633 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542597 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1"} err="failed to get container status \"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1\": rpc error: code = NotFound desc = could not find container \"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1\": container with ID starting with 8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1 not found: ID does not exist" Jul 22 18:20:11.542633 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542608 2562 scope.go:117] "RemoveContainer" containerID="fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136" Jul 22 18:20:11.542872 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.542855 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136\": container with ID starting with fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136 not found: ID does not exist" containerID="fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136" Jul 22 18:20:11.542936 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542878 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136"} err="failed to get container status \"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136\": rpc error: code = NotFound desc = could not find container \"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136\": container with ID starting with fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136 not found: ID does not exist" Jul 22 18:20:11.542936 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.542898 2562 scope.go:117] "RemoveContainer" containerID="1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34" Jul 22 18:20:11.543102 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:11.543087 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34\": container with ID starting with 1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34 not found: ID does not exist" containerID="1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34" Jul 22 18:20:11.543136 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543105 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34"} err="failed to get container status \"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34\": rpc error: code = NotFound desc = could not find container \"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34\": container with ID starting with 1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34 not found: ID does not exist" Jul 22 18:20:11.543136 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543117 2562 scope.go:117] "RemoveContainer" containerID="d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b" Jul 22 18:20:11.543280 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543265 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b"} err="failed to get container status \"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b\": rpc error: code = NotFound desc = could not find container \"d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b\": container with ID starting with d09dc79ef60e367db1545990a9c07c438246227c3c420a4bc8c1bfda83371a8b not found: ID does not exist" Jul 22 18:20:11.543321 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543281 2562 scope.go:117] "RemoveContainer" containerID="4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a" Jul 22 18:20:11.543477 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543460 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a"} err="failed to get container status \"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a\": rpc error: code = NotFound desc = could not find container \"4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a\": container with ID starting with 4690ebaac2046f55da288fd51f21007a8c9f84582b2ef1688dea7536558b6b2a not found: ID does not exist" Jul 22 18:20:11.543527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543477 2562 scope.go:117] "RemoveContainer" containerID="7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a" Jul 22 18:20:11.543674 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543632 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a"} err="failed to get container status \"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a\": rpc error: code = NotFound desc = could not find container \"7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a\": container with ID starting with 7371987924e6e066fa2c4202713482ea4025373a118cdcd91fada919e04b3c8a not found: ID does not exist" Jul 22 18:20:11.543727 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543674 2562 scope.go:117] "RemoveContainer" containerID="33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e" Jul 22 18:20:11.543855 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543836 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e"} err="failed to get container status \"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e\": rpc error: code = NotFound desc = could not find container \"33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e\": container with ID starting with 33cdb1b85f58e0722c20c8650973160a78015f4c1045bc3ee0e3e57f22b0488e not found: ID does not exist" Jul 22 18:20:11.543922 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.543857 2562 scope.go:117] "RemoveContainer" containerID="8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1" Jul 22 18:20:11.544088 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.544073 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1"} err="failed to get container status \"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1\": rpc error: code = NotFound desc = could not find container \"8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1\": container with ID starting with 8deaf183ed019406ab09e45d126f68f58a46b6d8bbd788063b1a2b24766b27f1 not found: ID does not exist" Jul 22 18:20:11.544130 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.544088 2562 scope.go:117] "RemoveContainer" containerID="fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136" Jul 22 18:20:11.544309 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.544291 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136"} err="failed to get container status \"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136\": rpc error: code = NotFound desc = could not find container \"fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136\": container with ID starting with fc71f52fe0c68652c4a60d5b61bb967736111713ff88d7bd232abf3102caa136 not found: ID does not exist" Jul 22 18:20:11.544355 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.544310 2562 scope.go:117] "RemoveContainer" containerID="1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34" Jul 22 18:20:11.544523 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.544504 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34"} err="failed to get container status \"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34\": rpc error: code = NotFound desc = could not find container \"1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34\": container with ID starting with 1d9dce8d103d4a7327491d695e1b54db73f0bf3ad77198cb6b2945a828c0fb34 not found: ID does not exist" Jul 22 18:20:11.573731 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573703 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-web\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.573859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573745 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-tls-assets\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.573859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573763 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-web-config\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.573859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573785 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.573859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573805 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-main-db\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.573859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573826 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-out\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.573859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573841 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhd5x\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-kube-api-access-dhd5x\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573874 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-volume\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573912 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573943 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-metrics-client-ca\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.573967 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-cluster-tls-config\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.574015 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-trusted-ca-bundle\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.574052 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-metric\") pod \"74cd8c5d-351d-4b87-bd01-8effc5eef078\" (UID: \"74cd8c5d-351d-4b87-bd01-8effc5eef078\") " Jul 22 18:20:11.574451 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.574186 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:20:11.574451 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.574329 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-main-db\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.574451 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.574346 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:11.575342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.575291 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:11.577255 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577207 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-out" (OuterVolumeSpecName: "config-out") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:20:11.577255 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577229 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.577404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577272 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-volume" (OuterVolumeSpecName: "config-volume") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.577404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577313 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.577404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577342 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.577625 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577606 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-kube-api-access-dhd5x" (OuterVolumeSpecName: "kube-api-access-dhd5x") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "kube-api-access-dhd5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:20:11.577625 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.577605 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.578779 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.578750 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:20:11.582064 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.582038 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.588166 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.588145 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-web-config" (OuterVolumeSpecName: "web-config") pod "74cd8c5d-351d-4b87-bd01-8effc5eef078" (UID: "74cd8c5d-351d-4b87-bd01-8effc5eef078"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:11.675148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675112 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675148 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-metrics-client-ca\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675157 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-cluster-tls-config\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675167 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74cd8c5d-351d-4b87-bd01-8effc5eef078-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675177 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675185 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675194 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-tls-assets\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675223 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-web-config\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675231 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-secret-alertmanager-main-tls\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675239 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-out\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675247 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhd5x\" (UniqueName: \"kubernetes.io/projected/74cd8c5d-351d-4b87-bd01-8effc5eef078-kube-api-access-dhd5x\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.675342 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.675254 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74cd8c5d-351d-4b87-bd01-8effc5eef078-config-volume\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:11.816836 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.816811 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:20:11.820867 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.820840 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:20:11.845765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.845736 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:20:11.846066 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846049 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="init-config-reloader" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846067 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="init-config-reloader" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846085 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41061829-7e06-4e65-94c7-e29b592f734e" containerName="registry" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846092 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="41061829-7e06-4e65-94c7-e29b592f734e" containerName="registry" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846105 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="alertmanager" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846113 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="alertmanager" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846121 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-metric" Jul 22 18:20:11.846144 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846130 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-metric" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846167 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-web" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846176 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-web" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846189 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" containerName="console" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846197 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" containerName="console" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846212 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="prom-label-proxy" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846220 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="prom-label-proxy" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846236 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="config-reloader" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846245 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="config-reloader" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846258 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846267 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846333 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="alertmanager" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846344 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="41061829-7e06-4e65-94c7-e29b592f734e" containerName="registry" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846356 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846366 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b90cc4-f4d4-43c6-abf2-1578a55dafc3" containerName="console" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846376 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="prom-label-proxy" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846387 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-metric" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846397 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="config-reloader" Jul 22 18:20:11.846458 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.846407 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" containerName="kube-rbac-proxy-web" Jul 22 18:20:11.851629 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.851610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.853773 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.853753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 18:20:11.853867 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.853806 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 18:20:11.854060 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854045 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 18:20:11.854413 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854245 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 18:20:11.854413 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854332 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 18:20:11.854413 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 18:20:11.854413 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ccdrf\"" Jul 22 18:20:11.857017 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854612 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 18:20:11.857017 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.854957 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 18:20:11.859141 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.859124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 18:20:11.864314 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.864292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:20:11.977526 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977709 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977709 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-web-config\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977709 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816a5cb0-03a8-4509-bb45-8a326935a45b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977709 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99h8\" (UniqueName: \"kubernetes.io/projected/816a5cb0-03a8-4509-bb45-8a326935a45b-kube-api-access-b99h8\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977709 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816a5cb0-03a8-4509-bb45-8a326935a45b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816a5cb0-03a8-4509-bb45-8a326935a45b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-config-volume\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816a5cb0-03a8-4509-bb45-8a326935a45b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:11.977912 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:11.977900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816a5cb0-03a8-4509-bb45-8a326935a45b-config-out\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.078755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.078628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816a5cb0-03a8-4509-bb45-8a326935a45b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.078755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.078697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b99h8\" (UniqueName: \"kubernetes.io/projected/816a5cb0-03a8-4509-bb45-8a326935a45b-kube-api-access-b99h8\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.078755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.078736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816a5cb0-03a8-4509-bb45-8a326935a45b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.078755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.078757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.078755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.078777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079140 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.078808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079289 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816a5cb0-03a8-4509-bb45-8a326935a45b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079349 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-config-volume\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079412 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816a5cb0-03a8-4509-bb45-8a326935a45b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079412 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816a5cb0-03a8-4509-bb45-8a326935a45b-config-out\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079508 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079565 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.079565 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.079544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-web-config\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.080528 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.080241 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816a5cb0-03a8-4509-bb45-8a326935a45b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.081640 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.081265 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816a5cb0-03a8-4509-bb45-8a326935a45b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.082467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.082439 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/816a5cb0-03a8-4509-bb45-8a326935a45b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.082567 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.082472 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-web-config\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.082786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.082759 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/816a5cb0-03a8-4509-bb45-8a326935a45b-config-out\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.082891 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.082849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/816a5cb0-03a8-4509-bb45-8a326935a45b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.082954 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.082905 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.083128 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.083072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.084569 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.084229 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-config-volume\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.084750 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.084729 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.084961 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.084939 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.087586 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.087123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/816a5cb0-03a8-4509-bb45-8a326935a45b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.088463 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.088443 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99h8\" (UniqueName: \"kubernetes.io/projected/816a5cb0-03a8-4509-bb45-8a326935a45b-kube-api-access-b99h8\") pod \"alertmanager-main-0\" (UID: \"816a5cb0-03a8-4509-bb45-8a326935a45b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.163026 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.162993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 18:20:12.303941 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.303549 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 18:20:12.306425 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:20:12.306389 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816a5cb0_03a8_4509_bb45_8a326935a45b.slice/crio-cff4b63313bbdcc1e7b3205b282f38cf35ea6ceb6fc5d2938b3f1aab3afb95cf WatchSource:0}: Error finding container cff4b63313bbdcc1e7b3205b282f38cf35ea6ceb6fc5d2938b3f1aab3afb95cf: Status 404 returned error can't find the container with id cff4b63313bbdcc1e7b3205b282f38cf35ea6ceb6fc5d2938b3f1aab3afb95cf Jul 22 18:20:12.499466 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.499432 2562 generic.go:356] "Generic (PLEG): container finished" podID="816a5cb0-03a8-4509-bb45-8a326935a45b" containerID="914ec3a7d05e4c12ce899c2ed3792527495a89432e69b498cb714616f9b0aae2" exitCode=0 Jul 22 18:20:12.499868 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.499506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerDied","Data":"914ec3a7d05e4c12ce899c2ed3792527495a89432e69b498cb714616f9b0aae2"} Jul 22 18:20:12.499868 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:12.499553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"cff4b63313bbdcc1e7b3205b282f38cf35ea6ceb6fc5d2938b3f1aab3afb95cf"} Jul 22 18:20:13.161516 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.161480 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74cd8c5d-351d-4b87-bd01-8effc5eef078" path="/var/lib/kubelet/pods/74cd8c5d-351d-4b87-bd01-8effc5eef078/volumes" Jul 22 18:20:13.508041 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.508005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"1254c440452d207d3453c8418a46a0d293094db5f3868575130b5ba5322f5620"} Jul 22 18:20:13.508423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.508083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"436f065be67bcf2e1d0f7fd2b6fb8491d8e2f90a34c0e483f6ecc56a33e9f164"} Jul 22 18:20:13.508423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.508123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"b2219820d2dc0fa1463f2b3ce6283198f41f2c2683d9de95e6931454b428e427"} Jul 22 18:20:13.508423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.508162 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"ef54d014f4b3a5f3b22c1457088359a31bb366b6199390fc11a99938e04c2bb7"} Jul 22 18:20:13.508423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.508200 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"8636381c5b02e89cee6e4f9f23a5b7036b3af8682be8e3f46254a2fe13cc8390"} Jul 22 18:20:13.508423 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.508233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"816a5cb0-03a8-4509-bb45-8a326935a45b","Type":"ContainerStarted","Data":"ad0de6c64b6cc106cbefa3f411e81f48afb36932669903a7b2aab95eef9bf6b8"} Jul 22 18:20:13.536401 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:13.536353 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.520972329 podStartE2EDuration="2.536337572s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.365243ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:20:13.534077721 +0000 UTC m=+386.810504066" watchObservedRunningTime="2026-07-22 18:20:13.536337572 +0000 UTC m=+386.812763932" Jul 22 18:20:32.613885 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:32.613847 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8699b787-wspfd"] Jul 22 18:20:57.636584 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.636540 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8699b787-wspfd" podUID="152432b7-1dc3-4570-ba96-93c016c69aca" containerName="console" containerID="cri-o://b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9" gracePeriod=15 Jul 22 18:20:57.883120 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.883095 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:20:57.960763 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.960734 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-service-ca\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.960928 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.960767 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-trusted-ca-bundle\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.960928 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.960801 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-console-config\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.960928 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.960825 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fx8l\" (UniqueName: \"kubernetes.io/projected/152432b7-1dc3-4570-ba96-93c016c69aca-kube-api-access-7fx8l\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.961061 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.960972 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-oauth-serving-cert\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.961061 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961046 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-oauth-config\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.961164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961075 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-serving-cert\") pod \"152432b7-1dc3-4570-ba96-93c016c69aca\" (UID: \"152432b7-1dc3-4570-ba96-93c016c69aca\") " Jul 22 18:20:57.961164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961137 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-service-ca" (OuterVolumeSpecName: "service-ca") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:57.961264 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961205 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-console-config" (OuterVolumeSpecName: "console-config") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:57.961264 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961221 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:57.961416 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961397 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-service-ca\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:57.961416 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961413 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-trusted-ca-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:57.961416 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961422 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-console-config\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:57.961614 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.961432 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:57.963355 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.963330 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:57.963443 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.963356 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/152432b7-1dc3-4570-ba96-93c016c69aca-kube-api-access-7fx8l" (OuterVolumeSpecName: "kube-api-access-7fx8l") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "kube-api-access-7fx8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:20:57.963443 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:57.963394 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "152432b7-1dc3-4570-ba96-93c016c69aca" (UID: "152432b7-1dc3-4570-ba96-93c016c69aca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:58.061815 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.061785 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fx8l\" (UniqueName: \"kubernetes.io/projected/152432b7-1dc3-4570-ba96-93c016c69aca-kube-api-access-7fx8l\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:58.061815 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.061818 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/152432b7-1dc3-4570-ba96-93c016c69aca-oauth-serving-cert\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:58.061997 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.061828 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-oauth-config\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:58.061997 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.061837 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/152432b7-1dc3-4570-ba96-93c016c69aca-console-serving-cert\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:20:58.681424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.681383 2562 generic.go:356] "Generic (PLEG): container finished" podID="152432b7-1dc3-4570-ba96-93c016c69aca" containerID="b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9" exitCode=0 Jul 22 18:20:58.681424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.681430 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8699b787-wspfd" Jul 22 18:20:58.681929 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.681438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8699b787-wspfd" event={"ID":"152432b7-1dc3-4570-ba96-93c016c69aca","Type":"ContainerDied","Data":"b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9"} Jul 22 18:20:58.681929 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.681479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8699b787-wspfd" event={"ID":"152432b7-1dc3-4570-ba96-93c016c69aca","Type":"ContainerDied","Data":"11af1badedfe288d70cdba42257b3976606159c70d7eca82923c460ac94ce32a"} Jul 22 18:20:58.681929 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.681498 2562 scope.go:117] "RemoveContainer" containerID="b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9" Jul 22 18:20:58.690291 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.690271 2562 scope.go:117] "RemoveContainer" containerID="b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9" Jul 22 18:20:58.690538 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:20:58.690520 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9\": container with ID starting with b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9 not found: ID does not exist" containerID="b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9" Jul 22 18:20:58.690581 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.690545 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9"} err="failed to get container status \"b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9\": rpc error: code = NotFound desc = could not find container \"b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9\": container with ID starting with b01d9c77f4c87505306fdd4605faf2453c88c5d8af2e12afcfa9ccef3527a9f9 not found: ID does not exist" Jul 22 18:20:58.701851 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.701825 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8699b787-wspfd"] Jul 22 18:20:58.705522 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:58.705503 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8699b787-wspfd"] Jul 22 18:20:59.161201 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:20:59.161127 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="152432b7-1dc3-4570-ba96-93c016c69aca" path="/var/lib/kubelet/pods/152432b7-1dc3-4570-ba96-93c016c69aca/volumes" Jul 22 18:21:10.064809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.064722 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl"] Jul 22 18:21:10.065372 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.065172 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152432b7-1dc3-4570-ba96-93c016c69aca" containerName="console" Jul 22 18:21:10.065372 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.065190 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="152432b7-1dc3-4570-ba96-93c016c69aca" containerName="console" Jul 22 18:21:10.065372 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.065263 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="152432b7-1dc3-4570-ba96-93c016c69aca" containerName="console" Jul 22 18:21:10.068364 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.068342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.070755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.070731 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-475qt\"" Jul 22 18:21:10.070859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.070731 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 18:21:10.071435 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.071420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 18:21:10.078131 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.078100 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl"] Jul 22 18:21:10.163909 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.163877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.164074 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.163920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.164074 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.164007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n57q\" (UniqueName: \"kubernetes.io/projected/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-kube-api-access-7n57q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.264997 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.264956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.265202 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.265013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.265202 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.265067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n57q\" (UniqueName: \"kubernetes.io/projected/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-kube-api-access-7n57q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.265425 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.265402 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.265492 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.265453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.274366 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.274340 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n57q\" (UniqueName: \"kubernetes.io/projected/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-kube-api-access-7n57q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.378256 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.378159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:10.507745 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.507718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl"] Jul 22 18:21:10.510179 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:10.510154 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00aa623f_cc51_4d1b_8bf3_b8def6cdf744.slice/crio-841669e6e90c26d6fbc1367a5a78c0ebe36de1b9a1bfd0b4dd414e308f3ba1dd WatchSource:0}: Error finding container 841669e6e90c26d6fbc1367a5a78c0ebe36de1b9a1bfd0b4dd414e308f3ba1dd: Status 404 returned error can't find the container with id 841669e6e90c26d6fbc1367a5a78c0ebe36de1b9a1bfd0b4dd414e308f3ba1dd Jul 22 18:21:10.730892 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:10.730853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" event={"ID":"00aa623f-cc51-4d1b-8bf3-b8def6cdf744","Type":"ContainerStarted","Data":"841669e6e90c26d6fbc1367a5a78c0ebe36de1b9a1bfd0b4dd414e308f3ba1dd"} Jul 22 18:21:19.769892 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:19.769858 2562 generic.go:356] "Generic (PLEG): container finished" podID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerID="8a6dda8720e6c76480713824e5c8737a3c3afba970df6405ce7344f62d50fb12" exitCode=0 Jul 22 18:21:19.770313 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:19.769926 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" event={"ID":"00aa623f-cc51-4d1b-8bf3-b8def6cdf744","Type":"ContainerDied","Data":"8a6dda8720e6c76480713824e5c8737a3c3afba970df6405ce7344f62d50fb12"} Jul 22 18:21:22.784524 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:22.784489 2562 generic.go:356] "Generic (PLEG): container finished" podID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerID="9ef7d20996a95c6b226b7ba52ac5ca8241e9110384dd5b37a0f79faf3b0ba0fe" exitCode=0 Jul 22 18:21:22.784954 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:22.784544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" event={"ID":"00aa623f-cc51-4d1b-8bf3-b8def6cdf744","Type":"ContainerDied","Data":"9ef7d20996a95c6b226b7ba52ac5ca8241e9110384dd5b37a0f79faf3b0ba0fe"} Jul 22 18:21:31.824703 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:31.824641 2562 generic.go:356] "Generic (PLEG): container finished" podID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerID="061660bc2ed3811aedb3c261786deadc802fab7c5c42dc32005a8732cdc2a604" exitCode=0 Jul 22 18:21:31.825101 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:31.824746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" event={"ID":"00aa623f-cc51-4d1b-8bf3-b8def6cdf744","Type":"ContainerDied","Data":"061660bc2ed3811aedb3c261786deadc802fab7c5c42dc32005a8732cdc2a604"} Jul 22 18:21:32.954499 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:32.954476 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:33.057631 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.057583 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-util\") pod \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " Jul 22 18:21:33.057835 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.057671 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n57q\" (UniqueName: \"kubernetes.io/projected/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-kube-api-access-7n57q\") pod \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " Jul 22 18:21:33.057835 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.057713 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-bundle\") pod \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\" (UID: \"00aa623f-cc51-4d1b-8bf3-b8def6cdf744\") " Jul 22 18:21:33.058387 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.058362 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-bundle" (OuterVolumeSpecName: "bundle") pod "00aa623f-cc51-4d1b-8bf3-b8def6cdf744" (UID: "00aa623f-cc51-4d1b-8bf3-b8def6cdf744"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:21:33.060107 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.060088 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-kube-api-access-7n57q" (OuterVolumeSpecName: "kube-api-access-7n57q") pod "00aa623f-cc51-4d1b-8bf3-b8def6cdf744" (UID: "00aa623f-cc51-4d1b-8bf3-b8def6cdf744"). InnerVolumeSpecName "kube-api-access-7n57q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:21:33.061858 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.061837 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-util" (OuterVolumeSpecName: "util") pod "00aa623f-cc51-4d1b-8bf3-b8def6cdf744" (UID: "00aa623f-cc51-4d1b-8bf3-b8def6cdf744"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:21:33.158438 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.158361 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:21:33.158438 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.158384 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:21:33.158438 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.158394 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n57q\" (UniqueName: \"kubernetes.io/projected/00aa623f-cc51-4d1b-8bf3-b8def6cdf744-kube-api-access-7n57q\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:21:33.834994 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.834955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" event={"ID":"00aa623f-cc51-4d1b-8bf3-b8def6cdf744","Type":"ContainerDied","Data":"841669e6e90c26d6fbc1367a5a78c0ebe36de1b9a1bfd0b4dd414e308f3ba1dd"} Jul 22 18:21:33.835161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.835042 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="841669e6e90c26d6fbc1367a5a78c0ebe36de1b9a1bfd0b4dd414e308f3ba1dd" Jul 22 18:21:33.835161 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:33.834974 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhbjl" Jul 22 18:21:38.081160 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081130 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz"] Jul 22 18:21:38.081527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081445 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="pull" Jul 22 18:21:38.081527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081456 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="pull" Jul 22 18:21:38.081527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081467 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="extract" Jul 22 18:21:38.081527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081473 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="extract" Jul 22 18:21:38.081527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081492 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="util" Jul 22 18:21:38.081527 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081497 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="util" Jul 22 18:21:38.081729 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.081548 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00aa623f-cc51-4d1b-8bf3-b8def6cdf744" containerName="extract" Jul 22 18:21:38.118805 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.118778 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz"] Jul 22 18:21:38.118938 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.118863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.121142 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.121114 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 18:21:38.121323 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.121305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:21:38.121376 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.121331 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qz7f6\"" Jul 22 18:21:38.200075 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.200042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5f5812-6ee4-4b4d-a421-b0e82d39ff65-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxcvz\" (UID: \"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.200220 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.200095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lslh\" (UniqueName: \"kubernetes.io/projected/0c5f5812-6ee4-4b4d-a421-b0e82d39ff65-kube-api-access-8lslh\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxcvz\" (UID: \"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.301387 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.301352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5f5812-6ee4-4b4d-a421-b0e82d39ff65-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxcvz\" (UID: \"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.301518 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.301437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lslh\" (UniqueName: \"kubernetes.io/projected/0c5f5812-6ee4-4b4d-a421-b0e82d39ff65-kube-api-access-8lslh\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxcvz\" (UID: \"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.301851 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.301830 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5f5812-6ee4-4b4d-a421-b0e82d39ff65-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxcvz\" (UID: \"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.309622 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.309602 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lslh\" (UniqueName: \"kubernetes.io/projected/0c5f5812-6ee4-4b4d-a421-b0e82d39ff65-kube-api-access-8lslh\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxcvz\" (UID: \"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.432553 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.432524 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" Jul 22 18:21:38.568974 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.568943 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz"] Jul 22 18:21:38.572093 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:38.572069 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5f5812_6ee4_4b4d_a421_b0e82d39ff65.slice/crio-5213595ffa92fb5a82a8b7a2d378b12ed49fc01ee5778a0df5c4613e708079c4 WatchSource:0}: Error finding container 5213595ffa92fb5a82a8b7a2d378b12ed49fc01ee5778a0df5c4613e708079c4: Status 404 returned error can't find the container with id 5213595ffa92fb5a82a8b7a2d378b12ed49fc01ee5778a0df5c4613e708079c4 Jul 22 18:21:38.858484 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:38.858400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" event={"ID":"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65","Type":"ContainerStarted","Data":"5213595ffa92fb5a82a8b7a2d378b12ed49fc01ee5778a0df5c4613e708079c4"} Jul 22 18:21:40.870145 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:40.870105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" event={"ID":"0c5f5812-6ee4-4b4d-a421-b0e82d39ff65","Type":"ContainerStarted","Data":"f645a7c29fd88d82923a7e5fad15dfcfecdbe4039a5867b2d06de91676355e96"} Jul 22 18:21:40.890731 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:40.890680 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxcvz" podStartSLOduration=1.237888877 podStartE2EDuration="2.890639975s" totalImagesPullingTime="1.652751098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:21:40.88872115 +0000 UTC m=+474.165147511" watchObservedRunningTime="2026-07-22 18:21:40.890639975 +0000 UTC m=+474.167066309" Jul 22 18:21:42.138220 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.138186 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff"] Jul 22 18:21:42.141761 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.141745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.144204 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.144181 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 18:21:42.144852 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.144835 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-475qt\"" Jul 22 18:21:42.144942 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.144848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 18:21:42.149932 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.149908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff"] Jul 22 18:21:42.237134 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.237098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.237367 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.237214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbfjb\" (UniqueName: \"kubernetes.io/projected/27f94b79-7797-4c6f-b623-0f88c60178d2-kube-api-access-xbfjb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.237453 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.237417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.338353 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.338321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbfjb\" (UniqueName: \"kubernetes.io/projected/27f94b79-7797-4c6f-b623-0f88c60178d2-kube-api-access-xbfjb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.338512 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.338361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.338512 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.338411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.338754 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.338738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.338813 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.338796 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.346095 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.346073 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbfjb\" (UniqueName: \"kubernetes.io/projected/27f94b79-7797-4c6f-b623-0f88c60178d2-kube-api-access-xbfjb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.451320 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.451290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:42.577694 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.577670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff"] Jul 22 18:21:42.580061 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:42.580035 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f94b79_7797_4c6f_b623_0f88c60178d2.slice/crio-4f5895154e6389d56ce2343b21920b2c609d7db508cbaf626ef43fc447e2380b WatchSource:0}: Error finding container 4f5895154e6389d56ce2343b21920b2c609d7db508cbaf626ef43fc447e2380b: Status 404 returned error can't find the container with id 4f5895154e6389d56ce2343b21920b2c609d7db508cbaf626ef43fc447e2380b Jul 22 18:21:42.882762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.882675 2562 generic.go:356] "Generic (PLEG): container finished" podID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerID="5a019ecd46128f8b1bfd0842f746145b7267c09c28146754cb3e55d341d0e0e6" exitCode=0 Jul 22 18:21:42.882762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.882746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" event={"ID":"27f94b79-7797-4c6f-b623-0f88c60178d2","Type":"ContainerDied","Data":"5a019ecd46128f8b1bfd0842f746145b7267c09c28146754cb3e55d341d0e0e6"} Jul 22 18:21:42.882990 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:42.882794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" event={"ID":"27f94b79-7797-4c6f-b623-0f88c60178d2","Type":"ContainerStarted","Data":"4f5895154e6389d56ce2343b21920b2c609d7db508cbaf626ef43fc447e2380b"} Jul 22 18:21:43.946578 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:43.946538 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7txn8"] Jul 22 18:21:43.950118 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:43.950096 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:43.952393 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:43.952371 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 18:21:43.953012 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:43.952991 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 18:21:43.953012 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:43.953002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v6x2d\"" Jul 22 18:21:43.956752 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:43.956705 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7txn8"] Jul 22 18:21:44.053418 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.053383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hcnk\" (UniqueName: \"kubernetes.io/projected/8c2a262f-bb1c-4130-974d-54b0ea84bf4a-kube-api-access-4hcnk\") pod \"cert-manager-cainjector-559cdd8c87-7txn8\" (UID: \"8c2a262f-bb1c-4130-974d-54b0ea84bf4a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.053604 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.053506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c2a262f-bb1c-4130-974d-54b0ea84bf4a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7txn8\" (UID: \"8c2a262f-bb1c-4130-974d-54b0ea84bf4a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.154971 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.154935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c2a262f-bb1c-4130-974d-54b0ea84bf4a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7txn8\" (UID: \"8c2a262f-bb1c-4130-974d-54b0ea84bf4a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.155157 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.155015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hcnk\" (UniqueName: \"kubernetes.io/projected/8c2a262f-bb1c-4130-974d-54b0ea84bf4a-kube-api-access-4hcnk\") pod \"cert-manager-cainjector-559cdd8c87-7txn8\" (UID: \"8c2a262f-bb1c-4130-974d-54b0ea84bf4a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.163603 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.163316 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c2a262f-bb1c-4130-974d-54b0ea84bf4a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7txn8\" (UID: \"8c2a262f-bb1c-4130-974d-54b0ea84bf4a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.163603 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.163556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hcnk\" (UniqueName: \"kubernetes.io/projected/8c2a262f-bb1c-4130-974d-54b0ea84bf4a-kube-api-access-4hcnk\") pod \"cert-manager-cainjector-559cdd8c87-7txn8\" (UID: \"8c2a262f-bb1c-4130-974d-54b0ea84bf4a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.269366 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.269292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" Jul 22 18:21:44.819076 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.819054 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7txn8"] Jul 22 18:21:44.821527 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:44.821500 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c2a262f_bb1c_4130_974d_54b0ea84bf4a.slice/crio-964595ff0695a92e76fcdd95e2e32fb20935f57e6aa9b0a668429bfc640ff627 WatchSource:0}: Error finding container 964595ff0695a92e76fcdd95e2e32fb20935f57e6aa9b0a668429bfc640ff627: Status 404 returned error can't find the container with id 964595ff0695a92e76fcdd95e2e32fb20935f57e6aa9b0a668429bfc640ff627 Jul 22 18:21:44.896424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.896399 2562 generic.go:356] "Generic (PLEG): container finished" podID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerID="f16f7ab460f91c7f7230a75f7f7ef56a1759ae8507ed3c5e684be6ff350e1fff" exitCode=0 Jul 22 18:21:44.896529 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.896482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" event={"ID":"27f94b79-7797-4c6f-b623-0f88c60178d2","Type":"ContainerDied","Data":"f16f7ab460f91c7f7230a75f7f7ef56a1759ae8507ed3c5e684be6ff350e1fff"} Jul 22 18:21:44.897768 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:44.897748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" event={"ID":"8c2a262f-bb1c-4130-974d-54b0ea84bf4a","Type":"ContainerStarted","Data":"964595ff0695a92e76fcdd95e2e32fb20935f57e6aa9b0a668429bfc640ff627"} Jul 22 18:21:45.905407 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:45.905371 2562 generic.go:356] "Generic (PLEG): container finished" podID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerID="2ea3c38b64985e26e410502a3ce3500b3940f6fcb8c90d71e2f3fbb0fd924b7b" exitCode=0 Jul 22 18:21:45.905859 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:45.905459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" event={"ID":"27f94b79-7797-4c6f-b623-0f88c60178d2","Type":"ContainerDied","Data":"2ea3c38b64985e26e410502a3ce3500b3940f6fcb8c90d71e2f3fbb0fd924b7b"} Jul 22 18:21:47.297100 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.297073 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:47.383467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.383444 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbfjb\" (UniqueName: \"kubernetes.io/projected/27f94b79-7797-4c6f-b623-0f88c60178d2-kube-api-access-xbfjb\") pod \"27f94b79-7797-4c6f-b623-0f88c60178d2\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " Jul 22 18:21:47.383576 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.383489 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-bundle\") pod \"27f94b79-7797-4c6f-b623-0f88c60178d2\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " Jul 22 18:21:47.383637 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.383600 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-util\") pod \"27f94b79-7797-4c6f-b623-0f88c60178d2\" (UID: \"27f94b79-7797-4c6f-b623-0f88c60178d2\") " Jul 22 18:21:47.383930 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.383909 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-bundle" (OuterVolumeSpecName: "bundle") pod "27f94b79-7797-4c6f-b623-0f88c60178d2" (UID: "27f94b79-7797-4c6f-b623-0f88c60178d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:21:47.385491 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.385471 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f94b79-7797-4c6f-b623-0f88c60178d2-kube-api-access-xbfjb" (OuterVolumeSpecName: "kube-api-access-xbfjb") pod "27f94b79-7797-4c6f-b623-0f88c60178d2" (UID: "27f94b79-7797-4c6f-b623-0f88c60178d2"). InnerVolumeSpecName "kube-api-access-xbfjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:21:47.388344 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.388315 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-util" (OuterVolumeSpecName: "util") pod "27f94b79-7797-4c6f-b623-0f88c60178d2" (UID: "27f94b79-7797-4c6f-b623-0f88c60178d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:21:47.485097 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.485066 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbfjb\" (UniqueName: \"kubernetes.io/projected/27f94b79-7797-4c6f-b623-0f88c60178d2-kube-api-access-xbfjb\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:21:47.485097 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.485094 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:21:47.485097 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.485104 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27f94b79-7797-4c6f-b623-0f88c60178d2-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:21:47.917030 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.916994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" event={"ID":"8c2a262f-bb1c-4130-974d-54b0ea84bf4a","Type":"ContainerStarted","Data":"40f476baa13a4059354107d54e6c4b73d2eeb802dfe26776058127f668438ce9"} Jul 22 18:21:47.918721 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.918699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" event={"ID":"27f94b79-7797-4c6f-b623-0f88c60178d2","Type":"ContainerDied","Data":"4f5895154e6389d56ce2343b21920b2c609d7db508cbaf626ef43fc447e2380b"} Jul 22 18:21:47.918840 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.918739 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnq8ff" Jul 22 18:21:47.918840 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.918758 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f5895154e6389d56ce2343b21920b2c609d7db508cbaf626ef43fc447e2380b" Jul 22 18:21:47.932211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:47.932150 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7txn8" podStartSLOduration=2.415215061 podStartE2EDuration="4.932132991s" totalImagesPullingTime="2.51691793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:21:47.931254849 +0000 UTC m=+481.207681182" watchObservedRunningTime="2026-07-22 18:21:47.932132991 +0000 UTC m=+481.208559327" Jul 22 18:21:52.181669 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181616 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln"] Jul 22 18:21:52.182014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181933 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="util" Jul 22 18:21:52.182014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181944 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="util" Jul 22 18:21:52.182014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181954 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="extract" Jul 22 18:21:52.182014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181959 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="extract" Jul 22 18:21:52.182014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181981 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="pull" Jul 22 18:21:52.182014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.181987 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="pull" Jul 22 18:21:52.182217 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.182042 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f94b79-7797-4c6f-b623-0f88c60178d2" containerName="extract" Jul 22 18:21:52.184952 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.184936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.187429 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.187402 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 18:21:52.188118 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.188104 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:21:52.188168 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.188116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p9rhw\"" Jul 22 18:21:52.194071 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.194050 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln"] Jul 22 18:21:52.328193 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.328161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dec8739-bcf0-4b2a-8a2a-1fd720cb4907-tmp\") pod \"openshift-lws-operator-fd8ccff4c-67fln\" (UID: \"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.328193 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.328198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drdr\" (UniqueName: \"kubernetes.io/projected/3dec8739-bcf0-4b2a-8a2a-1fd720cb4907-kube-api-access-7drdr\") pod \"openshift-lws-operator-fd8ccff4c-67fln\" (UID: \"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.429265 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.429227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dec8739-bcf0-4b2a-8a2a-1fd720cb4907-tmp\") pod \"openshift-lws-operator-fd8ccff4c-67fln\" (UID: \"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.429467 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.429278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7drdr\" (UniqueName: \"kubernetes.io/projected/3dec8739-bcf0-4b2a-8a2a-1fd720cb4907-kube-api-access-7drdr\") pod \"openshift-lws-operator-fd8ccff4c-67fln\" (UID: \"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.429622 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.429597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dec8739-bcf0-4b2a-8a2a-1fd720cb4907-tmp\") pod \"openshift-lws-operator-fd8ccff4c-67fln\" (UID: \"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.437918 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.437859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drdr\" (UniqueName: \"kubernetes.io/projected/3dec8739-bcf0-4b2a-8a2a-1fd720cb4907-kube-api-access-7drdr\") pod \"openshift-lws-operator-fd8ccff4c-67fln\" (UID: \"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.493972 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.493944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" Jul 22 18:21:52.627683 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.627617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln"] Jul 22 18:21:52.632791 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:52.632764 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dec8739_bcf0_4b2a_8a2a_1fd720cb4907.slice/crio-c93572c0a5f28a460e8c0abbaadd561a54ac477d249d4248f566cb41455abd68 WatchSource:0}: Error finding container c93572c0a5f28a460e8c0abbaadd561a54ac477d249d4248f566cb41455abd68: Status 404 returned error can't find the container with id c93572c0a5f28a460e8c0abbaadd561a54ac477d249d4248f566cb41455abd68 Jul 22 18:21:52.943033 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:52.942999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" event={"ID":"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907","Type":"ContainerStarted","Data":"c93572c0a5f28a460e8c0abbaadd561a54ac477d249d4248f566cb41455abd68"} Jul 22 18:21:53.948852 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:53.948814 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-td67n"] Jul 22 18:21:53.952355 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:53.952336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:53.954688 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:53.954635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tlc8d\"" Jul 22 18:21:53.959210 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:53.959187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-td67n"] Jul 22 18:21:54.042508 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.042439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a-bound-sa-token\") pod \"cert-manager-55b4d954d5-td67n\" (UID: \"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a\") " pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.042856 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.042610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpgd\" (UniqueName: \"kubernetes.io/projected/e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a-kube-api-access-wfpgd\") pod \"cert-manager-55b4d954d5-td67n\" (UID: \"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a\") " pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.143411 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.143365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpgd\" (UniqueName: \"kubernetes.io/projected/e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a-kube-api-access-wfpgd\") pod \"cert-manager-55b4d954d5-td67n\" (UID: \"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a\") " pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.143605 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.143427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a-bound-sa-token\") pod \"cert-manager-55b4d954d5-td67n\" (UID: \"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a\") " pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.151441 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.151413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a-bound-sa-token\") pod \"cert-manager-55b4d954d5-td67n\" (UID: \"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a\") " pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.151682 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.151615 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpgd\" (UniqueName: \"kubernetes.io/projected/e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a-kube-api-access-wfpgd\") pod \"cert-manager-55b4d954d5-td67n\" (UID: \"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a\") " pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.262412 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.262332 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-td67n" Jul 22 18:21:54.837111 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.837087 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-td67n"] Jul 22 18:21:54.839356 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:54.839329 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9c2c4d8_90a5_4c8f_90e9_2d06857fd95a.slice/crio-d5405636f762916bfa213234cf854dafb7be4ebb34cf2317126eb9c0edcc54cc WatchSource:0}: Error finding container d5405636f762916bfa213234cf854dafb7be4ebb34cf2317126eb9c0edcc54cc: Status 404 returned error can't find the container with id d5405636f762916bfa213234cf854dafb7be4ebb34cf2317126eb9c0edcc54cc Jul 22 18:21:54.955123 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.955088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" event={"ID":"3dec8739-bcf0-4b2a-8a2a-1fd720cb4907","Type":"ContainerStarted","Data":"22c92ce302081d6074aa369e015610d814277d1653e840d1a959a8be39d2b93e"} Jul 22 18:21:54.956658 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.956612 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-td67n" event={"ID":"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a","Type":"ContainerStarted","Data":"ef61ae982457e70de04724fc7a9d6d4bd0e61f2c96638feaa181b3795419e0ff"} Jul 22 18:21:54.956766 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.956669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-td67n" event={"ID":"e9c2c4d8-90a5-4c8f-90e9-2d06857fd95a","Type":"ContainerStarted","Data":"d5405636f762916bfa213234cf854dafb7be4ebb34cf2317126eb9c0edcc54cc"} Jul 22 18:21:54.970598 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.970522 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-67fln" podStartSLOduration=0.837001473 podStartE2EDuration="2.970508635s" totalImagesPullingTime="2.133507162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:21:54.969763299 +0000 UTC m=+488.246189632" watchObservedRunningTime="2026-07-22 18:21:54.970508635 +0000 UTC m=+488.246934967" Jul 22 18:21:54.990191 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:54.990148 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-td67n" podStartSLOduration=1.990133232 podStartE2EDuration="1.990133232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:21:54.989403765 +0000 UTC m=+488.265830098" watchObservedRunningTime="2026-07-22 18:21:54.990133232 +0000 UTC m=+488.266559565" Jul 22 18:21:57.810545 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.810511 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw"] Jul 22 18:21:57.818006 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.817980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:57.820406 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.820388 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 18:21:57.820533 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.820390 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 18:21:57.820533 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.820518 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-475qt\"" Jul 22 18:21:57.824889 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.824869 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw"] Jul 22 18:21:57.975543 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.975510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9nkr\" (UniqueName: \"kubernetes.io/projected/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-kube-api-access-b9nkr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:57.975747 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.975561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:57.975747 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:57.975689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.076720 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.076598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.076720 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.076664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9nkr\" (UniqueName: \"kubernetes.io/projected/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-kube-api-access-b9nkr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.076720 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.076691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.077079 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.077053 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.077079 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.077070 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.088601 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.088571 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9nkr\" (UniqueName: \"kubernetes.io/projected/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-kube-api-access-b9nkr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.128322 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.128296 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:21:58.258486 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.258462 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw"] Jul 22 18:21:58.260938 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:21:58.260913 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0bfab1_f4db_4c21_b3f8_a70b7f845771.slice/crio-536dc52518c15dd447d69aa51e77c8c8b6f98c2e44f7a2582ceb6dbac1fbca21 WatchSource:0}: Error finding container 536dc52518c15dd447d69aa51e77c8c8b6f98c2e44f7a2582ceb6dbac1fbca21: Status 404 returned error can't find the container with id 536dc52518c15dd447d69aa51e77c8c8b6f98c2e44f7a2582ceb6dbac1fbca21 Jul 22 18:21:58.975487 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.975450 2562 generic.go:356] "Generic (PLEG): container finished" podID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerID="686b65519301371f8f17424e2ee6071be7491069c247b7b039b795a0ffde8b9e" exitCode=0 Jul 22 18:21:58.975870 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.975536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" event={"ID":"5f0bfab1-f4db-4c21-b3f8-a70b7f845771","Type":"ContainerDied","Data":"686b65519301371f8f17424e2ee6071be7491069c247b7b039b795a0ffde8b9e"} Jul 22 18:21:58.975870 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:58.975585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" event={"ID":"5f0bfab1-f4db-4c21-b3f8-a70b7f845771","Type":"ContainerStarted","Data":"536dc52518c15dd447d69aa51e77c8c8b6f98c2e44f7a2582ceb6dbac1fbca21"} Jul 22 18:21:59.981771 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:59.981735 2562 generic.go:356] "Generic (PLEG): container finished" podID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerID="f368d25b5c3e1a87e6cace8a0149888baf3e457fd07ae5656601a2d65cc73ae4" exitCode=0 Jul 22 18:21:59.982136 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:21:59.981792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" event={"ID":"5f0bfab1-f4db-4c21-b3f8-a70b7f845771","Type":"ContainerDied","Data":"f368d25b5c3e1a87e6cace8a0149888baf3e457fd07ae5656601a2d65cc73ae4"} Jul 22 18:22:00.988762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:00.988726 2562 generic.go:356] "Generic (PLEG): container finished" podID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerID="5d236b4e2c119c5c8eecbdb8926c72f8bf222bb5ef8de3210830a972e77d81ef" exitCode=0 Jul 22 18:22:00.989135 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:00.988784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" event={"ID":"5f0bfab1-f4db-4c21-b3f8-a70b7f845771","Type":"ContainerDied","Data":"5d236b4e2c119c5c8eecbdb8926c72f8bf222bb5ef8de3210830a972e77d81ef"} Jul 22 18:22:02.126980 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.126955 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:22:02.309315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.309238 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-bundle\") pod \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " Jul 22 18:22:02.309315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.309282 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-util\") pod \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " Jul 22 18:22:02.309315 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.309311 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9nkr\" (UniqueName: \"kubernetes.io/projected/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-kube-api-access-b9nkr\") pod \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\" (UID: \"5f0bfab1-f4db-4c21-b3f8-a70b7f845771\") " Jul 22 18:22:02.310171 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.310134 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-bundle" (OuterVolumeSpecName: "bundle") pod "5f0bfab1-f4db-4c21-b3f8-a70b7f845771" (UID: "5f0bfab1-f4db-4c21-b3f8-a70b7f845771"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:22:02.311530 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.311506 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-kube-api-access-b9nkr" (OuterVolumeSpecName: "kube-api-access-b9nkr") pod "5f0bfab1-f4db-4c21-b3f8-a70b7f845771" (UID: "5f0bfab1-f4db-4c21-b3f8-a70b7f845771"). InnerVolumeSpecName "kube-api-access-b9nkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:22:02.317362 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.317321 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-util" (OuterVolumeSpecName: "util") pod "5f0bfab1-f4db-4c21-b3f8-a70b7f845771" (UID: "5f0bfab1-f4db-4c21-b3f8-a70b7f845771"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:22:02.410731 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.410699 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:22:02.410731 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.410724 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9nkr\" (UniqueName: \"kubernetes.io/projected/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-kube-api-access-b9nkr\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:22:02.410731 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.410735 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f0bfab1-f4db-4c21-b3f8-a70b7f845771-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:22:02.999622 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.999591 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" event={"ID":"5f0bfab1-f4db-4c21-b3f8-a70b7f845771","Type":"ContainerDied","Data":"536dc52518c15dd447d69aa51e77c8c8b6f98c2e44f7a2582ceb6dbac1fbca21"} Jul 22 18:22:02.999812 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.999638 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="536dc52518c15dd447d69aa51e77c8c8b6f98c2e44f7a2582ceb6dbac1fbca21" Jul 22 18:22:02.999812 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:02.999638 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjxwnw" Jul 22 18:22:23.350914 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.350878 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257"] Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351201 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="extract" Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351214 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="extract" Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351227 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="pull" Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351232 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="pull" Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351244 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="util" Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351250 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="util" Jul 22 18:22:23.351357 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.351316 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f0bfab1-f4db-4c21-b3f8-a70b7f845771" containerName="extract" Jul 22 18:22:23.357068 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.357052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.365096 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.365070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 18:22:23.365233 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.365186 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wz8qr\"" Jul 22 18:22:23.365233 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.365195 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 18:22:23.367990 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.367969 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 18:22:23.368092 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.368079 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 18:22:23.392267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.392242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257"] Jul 22 18:22:23.485521 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.485468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08072f30-fde9-465b-948d-5c5a447903ee-tmp\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.485521 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.485524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08072f30-fde9-465b-948d-5c5a447903ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.485737 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.485544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08072f30-fde9-465b-948d-5c5a447903ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.485737 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.485565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldxg\" (UniqueName: \"kubernetes.io/projected/08072f30-fde9-465b-948d-5c5a447903ee-kube-api-access-gldxg\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.485737 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.485610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08072f30-fde9-465b-948d-5c5a447903ee-manifests\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.586040 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.585995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08072f30-fde9-465b-948d-5c5a447903ee-tmp\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.586040 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.586041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08072f30-fde9-465b-948d-5c5a447903ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.586296 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.586058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08072f30-fde9-465b-948d-5c5a447903ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.586296 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.586079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gldxg\" (UniqueName: \"kubernetes.io/projected/08072f30-fde9-465b-948d-5c5a447903ee-kube-api-access-gldxg\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.586296 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.586129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08072f30-fde9-465b-948d-5c5a447903ee-manifests\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.586540 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.586515 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08072f30-fde9-465b-948d-5c5a447903ee-manifests\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.588534 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.588510 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08072f30-fde9-465b-948d-5c5a447903ee-tmp\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.588733 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.588716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08072f30-fde9-465b-948d-5c5a447903ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.588843 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.588825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08072f30-fde9-465b-948d-5c5a447903ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.593512 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.593491 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldxg\" (UniqueName: \"kubernetes.io/projected/08072f30-fde9-465b-948d-5c5a447903ee-kube-api-access-gldxg\") pod \"opendatahub-operator-controller-manager-549865fcdf-6m257\" (UID: \"08072f30-fde9-465b-948d-5c5a447903ee\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.666603 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.666516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:23.835216 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:23.835187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257"] Jul 22 18:22:23.838363 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:22:23.838335 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08072f30_fde9_465b_948d_5c5a447903ee.slice/crio-fa2b88c0cd70e6cfcf3eb0d7d0bfbf0b41201a40fb291c0f4293b79435bc40e1 WatchSource:0}: Error finding container fa2b88c0cd70e6cfcf3eb0d7d0bfbf0b41201a40fb291c0f4293b79435bc40e1: Status 404 returned error can't find the container with id fa2b88c0cd70e6cfcf3eb0d7d0bfbf0b41201a40fb291c0f4293b79435bc40e1 Jul 22 18:22:24.095892 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:24.095859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" event={"ID":"08072f30-fde9-465b-948d-5c5a447903ee","Type":"ContainerStarted","Data":"fa2b88c0cd70e6cfcf3eb0d7d0bfbf0b41201a40fb291c0f4293b79435bc40e1"} Jul 22 18:22:28.123878 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:28.123843 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" event={"ID":"08072f30-fde9-465b-948d-5c5a447903ee","Type":"ContainerStarted","Data":"a48203749ddc8a801d44ef5260b3ade80c24349669995ab2353b2e1dffa17e62"} Jul 22 18:22:29.130875 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:29.130839 2562 generic.go:356] "Generic (PLEG): container finished" podID="08072f30-fde9-465b-948d-5c5a447903ee" containerID="a48203749ddc8a801d44ef5260b3ade80c24349669995ab2353b2e1dffa17e62" exitCode=0 Jul 22 18:22:29.131333 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:29.130880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" event={"ID":"08072f30-fde9-465b-948d-5c5a447903ee","Type":"ContainerDied","Data":"a48203749ddc8a801d44ef5260b3ade80c24349669995ab2353b2e1dffa17e62"} Jul 22 18:22:30.137568 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:30.137534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" event={"ID":"08072f30-fde9-465b-948d-5c5a447903ee","Type":"ContainerStarted","Data":"79cd7841404efb150d6ac41a16bb72191a1f83ecd1804896431f2f153d8a9158"} Jul 22 18:22:30.137983 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:30.137671 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:30.158314 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:30.158266 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" podStartSLOduration=2.03399948 podStartE2EDuration="7.158252514s" totalImagesPullingTime="4.056089133s" totalInitContainerRuntime="1.068163901s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:30.156001756 +0000 UTC m=+523.432428120" watchObservedRunningTime="2026-07-22 18:22:30.158252514 +0000 UTC m=+523.434678910" Jul 22 18:22:41.145098 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:41.145012 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-6m257" Jul 22 18:22:43.611729 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.611695 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd"] Jul 22 18:22:43.614953 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.614936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.622148 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.622120 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 18:22:43.622273 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.622254 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 18:22:43.622960 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.622938 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vpwj6\"" Jul 22 18:22:43.634448 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.634426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd"] Jul 22 18:22:43.764585 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.764556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/853f8719-e622-4b7a-b1a0-9365885ca950-tmp\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.764758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.764594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skl9f\" (UniqueName: \"kubernetes.io/projected/853f8719-e622-4b7a-b1a0-9365885ca950-kube-api-access-skl9f\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.764758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.764748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853f8719-e622-4b7a-b1a0-9365885ca950-tls-certs\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.866222 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.866138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853f8719-e622-4b7a-b1a0-9365885ca950-tls-certs\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.866222 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.866179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/853f8719-e622-4b7a-b1a0-9365885ca950-tmp\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.866442 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.866305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skl9f\" (UniqueName: \"kubernetes.io/projected/853f8719-e622-4b7a-b1a0-9365885ca950-kube-api-access-skl9f\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.868793 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.868764 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/853f8719-e622-4b7a-b1a0-9365885ca950-tmp\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.869053 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.869033 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853f8719-e622-4b7a-b1a0-9365885ca950-tls-certs\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.878426 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.878400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skl9f\" (UniqueName: \"kubernetes.io/projected/853f8719-e622-4b7a-b1a0-9365885ca950-kube-api-access-skl9f\") pod \"kube-auth-proxy-7f4c4dbc87-gbbtd\" (UID: \"853f8719-e622-4b7a-b1a0-9365885ca950\") " pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:43.925060 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:43.925017 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" Jul 22 18:22:44.064199 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:44.064167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd"] Jul 22 18:22:44.067515 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:22:44.067483 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853f8719_e622_4b7a_b1a0_9365885ca950.slice/crio-072b6eab528bbb2e568524bb7d482b3261276228451a0fd197af1150b4131eeb WatchSource:0}: Error finding container 072b6eab528bbb2e568524bb7d482b3261276228451a0fd197af1150b4131eeb: Status 404 returned error can't find the container with id 072b6eab528bbb2e568524bb7d482b3261276228451a0fd197af1150b4131eeb Jul 22 18:22:44.202872 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:44.202838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" event={"ID":"853f8719-e622-4b7a-b1a0-9365885ca950","Type":"ContainerStarted","Data":"072b6eab528bbb2e568524bb7d482b3261276228451a0fd197af1150b4131eeb"} Jul 22 18:22:47.219070 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:47.219033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" event={"ID":"853f8719-e622-4b7a-b1a0-9365885ca950","Type":"ContainerStarted","Data":"ead308b832d4c3a08aea3af8af0040d372645781e253d6767ac6e5fe2c8e6f05"} Jul 22 18:22:47.236298 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:47.236255 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f4c4dbc87-gbbtd" podStartSLOduration=1.561205197 podStartE2EDuration="4.236240485s" totalImagesPullingTime="2.675035288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:47.23398701 +0000 UTC m=+540.510413342" watchObservedRunningTime="2026-07-22 18:22:47.236240485 +0000 UTC m=+540.512666818" Jul 22 18:22:51.671770 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.671731 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4"] Jul 22 18:22:51.677089 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.677067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.680628 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.680600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 18:22:51.680628 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.680608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 18:22:51.680833 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.680607 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dlwn8\"" Jul 22 18:22:51.680833 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.680600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 18:22:51.687358 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.687335 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4"] Jul 22 18:22:51.839048 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.839012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e92134c1-bdb8-4982-8faa-656b4628292c-manager-config\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.839210 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.839053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92134c1-bdb8-4982-8faa-656b4628292c-cert\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.839210 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.839108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e92134c1-bdb8-4982-8faa-656b4628292c-metrics-cert\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.839210 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.839126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47r5l\" (UniqueName: \"kubernetes.io/projected/e92134c1-bdb8-4982-8faa-656b4628292c-kube-api-access-47r5l\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.940057 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.940025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e92134c1-bdb8-4982-8faa-656b4628292c-manager-config\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.940057 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.940062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92134c1-bdb8-4982-8faa-656b4628292c-cert\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.940310 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.940098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e92134c1-bdb8-4982-8faa-656b4628292c-metrics-cert\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.940310 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.940115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47r5l\" (UniqueName: \"kubernetes.io/projected/e92134c1-bdb8-4982-8faa-656b4628292c-kube-api-access-47r5l\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.940841 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.940820 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e92134c1-bdb8-4982-8faa-656b4628292c-manager-config\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.942762 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.942743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e92134c1-bdb8-4982-8faa-656b4628292c-metrics-cert\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.942907 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.942886 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92134c1-bdb8-4982-8faa-656b4628292c-cert\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.956670 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.956633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47r5l\" (UniqueName: \"kubernetes.io/projected/e92134c1-bdb8-4982-8faa-656b4628292c-kube-api-access-47r5l\") pod \"lws-controller-manager-7b479b546f-9pnm4\" (UID: \"e92134c1-bdb8-4982-8faa-656b4628292c\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:51.986687 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:51.986641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:52.124852 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:52.124692 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4"] Jul 22 18:22:52.127511 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:22:52.127487 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92134c1_bdb8_4982_8faa_656b4628292c.slice/crio-12fb4ef2ea37a233bed4ff38efec6b16944926ad4e130de7ca869b8f0d8f1734 WatchSource:0}: Error finding container 12fb4ef2ea37a233bed4ff38efec6b16944926ad4e130de7ca869b8f0d8f1734: Status 404 returned error can't find the container with id 12fb4ef2ea37a233bed4ff38efec6b16944926ad4e130de7ca869b8f0d8f1734 Jul 22 18:22:52.248368 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:52.248289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" event={"ID":"e92134c1-bdb8-4982-8faa-656b4628292c","Type":"ContainerStarted","Data":"12fb4ef2ea37a233bed4ff38efec6b16944926ad4e130de7ca869b8f0d8f1734"} Jul 22 18:22:54.259326 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:54.259285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" event={"ID":"e92134c1-bdb8-4982-8faa-656b4628292c","Type":"ContainerStarted","Data":"dabb4337228fc3b7cf6da93be1e2ec7947aca460c6364a1cdc1616b7a58a79cb"} Jul 22 18:22:54.259719 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:54.259469 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:22:54.301399 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:22:54.301351 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" podStartSLOduration=1.6451262070000001 podStartE2EDuration="3.301336609s" totalImagesPullingTime="1.656210402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:54.301311273 +0000 UTC m=+547.577737625" watchObservedRunningTime="2026-07-22 18:22:54.301336609 +0000 UTC m=+547.577762942" Jul 22 18:23:05.267039 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:05.267011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-9pnm4" Jul 22 18:23:47.735471 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:47.735356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:23:47.735471 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:47.735363 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:23:47.741040 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:47.741022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:23:47.741040 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:47.741039 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:23:59.617691 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.617644 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w"] Jul 22 18:23:59.621180 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.621164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.623415 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.623393 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 18:23:59.624058 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.624034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7qf7d\"" Jul 22 18:23:59.624166 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.624070 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 18:23:59.629230 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.629208 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w"] Jul 22 18:23:59.797750 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.797714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.797750 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.797750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.797988 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.797802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt8pp\" (UniqueName: \"kubernetes.io/projected/3653dd2d-de18-4851-9fe3-bc9e3976c495-kube-api-access-bt8pp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.899359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.899272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.899359 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.899310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.899538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.899371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt8pp\" (UniqueName: \"kubernetes.io/projected/3653dd2d-de18-4851-9fe3-bc9e3976c495-kube-api-access-bt8pp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.899692 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.899673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.899775 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.899754 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.909505 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.909485 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt8pp\" (UniqueName: \"kubernetes.io/projected/3653dd2d-de18-4851-9fe3-bc9e3976c495-kube-api-access-bt8pp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:23:59.931328 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:23:59.931307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:24:00.064555 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.064532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w"] Jul 22 18:24:00.066978 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:24:00.066950 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3653dd2d_de18_4851_9fe3_bc9e3976c495.slice/crio-a8f673bfbc5fdb64ba52b9167ca398ac71f787a52b9c0328d4dff655fd21bf33 WatchSource:0}: Error finding container a8f673bfbc5fdb64ba52b9167ca398ac71f787a52b9c0328d4dff655fd21bf33: Status 404 returned error can't find the container with id a8f673bfbc5fdb64ba52b9167ca398ac71f787a52b9c0328d4dff655fd21bf33 Jul 22 18:24:00.413544 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.413456 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb"] Jul 22 18:24:00.417036 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.417013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.427786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.427763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb"] Jul 22 18:24:00.571211 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.571174 2562 generic.go:356] "Generic (PLEG): container finished" podID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerID="102ac1e63a1c48e94f230edf5494247a8dd5e55b85154399bad283ae66d5606f" exitCode=0 Jul 22 18:24:00.571404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.571260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" event={"ID":"3653dd2d-de18-4851-9fe3-bc9e3976c495","Type":"ContainerDied","Data":"102ac1e63a1c48e94f230edf5494247a8dd5e55b85154399bad283ae66d5606f"} Jul 22 18:24:00.571404 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.571310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" event={"ID":"3653dd2d-de18-4851-9fe3-bc9e3976c495","Type":"ContainerStarted","Data":"a8f673bfbc5fdb64ba52b9167ca398ac71f787a52b9c0328d4dff655fd21bf33"} Jul 22 18:24:00.571786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.571772 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:24:00.603819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.603790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqf8j\" (UniqueName: \"kubernetes.io/projected/404ec0d6-9a00-464e-8891-824476387eb1-kube-api-access-bqf8j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.603957 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.603834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.603957 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.603871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.705209 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.705176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqf8j\" (UniqueName: \"kubernetes.io/projected/404ec0d6-9a00-464e-8891-824476387eb1-kube-api-access-bqf8j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.705570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.705227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.705570 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.705277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.705741 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.705721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.705782 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.705738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.713610 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.713586 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqf8j\" (UniqueName: \"kubernetes.io/projected/404ec0d6-9a00-464e-8891-824476387eb1-kube-api-access-bqf8j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.725430 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.725404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:00.855901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:00.855878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb"] Jul 22 18:24:00.858120 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:24:00.858091 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404ec0d6_9a00_464e_8891_824476387eb1.slice/crio-3afe4c71fbf59d462486319e8db026d2520d1d7702cd5f5a08b72502951d8649 WatchSource:0}: Error finding container 3afe4c71fbf59d462486319e8db026d2520d1d7702cd5f5a08b72502951d8649: Status 404 returned error can't find the container with id 3afe4c71fbf59d462486319e8db026d2520d1d7702cd5f5a08b72502951d8649 Jul 22 18:24:01.019044 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.019006 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq"] Jul 22 18:24:01.022754 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.022733 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.029865 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.029731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq"] Jul 22 18:24:01.109168 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.109140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4hf\" (UniqueName: \"kubernetes.io/projected/6677ea46-b686-40bb-94d1-474cec84a688-kube-api-access-hh4hf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.109351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.109212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.109351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.109248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.210347 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.210255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.210347 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.210297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.210347 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.210329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4hf\" (UniqueName: \"kubernetes.io/projected/6677ea46-b686-40bb-94d1-474cec84a688-kube-api-access-hh4hf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.210693 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.210612 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.210755 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.210724 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.217997 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.217976 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4hf\" (UniqueName: \"kubernetes.io/projected/6677ea46-b686-40bb-94d1-474cec84a688-kube-api-access-hh4hf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.331999 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.331962 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:01.415639 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.415597 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll"] Jul 22 18:24:01.421544 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.421520 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.426958 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.426934 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll"] Jul 22 18:24:01.513197 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.513027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlp4j\" (UniqueName: \"kubernetes.io/projected/bf07dacf-347c-4bae-ae2c-330cf29adfbc-kube-api-access-mlp4j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.513197 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.513128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.513197 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.513160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.520779 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.520755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq"] Jul 22 18:24:01.523018 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:24:01.522996 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6677ea46_b686_40bb_94d1_474cec84a688.slice/crio-28da829248af2cd32803c20416f132cfa33177ab93f8c4f6bf762c3e236cc806 WatchSource:0}: Error finding container 28da829248af2cd32803c20416f132cfa33177ab93f8c4f6bf762c3e236cc806: Status 404 returned error can't find the container with id 28da829248af2cd32803c20416f132cfa33177ab93f8c4f6bf762c3e236cc806 Jul 22 18:24:01.577246 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.577209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" event={"ID":"6677ea46-b686-40bb-94d1-474cec84a688","Type":"ContainerStarted","Data":"28da829248af2cd32803c20416f132cfa33177ab93f8c4f6bf762c3e236cc806"} Jul 22 18:24:01.579058 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.579035 2562 generic.go:356] "Generic (PLEG): container finished" podID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerID="c2988724d16841e92aab0073b884a6cd141c0662f35560f02cb89b0177cc2526" exitCode=0 Jul 22 18:24:01.579145 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.579113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" event={"ID":"3653dd2d-de18-4851-9fe3-bc9e3976c495","Type":"ContainerDied","Data":"c2988724d16841e92aab0073b884a6cd141c0662f35560f02cb89b0177cc2526"} Jul 22 18:24:01.580627 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.580608 2562 generic.go:356] "Generic (PLEG): container finished" podID="404ec0d6-9a00-464e-8891-824476387eb1" containerID="e242e4d0e2e7508692102e8d04c49e72ff1e8d74f05a15678eb1672b942b0de5" exitCode=0 Jul 22 18:24:01.580723 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.580669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" event={"ID":"404ec0d6-9a00-464e-8891-824476387eb1","Type":"ContainerDied","Data":"e242e4d0e2e7508692102e8d04c49e72ff1e8d74f05a15678eb1672b942b0de5"} Jul 22 18:24:01.580723 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.580700 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" event={"ID":"404ec0d6-9a00-464e-8891-824476387eb1","Type":"ContainerStarted","Data":"3afe4c71fbf59d462486319e8db026d2520d1d7702cd5f5a08b72502951d8649"} Jul 22 18:24:01.614122 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.614096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlp4j\" (UniqueName: \"kubernetes.io/projected/bf07dacf-347c-4bae-ae2c-330cf29adfbc-kube-api-access-mlp4j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.614407 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.614382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.614505 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.614419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.614786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.614767 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.614854 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.614825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.622147 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.622124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlp4j\" (UniqueName: \"kubernetes.io/projected/bf07dacf-347c-4bae-ae2c-330cf29adfbc-kube-api-access-mlp4j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.733466 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.733437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:01.864199 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:01.864174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll"] Jul 22 18:24:01.866694 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:24:01.866662 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf07dacf_347c_4bae_ae2c_330cf29adfbc.slice/crio-8b2a908cf906540d40fc7b0a2f5e1b3467aa4bcb0ed297914753057831c29672 WatchSource:0}: Error finding container 8b2a908cf906540d40fc7b0a2f5e1b3467aa4bcb0ed297914753057831c29672: Status 404 returned error can't find the container with id 8b2a908cf906540d40fc7b0a2f5e1b3467aa4bcb0ed297914753057831c29672 Jul 22 18:24:02.588304 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.588275 2562 generic.go:356] "Generic (PLEG): container finished" podID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerID="f3a0e2d1fad0f4edb3a2c642814cc25169b7da10d48c0217a7e48705f639334e" exitCode=0 Jul 22 18:24:02.588478 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.588351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" event={"ID":"3653dd2d-de18-4851-9fe3-bc9e3976c495","Type":"ContainerDied","Data":"f3a0e2d1fad0f4edb3a2c642814cc25169b7da10d48c0217a7e48705f639334e"} Jul 22 18:24:02.589893 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.589874 2562 generic.go:356] "Generic (PLEG): container finished" podID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerID="b7efb2ec63478f85b13b3794cbd699c68133b86535abecd99e4a18445c178a9d" exitCode=0 Jul 22 18:24:02.590015 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.589966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" event={"ID":"bf07dacf-347c-4bae-ae2c-330cf29adfbc","Type":"ContainerDied","Data":"b7efb2ec63478f85b13b3794cbd699c68133b86535abecd99e4a18445c178a9d"} Jul 22 18:24:02.590090 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.590019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" event={"ID":"bf07dacf-347c-4bae-ae2c-330cf29adfbc","Type":"ContainerStarted","Data":"8b2a908cf906540d40fc7b0a2f5e1b3467aa4bcb0ed297914753057831c29672"} Jul 22 18:24:02.591838 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.591810 2562 generic.go:356] "Generic (PLEG): container finished" podID="6677ea46-b686-40bb-94d1-474cec84a688" containerID="27df74e809aa368f39d34940974241481744f55f36aa9e324163c2776b29be85" exitCode=0 Jul 22 18:24:02.591933 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:02.591853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" event={"ID":"6677ea46-b686-40bb-94d1-474cec84a688","Type":"ContainerDied","Data":"27df74e809aa368f39d34940974241481744f55f36aa9e324163c2776b29be85"} Jul 22 18:24:03.598905 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.598873 2562 generic.go:356] "Generic (PLEG): container finished" podID="404ec0d6-9a00-464e-8891-824476387eb1" containerID="074225bcdea7b34729a7496b00883b1496c990f2a6ad79cb1c0e2e612da11397" exitCode=0 Jul 22 18:24:03.599336 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.598962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" event={"ID":"404ec0d6-9a00-464e-8891-824476387eb1","Type":"ContainerDied","Data":"074225bcdea7b34729a7496b00883b1496c990f2a6ad79cb1c0e2e612da11397"} Jul 22 18:24:03.736893 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.736867 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:24:03.831554 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.831532 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-util\") pod \"3653dd2d-de18-4851-9fe3-bc9e3976c495\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " Jul 22 18:24:03.831671 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.831607 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt8pp\" (UniqueName: \"kubernetes.io/projected/3653dd2d-de18-4851-9fe3-bc9e3976c495-kube-api-access-bt8pp\") pod \"3653dd2d-de18-4851-9fe3-bc9e3976c495\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " Jul 22 18:24:03.831671 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.831631 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-bundle\") pod \"3653dd2d-de18-4851-9fe3-bc9e3976c495\" (UID: \"3653dd2d-de18-4851-9fe3-bc9e3976c495\") " Jul 22 18:24:03.832345 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.832320 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-bundle" (OuterVolumeSpecName: "bundle") pod "3653dd2d-de18-4851-9fe3-bc9e3976c495" (UID: "3653dd2d-de18-4851-9fe3-bc9e3976c495"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:03.833803 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.833779 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3653dd2d-de18-4851-9fe3-bc9e3976c495-kube-api-access-bt8pp" (OuterVolumeSpecName: "kube-api-access-bt8pp") pod "3653dd2d-de18-4851-9fe3-bc9e3976c495" (UID: "3653dd2d-de18-4851-9fe3-bc9e3976c495"). InnerVolumeSpecName "kube-api-access-bt8pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:24:03.838379 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.838347 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-util" (OuterVolumeSpecName: "util") pod "3653dd2d-de18-4851-9fe3-bc9e3976c495" (UID: "3653dd2d-de18-4851-9fe3-bc9e3976c495"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:03.932536 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.932507 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt8pp\" (UniqueName: \"kubernetes.io/projected/3653dd2d-de18-4851-9fe3-bc9e3976c495-kube-api-access-bt8pp\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:03.932536 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.932532 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:03.932815 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:03.932543 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3653dd2d-de18-4851-9fe3-bc9e3976c495-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:04.605722 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.605696 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" Jul 22 18:24:04.606106 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.605735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w" event={"ID":"3653dd2d-de18-4851-9fe3-bc9e3976c495","Type":"ContainerDied","Data":"a8f673bfbc5fdb64ba52b9167ca398ac71f787a52b9c0328d4dff655fd21bf33"} Jul 22 18:24:04.606106 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.605791 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8f673bfbc5fdb64ba52b9167ca398ac71f787a52b9c0328d4dff655fd21bf33" Jul 22 18:24:04.608186 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.608161 2562 generic.go:356] "Generic (PLEG): container finished" podID="404ec0d6-9a00-464e-8891-824476387eb1" containerID="d2780b97c49100e1dc782f2d61c75f0c639af78f33e554a0958dec769bf5ebd1" exitCode=0 Jul 22 18:24:04.608287 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.608244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" event={"ID":"404ec0d6-9a00-464e-8891-824476387eb1","Type":"ContainerDied","Data":"d2780b97c49100e1dc782f2d61c75f0c639af78f33e554a0958dec769bf5ebd1"} Jul 22 18:24:04.610153 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.610130 2562 generic.go:356] "Generic (PLEG): container finished" podID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerID="29aeb5808d8c61c1647803d25d497b61b21d72cfddbe9af9f4ae2374c0484bdd" exitCode=0 Jul 22 18:24:04.610250 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.610209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" event={"ID":"bf07dacf-347c-4bae-ae2c-330cf29adfbc","Type":"ContainerDied","Data":"29aeb5808d8c61c1647803d25d497b61b21d72cfddbe9af9f4ae2374c0484bdd"} Jul 22 18:24:04.612575 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:04.612551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" event={"ID":"6677ea46-b686-40bb-94d1-474cec84a688","Type":"ContainerStarted","Data":"49700d15796ab2e78cf4aade1a26446c383f75cced922eb09a35b533e4bb1ea5"} Jul 22 18:24:05.619525 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.619489 2562 generic.go:356] "Generic (PLEG): container finished" podID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerID="be3a6cbd28c01108b1e047639a666fa976b552baf9128aef544fbd64327a740a" exitCode=0 Jul 22 18:24:05.620021 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.619578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" event={"ID":"bf07dacf-347c-4bae-ae2c-330cf29adfbc","Type":"ContainerDied","Data":"be3a6cbd28c01108b1e047639a666fa976b552baf9128aef544fbd64327a740a"} Jul 22 18:24:05.621384 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.621361 2562 generic.go:356] "Generic (PLEG): container finished" podID="6677ea46-b686-40bb-94d1-474cec84a688" containerID="49700d15796ab2e78cf4aade1a26446c383f75cced922eb09a35b533e4bb1ea5" exitCode=0 Jul 22 18:24:05.621497 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.621388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" event={"ID":"6677ea46-b686-40bb-94d1-474cec84a688","Type":"ContainerDied","Data":"49700d15796ab2e78cf4aade1a26446c383f75cced922eb09a35b533e4bb1ea5"} Jul 22 18:24:05.762014 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.761990 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:05.848281 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.848239 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-util\") pod \"404ec0d6-9a00-464e-8891-824476387eb1\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " Jul 22 18:24:05.848281 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.848287 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqf8j\" (UniqueName: \"kubernetes.io/projected/404ec0d6-9a00-464e-8891-824476387eb1-kube-api-access-bqf8j\") pod \"404ec0d6-9a00-464e-8891-824476387eb1\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " Jul 22 18:24:05.848505 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.848328 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-bundle\") pod \"404ec0d6-9a00-464e-8891-824476387eb1\" (UID: \"404ec0d6-9a00-464e-8891-824476387eb1\") " Jul 22 18:24:05.848935 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.848909 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-bundle" (OuterVolumeSpecName: "bundle") pod "404ec0d6-9a00-464e-8891-824476387eb1" (UID: "404ec0d6-9a00-464e-8891-824476387eb1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:05.850468 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.850443 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404ec0d6-9a00-464e-8891-824476387eb1-kube-api-access-bqf8j" (OuterVolumeSpecName: "kube-api-access-bqf8j") pod "404ec0d6-9a00-464e-8891-824476387eb1" (UID: "404ec0d6-9a00-464e-8891-824476387eb1"). InnerVolumeSpecName "kube-api-access-bqf8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:24:05.853529 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.853508 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-util" (OuterVolumeSpecName: "util") pod "404ec0d6-9a00-464e-8891-824476387eb1" (UID: "404ec0d6-9a00-464e-8891-824476387eb1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:05.948908 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.948881 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:05.948908 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.948905 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/404ec0d6-9a00-464e-8891-824476387eb1-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:05.949088 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:05.948914 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqf8j\" (UniqueName: \"kubernetes.io/projected/404ec0d6-9a00-464e-8891-824476387eb1-kube-api-access-bqf8j\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:06.628194 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.628159 2562 generic.go:356] "Generic (PLEG): container finished" podID="6677ea46-b686-40bb-94d1-474cec84a688" containerID="57143e984363c6d202ff0af20a3bbf01d8736917d6e0d356ff3538a51c98ed83" exitCode=0 Jul 22 18:24:06.628580 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.628247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" event={"ID":"6677ea46-b686-40bb-94d1-474cec84a688","Type":"ContainerDied","Data":"57143e984363c6d202ff0af20a3bbf01d8736917d6e0d356ff3538a51c98ed83"} Jul 22 18:24:06.630049 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.630011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" event={"ID":"404ec0d6-9a00-464e-8891-824476387eb1","Type":"ContainerDied","Data":"3afe4c71fbf59d462486319e8db026d2520d1d7702cd5f5a08b72502951d8649"} Jul 22 18:24:06.630177 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.630064 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3afe4c71fbf59d462486319e8db026d2520d1d7702cd5f5a08b72502951d8649" Jul 22 18:24:06.630218 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.630182 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb" Jul 22 18:24:06.757727 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.757704 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:06.854992 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.854956 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-util\") pod \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " Jul 22 18:24:06.855145 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.855016 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlp4j\" (UniqueName: \"kubernetes.io/projected/bf07dacf-347c-4bae-ae2c-330cf29adfbc-kube-api-access-mlp4j\") pod \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " Jul 22 18:24:06.855145 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.855114 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-bundle\") pod \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\" (UID: \"bf07dacf-347c-4bae-ae2c-330cf29adfbc\") " Jul 22 18:24:06.855508 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.855480 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-bundle" (OuterVolumeSpecName: "bundle") pod "bf07dacf-347c-4bae-ae2c-330cf29adfbc" (UID: "bf07dacf-347c-4bae-ae2c-330cf29adfbc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:06.857195 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.857171 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf07dacf-347c-4bae-ae2c-330cf29adfbc-kube-api-access-mlp4j" (OuterVolumeSpecName: "kube-api-access-mlp4j") pod "bf07dacf-347c-4bae-ae2c-330cf29adfbc" (UID: "bf07dacf-347c-4bae-ae2c-330cf29adfbc"). InnerVolumeSpecName "kube-api-access-mlp4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:24:06.860460 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.860441 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-util" (OuterVolumeSpecName: "util") pod "bf07dacf-347c-4bae-ae2c-330cf29adfbc" (UID: "bf07dacf-347c-4bae-ae2c-330cf29adfbc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:06.956545 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.956514 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:06.956545 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.956542 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf07dacf-347c-4bae-ae2c-330cf29adfbc-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:06.956751 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:06.956557 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlp4j\" (UniqueName: \"kubernetes.io/projected/bf07dacf-347c-4bae-ae2c-330cf29adfbc-kube-api-access-mlp4j\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:07.636758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.636675 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" Jul 22 18:24:07.636758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.636684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll" event={"ID":"bf07dacf-347c-4bae-ae2c-330cf29adfbc","Type":"ContainerDied","Data":"8b2a908cf906540d40fc7b0a2f5e1b3467aa4bcb0ed297914753057831c29672"} Jul 22 18:24:07.636758 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.636738 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b2a908cf906540d40fc7b0a2f5e1b3467aa4bcb0ed297914753057831c29672" Jul 22 18:24:07.778158 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.778136 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:07.864267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.864233 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-bundle\") pod \"6677ea46-b686-40bb-94d1-474cec84a688\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " Jul 22 18:24:07.864440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.864319 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-util\") pod \"6677ea46-b686-40bb-94d1-474cec84a688\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " Jul 22 18:24:07.864440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.864344 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh4hf\" (UniqueName: \"kubernetes.io/projected/6677ea46-b686-40bb-94d1-474cec84a688-kube-api-access-hh4hf\") pod \"6677ea46-b686-40bb-94d1-474cec84a688\" (UID: \"6677ea46-b686-40bb-94d1-474cec84a688\") " Jul 22 18:24:07.864723 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.864684 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-bundle" (OuterVolumeSpecName: "bundle") pod "6677ea46-b686-40bb-94d1-474cec84a688" (UID: "6677ea46-b686-40bb-94d1-474cec84a688"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:07.866663 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.866622 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6677ea46-b686-40bb-94d1-474cec84a688-kube-api-access-hh4hf" (OuterVolumeSpecName: "kube-api-access-hh4hf") pod "6677ea46-b686-40bb-94d1-474cec84a688" (UID: "6677ea46-b686-40bb-94d1-474cec84a688"). InnerVolumeSpecName "kube-api-access-hh4hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:24:07.868926 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.868907 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-util" (OuterVolumeSpecName: "util") pod "6677ea46-b686-40bb-94d1-474cec84a688" (UID: "6677ea46-b686-40bb-94d1-474cec84a688"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:07.965900 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.965876 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-util\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:07.965900 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.965898 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh4hf\" (UniqueName: \"kubernetes.io/projected/6677ea46-b686-40bb-94d1-474cec84a688-kube-api-access-hh4hf\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:07.966076 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:07.965909 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6677ea46-b686-40bb-94d1-474cec84a688-bundle\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:08.642899 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:08.642857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" event={"ID":"6677ea46-b686-40bb-94d1-474cec84a688","Type":"ContainerDied","Data":"28da829248af2cd32803c20416f132cfa33177ab93f8c4f6bf762c3e236cc806"} Jul 22 18:24:08.643267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:08.642909 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq" Jul 22 18:24:08.643267 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:08.642914 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28da829248af2cd32803c20416f132cfa33177ab93f8c4f6bf762c3e236cc806" Jul 22 18:24:38.223310 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223278 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8"] Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223598 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223608 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223616 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223622 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223630 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223635 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223664 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223672 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223682 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223689 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223700 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223705 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223711 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223716 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="pull" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223721 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223726 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223735 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223740 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223747 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223752 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223759 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223765 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="util" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223772 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="extract" Jul 22 18:24:38.223786 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223776 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="extract" Jul 22 18:24:38.224468 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223829 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf07dacf-347c-4bae-ae2c-330cf29adfbc" containerName="extract" Jul 22 18:24:38.224468 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223838 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3653dd2d-de18-4851-9fe3-bc9e3976c495" containerName="extract" Jul 22 18:24:38.224468 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223845 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="404ec0d6-9a00-464e-8891-824476387eb1" containerName="extract" Jul 22 18:24:38.224468 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.223850 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6677ea46-b686-40bb-94d1-474cec84a688" containerName="extract" Jul 22 18:24:38.228183 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.228166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.230507 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.230485 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-npxbv\"" Jul 22 18:24:38.230612 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.230574 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 18:24:38.230704 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.230687 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 18:24:38.238225 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.238194 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8"] Jul 22 18:24:38.323600 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.323566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57995052-8ddd-4a97-a802-e25ed72c5cc5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" (UID: \"57995052-8ddd-4a97-a802-e25ed72c5cc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.323600 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.323603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78t6l\" (UniqueName: \"kubernetes.io/projected/57995052-8ddd-4a97-a802-e25ed72c5cc5-kube-api-access-78t6l\") pod \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" (UID: \"57995052-8ddd-4a97-a802-e25ed72c5cc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.334624 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.334596 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8"] Jul 22 18:24:38.334930 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:24:38.334906 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-78t6l], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" podUID="57995052-8ddd-4a97-a802-e25ed72c5cc5" Jul 22 18:24:38.345169 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.345144 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8"] Jul 22 18:24:38.364345 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.364322 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n"] Jul 22 18:24:38.367831 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.367814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.384876 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.384851 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n"] Jul 22 18:24:38.424031 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.424007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57995052-8ddd-4a97-a802-e25ed72c5cc5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" (UID: \"57995052-8ddd-4a97-a802-e25ed72c5cc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.424164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.424035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78t6l\" (UniqueName: \"kubernetes.io/projected/57995052-8ddd-4a97-a802-e25ed72c5cc5-kube-api-access-78t6l\") pod \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" (UID: \"57995052-8ddd-4a97-a802-e25ed72c5cc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.424427 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.424406 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57995052-8ddd-4a97-a802-e25ed72c5cc5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" (UID: \"57995052-8ddd-4a97-a802-e25ed72c5cc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.428405 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:24:38.428388 2562 projected.go:196] Error preparing data for projected volume kube-api-access-78t6l for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-wwfg8" not found Jul 22 18:24:38.428472 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:24:38.428459 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57995052-8ddd-4a97-a802-e25ed72c5cc5-kube-api-access-78t6l podName:57995052-8ddd-4a97-a802-e25ed72c5cc5 nodeName:}" failed. No retries permitted until 2026-07-22 18:24:38.928440969 +0000 UTC m=+652.204867281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-78t6l" (UniqueName: "kubernetes.io/projected/57995052-8ddd-4a97-a802-e25ed72c5cc5-kube-api-access-78t6l") pod "kuadrant-operator-controller-manager-86878c769f-wwfg8" (UID: "57995052-8ddd-4a97-a802-e25ed72c5cc5") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-wwfg8" not found Jul 22 18:24:38.525095 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.525024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gvf\" (UniqueName: \"kubernetes.io/projected/7400101d-fee4-4d7f-b501-8bc80e7426f4-kube-api-access-69gvf\") pod \"kuadrant-operator-controller-manager-86878c769f-mn22n\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.525095 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.525067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7400101d-fee4-4d7f-b501-8bc80e7426f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mn22n\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.625630 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.625598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gvf\" (UniqueName: \"kubernetes.io/projected/7400101d-fee4-4d7f-b501-8bc80e7426f4-kube-api-access-69gvf\") pod \"kuadrant-operator-controller-manager-86878c769f-mn22n\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.625812 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.625680 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7400101d-fee4-4d7f-b501-8bc80e7426f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mn22n\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.626059 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.626040 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7400101d-fee4-4d7f-b501-8bc80e7426f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mn22n\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.634972 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.634950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gvf\" (UniqueName: \"kubernetes.io/projected/7400101d-fee4-4d7f-b501-8bc80e7426f4-kube-api-access-69gvf\") pod \"kuadrant-operator-controller-manager-86878c769f-mn22n\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.678933 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.678901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:38.797184 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.797117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.799575 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:24:38.799543 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" is forbidden: User \"system:node:ip-10-0-128-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-109.ec2.internal' and this object" podUID="57995052-8ddd-4a97-a802-e25ed72c5cc5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.804613 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.804595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.806611 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:24:38.806589 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" is forbidden: User \"system:node:ip-10-0-128-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-109.ec2.internal' and this object" podUID="57995052-8ddd-4a97-a802-e25ed72c5cc5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:38.816854 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.816835 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n"] Jul 22 18:24:38.818613 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:24:38.818594 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7400101d_fee4_4d7f_b501_8bc80e7426f4.slice/crio-992a51ad08c0dd87754a4cfdcb44b6e7221854250040ea6f810d1a2fd055e39a WatchSource:0}: Error finding container 992a51ad08c0dd87754a4cfdcb44b6e7221854250040ea6f810d1a2fd055e39a: Status 404 returned error can't find the container with id 992a51ad08c0dd87754a4cfdcb44b6e7221854250040ea6f810d1a2fd055e39a Jul 22 18:24:38.928193 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.928168 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57995052-8ddd-4a97-a802-e25ed72c5cc5-extensions-socket-volume\") pod \"57995052-8ddd-4a97-a802-e25ed72c5cc5\" (UID: \"57995052-8ddd-4a97-a802-e25ed72c5cc5\") " Jul 22 18:24:38.928372 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.928349 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78t6l\" (UniqueName: \"kubernetes.io/projected/57995052-8ddd-4a97-a802-e25ed72c5cc5-kube-api-access-78t6l\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:38.928481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:38.928454 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57995052-8ddd-4a97-a802-e25ed72c5cc5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57995052-8ddd-4a97-a802-e25ed72c5cc5" (UID: "57995052-8ddd-4a97-a802-e25ed72c5cc5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:24:39.029269 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:39.029242 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57995052-8ddd-4a97-a802-e25ed72c5cc5-extensions-socket-volume\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:24:39.162415 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:39.162341 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57995052-8ddd-4a97-a802-e25ed72c5cc5" path="/var/lib/kubelet/pods/57995052-8ddd-4a97-a802-e25ed72c5cc5/volumes" Jul 22 18:24:39.804511 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:39.804476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:39.804964 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:39.804514 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" event={"ID":"7400101d-fee4-4d7f-b501-8bc80e7426f4","Type":"ContainerStarted","Data":"992a51ad08c0dd87754a4cfdcb44b6e7221854250040ea6f810d1a2fd055e39a"} Jul 22 18:24:39.808883 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:24:39.808841 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-wwfg8\" is forbidden: User \"system:node:ip-10-0-128-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-109.ec2.internal' and this object" podUID="57995052-8ddd-4a97-a802-e25ed72c5cc5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wwfg8" Jul 22 18:24:44.838495 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:44.838460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" event={"ID":"7400101d-fee4-4d7f-b501-8bc80e7426f4","Type":"ContainerStarted","Data":"8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d"} Jul 22 18:24:44.839008 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:44.838516 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:24:44.860664 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:44.860607 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" podStartSLOduration=1.665622869 podStartE2EDuration="6.860591293s" totalImagesPullingTime="5.194968424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:24:44.858683737 +0000 UTC m=+658.135110083" watchObservedRunningTime="2026-07-22 18:24:44.860591293 +0000 UTC m=+658.137017694" Jul 22 18:24:55.846069 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:24:55.846024 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:25:15.105120 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.105088 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nff48"] Jul 22 18:25:15.108428 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.108411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:15.110860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.110842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vls2r\"" Jul 22 18:25:15.115358 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.115329 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nff48"] Jul 22 18:25:15.140597 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.140575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66jv\" (UniqueName: \"kubernetes.io/projected/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08-kube-api-access-k66jv\") pod \"authorino-75d556bd77-nff48\" (UID: \"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08\") " pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:15.241354 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.241321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k66jv\" (UniqueName: \"kubernetes.io/projected/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08-kube-api-access-k66jv\") pod \"authorino-75d556bd77-nff48\" (UID: \"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08\") " pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:15.251641 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.251611 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66jv\" (UniqueName: \"kubernetes.io/projected/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08-kube-api-access-k66jv\") pod \"authorino-75d556bd77-nff48\" (UID: \"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08\") " pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:15.417770 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.417695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:15.549809 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.549784 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nff48"] Jul 22 18:25:15.552357 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:25:15.552320 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb65dd3d0_c285_4e3d_bf46_fb1f97d66f08.slice/crio-f908c270e6be8249066be81f5eaef87e6ce231837a5f8758c9c330b9f03b198b WatchSource:0}: Error finding container f908c270e6be8249066be81f5eaef87e6ce231837a5f8758c9c330b9f03b198b: Status 404 returned error can't find the container with id f908c270e6be8249066be81f5eaef87e6ce231837a5f8758c9c330b9f03b198b Jul 22 18:25:15.999481 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:15.999448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nff48" event={"ID":"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08","Type":"ContainerStarted","Data":"f908c270e6be8249066be81f5eaef87e6ce231837a5f8758c9c330b9f03b198b"} Jul 22 18:25:20.026532 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:20.026441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nff48" event={"ID":"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08","Type":"ContainerStarted","Data":"2b16f0657bc731de842a09521c27a031bf2909c1389880514541d52957cc88ab"} Jul 22 18:25:20.042779 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:20.042732 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nff48" podStartSLOduration=0.870806522 podStartE2EDuration="5.042717464s" totalImagesPullingTime="4.171910942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:25:20.041309994 +0000 UTC m=+693.317736327" watchObservedRunningTime="2026-07-22 18:25:20.042717464 +0000 UTC m=+693.319143797" Jul 22 18:25:51.001143 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.001066 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nff48"] Jul 22 18:25:51.001618 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.001253 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nff48" podUID="b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" containerName="authorino" containerID="cri-o://2b16f0657bc731de842a09521c27a031bf2909c1389880514541d52957cc88ab" gracePeriod=30 Jul 22 18:25:51.197604 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.197575 2562 generic.go:356] "Generic (PLEG): container finished" podID="b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" containerID="2b16f0657bc731de842a09521c27a031bf2909c1389880514541d52957cc88ab" exitCode=0 Jul 22 18:25:51.197775 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.197628 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nff48" event={"ID":"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08","Type":"ContainerDied","Data":"2b16f0657bc731de842a09521c27a031bf2909c1389880514541d52957cc88ab"} Jul 22 18:25:51.255085 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.255024 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:51.358297 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.358271 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k66jv\" (UniqueName: \"kubernetes.io/projected/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08-kube-api-access-k66jv\") pod \"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08\" (UID: \"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08\") " Jul 22 18:25:51.360340 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.360319 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08-kube-api-access-k66jv" (OuterVolumeSpecName: "kube-api-access-k66jv") pod "b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" (UID: "b65dd3d0-c285-4e3d-bf46-fb1f97d66f08"). InnerVolumeSpecName "kube-api-access-k66jv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:25:51.458891 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:51.458860 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k66jv\" (UniqueName: \"kubernetes.io/projected/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08-kube-api-access-k66jv\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:25:52.204829 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:52.204795 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nff48" Jul 22 18:25:52.204829 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:52.204803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nff48" event={"ID":"b65dd3d0-c285-4e3d-bf46-fb1f97d66f08","Type":"ContainerDied","Data":"f908c270e6be8249066be81f5eaef87e6ce231837a5f8758c9c330b9f03b198b"} Jul 22 18:25:52.205370 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:52.204857 2562 scope.go:117] "RemoveContainer" containerID="2b16f0657bc731de842a09521c27a031bf2909c1389880514541d52957cc88ab" Jul 22 18:25:52.235420 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:52.235390 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nff48"] Jul 22 18:25:52.237346 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:52.237323 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nff48"] Jul 22 18:25:53.162243 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:25:53.162212 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" path="/var/lib/kubelet/pods/b65dd3d0-c285-4e3d-bf46-fb1f97d66f08/volumes" Jul 22 18:27:04.088471 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.088437 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78"] Jul 22 18:27:04.088955 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.088885 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" containerName="authorino" Jul 22 18:27:04.088955 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.088901 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" containerName="authorino" Jul 22 18:27:04.089060 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.088982 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65dd3d0-c285-4e3d-bf46-fb1f97d66f08" containerName="authorino" Jul 22 18:27:04.093370 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.093352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.095807 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.095789 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 18:27:04.096571 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.096556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 18:27:04.096681 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.096564 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 18:27:04.096681 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.096585 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6vrkz\"" Jul 22 18:27:04.102440 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.102423 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78"] Jul 22 18:27:04.170397 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.170360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.170397 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.170399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.170598 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.170430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snzpb\" (UniqueName: \"kubernetes.io/projected/72e19196-9b38-4d2e-b859-48e26a91e88f-kube-api-access-snzpb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.170598 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.170512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.170598 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.170532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e19196-9b38-4d2e-b859-48e26a91e88f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.170598 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.170553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.271678 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.271612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.271866 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.271691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e19196-9b38-4d2e-b859-48e26a91e88f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.271866 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.271793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.271866 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.271861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.272025 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.271899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.272025 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.271947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snzpb\" (UniqueName: \"kubernetes.io/projected/72e19196-9b38-4d2e-b859-48e26a91e88f-kube-api-access-snzpb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.272133 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.272074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.272191 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.272163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.272270 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.272250 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.274164 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.274141 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e19196-9b38-4d2e-b859-48e26a91e88f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.274378 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.274358 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e19196-9b38-4d2e-b859-48e26a91e88f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.279738 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.279716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snzpb\" (UniqueName: \"kubernetes.io/projected/72e19196-9b38-4d2e-b859-48e26a91e88f-kube-api-access-snzpb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qtb78\" (UID: \"72e19196-9b38-4d2e-b859-48e26a91e88f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.404808 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.404738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:04.542353 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.542326 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78"] Jul 22 18:27:04.544389 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:27:04.544366 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e19196_9b38_4d2e_b859_48e26a91e88f.slice/crio-7df54d5d598d3473a44ee21c7c31f7e11920283e567113d1afc3d976e8c374c9 WatchSource:0}: Error finding container 7df54d5d598d3473a44ee21c7c31f7e11920283e567113d1afc3d976e8c374c9: Status 404 returned error can't find the container with id 7df54d5d598d3473a44ee21c7c31f7e11920283e567113d1afc3d976e8c374c9 Jul 22 18:27:04.571044 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:04.571010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" event={"ID":"72e19196-9b38-4d2e-b859-48e26a91e88f","Type":"ContainerStarted","Data":"7df54d5d598d3473a44ee21c7c31f7e11920283e567113d1afc3d976e8c374c9"} Jul 22 18:27:06.583850 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:06.583812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" event={"ID":"72e19196-9b38-4d2e-b859-48e26a91e88f","Type":"ContainerStarted","Data":"b1d266e4416b4c855958dac7737f62daaa1119a571e56cd03d0d8d7ad97ac040"} Jul 22 18:27:06.602154 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:06.602106 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" podStartSLOduration=1.524071352 podStartE2EDuration="2.602091285s" totalImagesPullingTime="1.078019933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:27:06.600587762 +0000 UTC m=+799.877014119" watchObservedRunningTime="2026-07-22 18:27:06.602091285 +0000 UTC m=+799.878517623" Jul 22 18:27:14.405288 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:14.405240 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:14.405768 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:14.405307 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:14.418191 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:14.418169 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:14.635549 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:14.635520 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qtb78" Jul 22 18:27:27.699473 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.699438 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87"] Jul 22 18:27:27.706033 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.706015 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.708313 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.708289 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 22 18:27:27.711855 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.711833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87"] Jul 22 18:27:27.786596 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.786566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.786765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.786603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.786765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.786627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97p2d\" (UniqueName: \"kubernetes.io/projected/b3a5792e-f34e-4b25-b549-a35c4288baf9-kube-api-access-97p2d\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.786765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.786659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a5792e-f34e-4b25-b549-a35c4288baf9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.786765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.786715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.786765 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.786730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888068 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888257 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888257 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97p2d\" (UniqueName: \"kubernetes.io/projected/b3a5792e-f34e-4b25-b549-a35c4288baf9-kube-api-access-97p2d\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888257 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a5792e-f34e-4b25-b549-a35c4288baf9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888257 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888257 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888538 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888511 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.888635 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.888579 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.890696 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.890666 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3a5792e-f34e-4b25-b549-a35c4288baf9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.890893 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.890875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3a5792e-f34e-4b25-b549-a35c4288baf9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:27.895710 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:27.895689 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97p2d\" (UniqueName: \"kubernetes.io/projected/b3a5792e-f34e-4b25-b549-a35c4288baf9-kube-api-access-97p2d\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mrh87\" (UID: \"b3a5792e-f34e-4b25-b549-a35c4288baf9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:28.017406 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:28.017319 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:28.156232 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:28.156205 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87"] Jul 22 18:27:28.157511 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:27:28.157485 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3a5792e_f34e_4b25_b549_a35c4288baf9.slice/crio-379a0da689ae6ab7c138c0c57a3fc16f91a87d5436ba0b1b02a32e4a79672334 WatchSource:0}: Error finding container 379a0da689ae6ab7c138c0c57a3fc16f91a87d5436ba0b1b02a32e4a79672334: Status 404 returned error can't find the container with id 379a0da689ae6ab7c138c0c57a3fc16f91a87d5436ba0b1b02a32e4a79672334 Jul 22 18:27:28.696582 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:28.696532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" event={"ID":"b3a5792e-f34e-4b25-b549-a35c4288baf9","Type":"ContainerStarted","Data":"20564788c7e2b35a8b4b8766d32fe25b339f54e3466714de35c0cdc482faaab2"} Jul 22 18:27:28.696777 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:28.696597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" event={"ID":"b3a5792e-f34e-4b25-b549-a35c4288baf9","Type":"ContainerStarted","Data":"379a0da689ae6ab7c138c0c57a3fc16f91a87d5436ba0b1b02a32e4a79672334"} Jul 22 18:27:28.716424 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:28.716317 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" podStartSLOduration=1.426854332 podStartE2EDuration="1.716301278s" totalImagesPullingTime="289.446946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:27:28.714637402 +0000 UTC m=+821.991063747" watchObservedRunningTime="2026-07-22 18:27:28.716301278 +0000 UTC m=+821.992727649" Jul 22 18:27:38.018325 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:38.018289 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:38.018798 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:38.018345 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:38.033772 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:38.033744 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:27:38.759895 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:27:38.759867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mrh87" Jul 22 18:28:20.863209 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.863175 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ccfc54956-f7whv"] Jul 22 18:28:20.866674 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.866635 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:20.869512 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.869486 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 18:28:20.869512 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.869508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vls2r\"" Jul 22 18:28:20.873017 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.872980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ccfc54956-f7whv"] Jul 22 18:28:20.945753 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.945722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f03e5d62-3a51-4d70-b6f9-380cb186f29b-tls-cert\") pod \"authorino-ccfc54956-f7whv\" (UID: \"f03e5d62-3a51-4d70-b6f9-380cb186f29b\") " pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:20.945939 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:20.945783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2bfx\" (UniqueName: \"kubernetes.io/projected/f03e5d62-3a51-4d70-b6f9-380cb186f29b-kube-api-access-m2bfx\") pod \"authorino-ccfc54956-f7whv\" (UID: \"f03e5d62-3a51-4d70-b6f9-380cb186f29b\") " pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:21.046449 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.046411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2bfx\" (UniqueName: \"kubernetes.io/projected/f03e5d62-3a51-4d70-b6f9-380cb186f29b-kube-api-access-m2bfx\") pod \"authorino-ccfc54956-f7whv\" (UID: \"f03e5d62-3a51-4d70-b6f9-380cb186f29b\") " pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:21.046681 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.046508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f03e5d62-3a51-4d70-b6f9-380cb186f29b-tls-cert\") pod \"authorino-ccfc54956-f7whv\" (UID: \"f03e5d62-3a51-4d70-b6f9-380cb186f29b\") " pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:21.049077 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.049055 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f03e5d62-3a51-4d70-b6f9-380cb186f29b-tls-cert\") pod \"authorino-ccfc54956-f7whv\" (UID: \"f03e5d62-3a51-4d70-b6f9-380cb186f29b\") " pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:21.053785 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.053765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2bfx\" (UniqueName: \"kubernetes.io/projected/f03e5d62-3a51-4d70-b6f9-380cb186f29b-kube-api-access-m2bfx\") pod \"authorino-ccfc54956-f7whv\" (UID: \"f03e5d62-3a51-4d70-b6f9-380cb186f29b\") " pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:21.176819 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.176735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ccfc54956-f7whv" Jul 22 18:28:21.310588 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.310524 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ccfc54956-f7whv"] Jul 22 18:28:21.314757 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:28:21.314732 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf03e5d62_3a51_4d70_b6f9_380cb186f29b.slice/crio-187b5f39d37291a24184dc3327c75541a45d8b188a558d3fc99a47cfc9d00d78 WatchSource:0}: Error finding container 187b5f39d37291a24184dc3327c75541a45d8b188a558d3fc99a47cfc9d00d78: Status 404 returned error can't find the container with id 187b5f39d37291a24184dc3327c75541a45d8b188a558d3fc99a47cfc9d00d78 Jul 22 18:28:21.978889 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.978852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ccfc54956-f7whv" event={"ID":"f03e5d62-3a51-4d70-b6f9-380cb186f29b","Type":"ContainerStarted","Data":"57a970b99cb742f9ab51f3255ad40d178a57495921073ee7f5bfbcc3fe6ae871"} Jul 22 18:28:21.979269 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.978913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ccfc54956-f7whv" event={"ID":"f03e5d62-3a51-4d70-b6f9-380cb186f29b","Type":"ContainerStarted","Data":"187b5f39d37291a24184dc3327c75541a45d8b188a558d3fc99a47cfc9d00d78"} Jul 22 18:28:21.997086 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:21.997034 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ccfc54956-f7whv" podStartSLOduration=1.555021212 podStartE2EDuration="1.997012083s" totalImagesPullingTime="441.990871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:28:21.996352347 +0000 UTC m=+875.272778679" watchObservedRunningTime="2026-07-22 18:28:21.997012083 +0000 UTC m=+875.273438416" Jul 22 18:28:47.771033 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:47.770921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:28:47.773334 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:47.773311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:28:47.775811 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:47.775791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:28:47.778189 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:28:47.778171 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:33:47.805821 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:33:47.805703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:33:47.810351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:33:47.810334 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:33:47.811351 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:33:47.811329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:33:47.816115 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:33:47.816095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:35:24.791801 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:24.791767 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n"] Jul 22 18:35:24.792348 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:24.791981 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" podUID="7400101d-fee4-4d7f-b501-8bc80e7426f4" containerName="manager" containerID="cri-o://8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d" gracePeriod=10 Jul 22 18:35:28.849448 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:28.849425 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:35:28.943711 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:28.943681 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69gvf\" (UniqueName: \"kubernetes.io/projected/7400101d-fee4-4d7f-b501-8bc80e7426f4-kube-api-access-69gvf\") pod \"7400101d-fee4-4d7f-b501-8bc80e7426f4\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " Jul 22 18:35:28.943874 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:28.943732 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7400101d-fee4-4d7f-b501-8bc80e7426f4-extensions-socket-volume\") pod \"7400101d-fee4-4d7f-b501-8bc80e7426f4\" (UID: \"7400101d-fee4-4d7f-b501-8bc80e7426f4\") " Jul 22 18:35:28.944146 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:28.944125 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7400101d-fee4-4d7f-b501-8bc80e7426f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7400101d-fee4-4d7f-b501-8bc80e7426f4" (UID: "7400101d-fee4-4d7f-b501-8bc80e7426f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:35:28.945901 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:28.945877 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7400101d-fee4-4d7f-b501-8bc80e7426f4-kube-api-access-69gvf" (OuterVolumeSpecName: "kube-api-access-69gvf") pod "7400101d-fee4-4d7f-b501-8bc80e7426f4" (UID: "7400101d-fee4-4d7f-b501-8bc80e7426f4"). InnerVolumeSpecName "kube-api-access-69gvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:35:29.045216 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.045167 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69gvf\" (UniqueName: \"kubernetes.io/projected/7400101d-fee4-4d7f-b501-8bc80e7426f4-kube-api-access-69gvf\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:35:29.045216 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.045210 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7400101d-fee4-4d7f-b501-8bc80e7426f4-extensions-socket-volume\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:35:29.261874 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.261792 2562 generic.go:356] "Generic (PLEG): container finished" podID="7400101d-fee4-4d7f-b501-8bc80e7426f4" containerID="8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d" exitCode=0 Jul 22 18:35:29.261874 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.261838 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" Jul 22 18:35:29.261874 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.261865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" event={"ID":"7400101d-fee4-4d7f-b501-8bc80e7426f4","Type":"ContainerDied","Data":"8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d"} Jul 22 18:35:29.262292 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.261919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n" event={"ID":"7400101d-fee4-4d7f-b501-8bc80e7426f4","Type":"ContainerDied","Data":"992a51ad08c0dd87754a4cfdcb44b6e7221854250040ea6f810d1a2fd055e39a"} Jul 22 18:35:29.262292 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.261953 2562 scope.go:117] "RemoveContainer" containerID="8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d" Jul 22 18:35:29.275407 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.275387 2562 scope.go:117] "RemoveContainer" containerID="8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d" Jul 22 18:35:29.275694 ip-10-0-128-109 kubenswrapper[2562]: E0722 18:35:29.275675 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d\": container with ID starting with 8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d not found: ID does not exist" containerID="8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d" Jul 22 18:35:29.275751 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.275705 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d"} err="failed to get container status \"8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d\": rpc error: code = NotFound desc = could not find container \"8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d\": container with ID starting with 8ffc0fa473da1637bc7138e8fad062162fda2a849ca8104108cba2ae5deef60d not found: ID does not exist" Jul 22 18:35:29.279317 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.279294 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n"] Jul 22 18:35:29.283799 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:29.283778 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mn22n"] Jul 22 18:35:31.161806 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:35:31.161771 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7400101d-fee4-4d7f-b501-8bc80e7426f4" path="/var/lib/kubelet/pods/7400101d-fee4-4d7f-b501-8bc80e7426f4/volumes" Jul 22 18:36:25.947623 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.947586 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9"] Jul 22 18:36:25.948129 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.947952 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7400101d-fee4-4d7f-b501-8bc80e7426f4" containerName="manager" Jul 22 18:36:25.948129 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.947963 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7400101d-fee4-4d7f-b501-8bc80e7426f4" containerName="manager" Jul 22 18:36:25.948129 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.948030 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7400101d-fee4-4d7f-b501-8bc80e7426f4" containerName="manager" Jul 22 18:36:25.951033 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.951017 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:25.953771 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.953754 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-npxbv\"" Jul 22 18:36:25.968566 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:25.968536 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9"] Jul 22 18:36:26.050277 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.050232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xz4h9\" (UID: \"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.050277 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.050283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wm7\" (UniqueName: \"kubernetes.io/projected/2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8-kube-api-access-67wm7\") pod \"kuadrant-operator-controller-manager-86878c769f-xz4h9\" (UID: \"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.151220 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.151184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xz4h9\" (UID: \"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.151390 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.151233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wm7\" (UniqueName: \"kubernetes.io/projected/2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8-kube-api-access-67wm7\") pod \"kuadrant-operator-controller-manager-86878c769f-xz4h9\" (UID: \"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.151585 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.151559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xz4h9\" (UID: \"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.160329 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.160299 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wm7\" (UniqueName: \"kubernetes.io/projected/2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8-kube-api-access-67wm7\") pod \"kuadrant-operator-controller-manager-86878c769f-xz4h9\" (UID: \"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.261378 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.261295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.415284 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.415252 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9"] Jul 22 18:36:26.416814 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:36:26.416782 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef3ddcd_c6eb_4eab_92cf_64e7dfd73cf8.slice/crio-506aeae90e4bdeea6741818660334d0e7f84ef9e31a3e192b91dfb8dee085a19 WatchSource:0}: Error finding container 506aeae90e4bdeea6741818660334d0e7f84ef9e31a3e192b91dfb8dee085a19: Status 404 returned error can't find the container with id 506aeae90e4bdeea6741818660334d0e7f84ef9e31a3e192b91dfb8dee085a19 Jul 22 18:36:26.558553 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.558463 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" event={"ID":"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8","Type":"ContainerStarted","Data":"016b5a878c12886d98f002621d907c10d8e39c52045dfc39e66a4e61795e5a66"} Jul 22 18:36:26.558553 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.558518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" event={"ID":"2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8","Type":"ContainerStarted","Data":"506aeae90e4bdeea6741818660334d0e7f84ef9e31a3e192b91dfb8dee085a19"} Jul 22 18:36:26.558773 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.558586 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:36:26.581838 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:26.581788 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" podStartSLOduration=1.5817724869999998 podStartE2EDuration="1.581772487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:36:26.579425346 +0000 UTC m=+1359.855851678" watchObservedRunningTime="2026-07-22 18:36:26.581772487 +0000 UTC m=+1359.858198820" Jul 22 18:36:37.566796 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:36:37.566765 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xz4h9" Jul 22 18:38:47.842012 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:38:47.841890 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:38:47.846996 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:38:47.846975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:38:47.848425 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:38:47.848408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:38:47.853194 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:38:47.853177 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:43:47.877099 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:43:47.876987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:43:47.883990 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:43:47.882220 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:43:47.884955 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:43:47.884933 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:43:47.890048 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:43:47.890032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:48:47.912176 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:48:47.912071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:48:47.917871 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:48:47.917848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:48:47.922325 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:48:47.922306 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:48:47.927123 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:48:47.927107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:53:23.993069 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:23.993035 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb"] Jul 22 18:53:23.996489 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:23.996472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:23.999106 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:23.999074 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w7279\"" Jul 22 18:53:23.999246 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:23.999153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 18:53:24.004039 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.004015 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb"] Jul 22 18:53:24.055736 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.055702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4195f9e7-3a9c-43fc-b4ad-e78a6b069112-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb\" (UID: \"4195f9e7-3a9c-43fc-b4ad-e78a6b069112\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:24.156463 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.156426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4195f9e7-3a9c-43fc-b4ad-e78a6b069112-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb\" (UID: \"4195f9e7-3a9c-43fc-b4ad-e78a6b069112\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:24.157074 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.157039 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4195f9e7-3a9c-43fc-b4ad-e78a6b069112-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb\" (UID: \"4195f9e7-3a9c-43fc-b4ad-e78a6b069112\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:24.308241 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.308169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:24.445860 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.445834 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb"] Jul 22 18:53:24.447854 ip-10-0-128-109 kubenswrapper[2562]: W0722 18:53:24.447828 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4195f9e7_3a9c_43fc_b4ad_e78a6b069112.slice/crio-8c61f59b1393be5d6b4f8489319c0da50799ecd554d5f377ff44615053e9964a WatchSource:0}: Error finding container 8c61f59b1393be5d6b4f8489319c0da50799ecd554d5f377ff44615053e9964a: Status 404 returned error can't find the container with id 8c61f59b1393be5d6b4f8489319c0da50799ecd554d5f377ff44615053e9964a Jul 22 18:53:24.449626 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:24.449608 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:53:25.067399 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:25.067362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" event={"ID":"4195f9e7-3a9c-43fc-b4ad-e78a6b069112","Type":"ContainerStarted","Data":"8c61f59b1393be5d6b4f8489319c0da50799ecd554d5f377ff44615053e9964a"} Jul 22 18:53:27.080722 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:27.080615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" event={"ID":"4195f9e7-3a9c-43fc-b4ad-e78a6b069112","Type":"ContainerStarted","Data":"3eeda10afb424b21da045560e7e85d1e6f9777761ad9f0fea041f1716c0dc77f"} Jul 22 18:53:27.096663 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:27.096605 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" podStartSLOduration=2.088017366 podStartE2EDuration="4.09659151s" totalImagesPullingTime="2.008574144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:53:27.096068834 +0000 UTC m=+2380.372495164" watchObservedRunningTime="2026-07-22 18:53:27.09659151 +0000 UTC m=+2380.373017833" Jul 22 18:53:28.087020 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:28.086985 2562 generic.go:356] "Generic (PLEG): container finished" podID="4195f9e7-3a9c-43fc-b4ad-e78a6b069112" containerID="3eeda10afb424b21da045560e7e85d1e6f9777761ad9f0fea041f1716c0dc77f" exitCode=0 Jul 22 18:53:28.087400 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:28.087076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" event={"ID":"4195f9e7-3a9c-43fc-b4ad-e78a6b069112","Type":"ContainerDied","Data":"3eeda10afb424b21da045560e7e85d1e6f9777761ad9f0fea041f1716c0dc77f"} Jul 22 18:53:29.228705 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:29.228681 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:29.306517 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:29.306483 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4195f9e7-3a9c-43fc-b4ad-e78a6b069112-maas-api-service-ca\") pod \"4195f9e7-3a9c-43fc-b4ad-e78a6b069112\" (UID: \"4195f9e7-3a9c-43fc-b4ad-e78a6b069112\") " Jul 22 18:53:29.306900 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:29.306865 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4195f9e7-3a9c-43fc-b4ad-e78a6b069112-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4195f9e7-3a9c-43fc-b4ad-e78a6b069112" (UID: "4195f9e7-3a9c-43fc-b4ad-e78a6b069112"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:53:29.407962 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:29.407883 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4195f9e7-3a9c-43fc-b4ad-e78a6b069112-maas-api-service-ca\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 18:53:30.105436 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:30.105392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" event={"ID":"4195f9e7-3a9c-43fc-b4ad-e78a6b069112","Type":"ContainerDied","Data":"8c61f59b1393be5d6b4f8489319c0da50799ecd554d5f377ff44615053e9964a"} Jul 22 18:53:30.105616 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:30.105461 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c61f59b1393be5d6b4f8489319c0da50799ecd554d5f377ff44615053e9964a" Jul 22 18:53:30.105616 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:30.105408 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb" Jul 22 18:53:39.087599 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:39.087561 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb"] Jul 22 18:53:39.090338 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:39.090308 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d001ad-zp2lb"] Jul 22 18:53:39.161685 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:39.161628 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4195f9e7-3a9c-43fc-b4ad-e78a6b069112" path="/var/lib/kubelet/pods/4195f9e7-3a9c-43fc-b4ad-e78a6b069112/volumes" Jul 22 18:53:47.949452 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:47.949424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:53:47.957766 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:47.957739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:53:47.961939 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:47.961921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:53:47.966767 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:53:47.966751 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:58:47.987531 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:58:47.987415 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:58:47.993141 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:58:47.993121 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:58:47.998831 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:58:47.998813 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 18:58:48.010251 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:58:48.010230 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-882h7_30189d1d-f1c2-4f4c-9208-6cd6c295ca87/ovn-acl-logging/0.log" Jul 22 18:59:47.602952 ip-10-0-128-109 kubenswrapper[2562]: I0722 18:59:47.602915 2562 scope.go:117] "RemoveContainer" containerID="3eeda10afb424b21da045560e7e85d1e6f9777761ad9f0fea041f1716c0dc77f" Jul 22 19:00:00.178587 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.178556 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh"] Jul 22 19:00:00.179034 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.178948 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4195f9e7-3a9c-43fc-b4ad-e78a6b069112" containerName="revoke-keys" Jul 22 19:00:00.179034 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.178958 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4195f9e7-3a9c-43fc-b4ad-e78a6b069112" containerName="revoke-keys" Jul 22 19:00:00.179034 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.179021 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4195f9e7-3a9c-43fc-b4ad-e78a6b069112" containerName="revoke-keys" Jul 22 19:00:00.181616 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.181598 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt"] Jul 22 19:00:00.181746 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.181728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" Jul 22 19:00:00.184831 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.184811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" Jul 22 19:00:00.189002 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.188921 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z"] Jul 22 19:00:00.191191 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.191175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w7279\"" Jul 22 19:00:00.192130 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.192113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" Jul 22 19:00:00.192788 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.192774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" Jul 22 19:00:00.199977 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.199953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" Jul 22 19:00:00.216994 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.216909 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh"] Jul 22 19:00:00.219518 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.219498 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt"] Jul 22 19:00:00.223315 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.223261 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z"] Jul 22 19:00:00.239211 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.239176 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" Jul 22 19:00:00.373708 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.373678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh"] Jul 22 19:00:00.376540 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:00:00.376514 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeacf5c3_f108_4725_88e2_9d702ca4c68a.slice/crio-3267345ab30db59d1c9a317a5d09427c074bab2244295a0c6ab9bdad3fd06a02 WatchSource:0}: Error finding container 3267345ab30db59d1c9a317a5d09427c074bab2244295a0c6ab9bdad3fd06a02: Status 404 returned error can't find the container with id 3267345ab30db59d1c9a317a5d09427c074bab2244295a0c6ab9bdad3fd06a02 Jul 22 19:00:00.421192 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.421170 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z"] Jul 22 19:00:00.423386 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:00:00.423356 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7e2358_9db9_49b8_b168_7a96c9268a89.slice/crio-7a1ee6554be3cc516ea8d96b626838251f62e70b32d14049485db9f1197e6a3a WatchSource:0}: Error finding container 7a1ee6554be3cc516ea8d96b626838251f62e70b32d14049485db9f1197e6a3a: Status 404 returned error can't find the container with id 7a1ee6554be3cc516ea8d96b626838251f62e70b32d14049485db9f1197e6a3a Jul 22 19:00:00.596587 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:00.596563 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt"] Jul 22 19:00:00.597938 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:00:00.597907 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc454483a_5791_4381_9c32_1e8b2b34d593.slice/crio-c35623e28b5ed766cde7c99a6ec989da86fac11114ccc652080753ebb037978f WatchSource:0}: Error finding container c35623e28b5ed766cde7c99a6ec989da86fac11114ccc652080753ebb037978f: Status 404 returned error can't find the container with id c35623e28b5ed766cde7c99a6ec989da86fac11114ccc652080753ebb037978f Jul 22 19:00:01.176167 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.176070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" event={"ID":"c454483a-5791-4381-9c32-1e8b2b34d593","Type":"ContainerStarted","Data":"9f4afa2af448fd2ee4fcddeb1fd05310020e688dc507f65d87773c5ae41d8103"} Jul 22 19:00:01.176167 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.176127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" event={"ID":"c454483a-5791-4381-9c32-1e8b2b34d593","Type":"ContainerStarted","Data":"c35623e28b5ed766cde7c99a6ec989da86fac11114ccc652080753ebb037978f"} Jul 22 19:00:01.177624 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.177592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" event={"ID":"eeacf5c3-f108-4725-88e2-9d702ca4c68a","Type":"ContainerStarted","Data":"ac603f5b81f9d560574e6552bd7e73cdc48d3811f273e93c98bb7dee65f045fa"} Jul 22 19:00:01.177746 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.177643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" event={"ID":"eeacf5c3-f108-4725-88e2-9d702ca4c68a","Type":"ContainerStarted","Data":"3267345ab30db59d1c9a317a5d09427c074bab2244295a0c6ab9bdad3fd06a02"} Jul 22 19:00:01.179021 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.179002 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" event={"ID":"0f7e2358-9db9-49b8-b168-7a96c9268a89","Type":"ContainerStarted","Data":"64bfeb32c600cfa1ff57ef9baaf638f8d0f83ccfabfd7debadfba5070372a1f8"} Jul 22 19:00:01.179336 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.179043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" event={"ID":"0f7e2358-9db9-49b8-b168-7a96c9268a89","Type":"ContainerStarted","Data":"7a1ee6554be3cc516ea8d96b626838251f62e70b32d14049485db9f1197e6a3a"} Jul 22 19:00:01.191195 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.191151 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" podStartSLOduration=1.1911327840000001 podStartE2EDuration="1.191132784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:00:01.189557738 +0000 UTC m=+2774.465984082" watchObservedRunningTime="2026-07-22 19:00:01.191132784 +0000 UTC m=+2774.467559117" Jul 22 19:00:01.205855 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:01.205807 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" podStartSLOduration=1.205791499 podStartE2EDuration="1.205791499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:00:01.203552971 +0000 UTC m=+2774.479979331" watchObservedRunningTime="2026-07-22 19:00:01.205791499 +0000 UTC m=+2774.482217968" Jul 22 19:00:02.185450 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:02.185418 2562 generic.go:356] "Generic (PLEG): container finished" podID="0f7e2358-9db9-49b8-b168-7a96c9268a89" containerID="64bfeb32c600cfa1ff57ef9baaf638f8d0f83ccfabfd7debadfba5070372a1f8" exitCode=0 Jul 22 19:00:02.185939 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:02.185493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" event={"ID":"0f7e2358-9db9-49b8-b168-7a96c9268a89","Type":"ContainerDied","Data":"64bfeb32c600cfa1ff57ef9baaf638f8d0f83ccfabfd7debadfba5070372a1f8"} Jul 22 19:00:02.187157 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:02.187137 2562 generic.go:356] "Generic (PLEG): container finished" podID="c454483a-5791-4381-9c32-1e8b2b34d593" containerID="9f4afa2af448fd2ee4fcddeb1fd05310020e688dc507f65d87773c5ae41d8103" exitCode=0 Jul 22 19:00:02.187258 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:02.187225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" event={"ID":"c454483a-5791-4381-9c32-1e8b2b34d593","Type":"ContainerDied","Data":"9f4afa2af448fd2ee4fcddeb1fd05310020e688dc507f65d87773c5ae41d8103"} Jul 22 19:00:02.188636 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:02.188614 2562 generic.go:356] "Generic (PLEG): container finished" podID="eeacf5c3-f108-4725-88e2-9d702ca4c68a" containerID="ac603f5b81f9d560574e6552bd7e73cdc48d3811f273e93c98bb7dee65f045fa" exitCode=0 Jul 22 19:00:02.188755 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:02.188642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" event={"ID":"eeacf5c3-f108-4725-88e2-9d702ca4c68a","Type":"ContainerDied","Data":"ac603f5b81f9d560574e6552bd7e73cdc48d3811f273e93c98bb7dee65f045fa"} Jul 22 19:00:03.350609 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:03.350582 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" Jul 22 19:00:03.396020 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:03.395987 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" Jul 22 19:00:03.400295 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:03.400265 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" Jul 22 19:00:04.201940 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.201911 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" Jul 22 19:00:04.201940 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.201922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745780-7wllt" event={"ID":"c454483a-5791-4381-9c32-1e8b2b34d593","Type":"ContainerDied","Data":"c35623e28b5ed766cde7c99a6ec989da86fac11114ccc652080753ebb037978f"} Jul 22 19:00:04.202265 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.201970 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c35623e28b5ed766cde7c99a6ec989da86fac11114ccc652080753ebb037978f" Jul 22 19:00:04.203223 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.203205 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" Jul 22 19:00:04.203359 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.203254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh" event={"ID":"eeacf5c3-f108-4725-88e2-9d702ca4c68a","Type":"ContainerDied","Data":"3267345ab30db59d1c9a317a5d09427c074bab2244295a0c6ab9bdad3fd06a02"} Jul 22 19:00:04.203359 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.203327 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3267345ab30db59d1c9a317a5d09427c074bab2244295a0c6ab9bdad3fd06a02" Jul 22 19:00:04.204486 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.204469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" event={"ID":"0f7e2358-9db9-49b8-b168-7a96c9268a89","Type":"ContainerDied","Data":"7a1ee6554be3cc516ea8d96b626838251f62e70b32d14049485db9f1197e6a3a"} Jul 22 19:00:04.204582 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.204499 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a1ee6554be3cc516ea8d96b626838251f62e70b32d14049485db9f1197e6a3a" Jul 22 19:00:04.204582 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:00:04.204506 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z" Jul 22 19:01:06.653338 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653304 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139754714994352"] Jul 22 19:01:06.653795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653695 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeacf5c3-f108-4725-88e2-9d702ca4c68a" containerName="cleanup" Jul 22 19:01:06.653795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653708 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeacf5c3-f108-4725-88e2-9d702ca4c68a" containerName="cleanup" Jul 22 19:01:06.653795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653725 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c454483a-5791-4381-9c32-1e8b2b34d593" containerName="cleanup" Jul 22 19:01:06.653795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653731 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c454483a-5791-4381-9c32-1e8b2b34d593" containerName="cleanup" Jul 22 19:01:06.653795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653742 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7e2358-9db9-49b8-b168-7a96c9268a89" containerName="cleanup" Jul 22 19:01:06.653795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653747 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7e2358-9db9-49b8-b168-7a96c9268a89" containerName="cleanup" Jul 22 19:01:06.653996 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653805 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeacf5c3-f108-4725-88e2-9d702ca4c68a" containerName="cleanup" Jul 22 19:01:06.653996 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653814 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c454483a-5791-4381-9c32-1e8b2b34d593" containerName="cleanup" Jul 22 19:01:06.653996 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.653823 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f7e2358-9db9-49b8-b168-7a96c9268a89" containerName="cleanup" Jul 22 19:01:06.656998 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.656982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:06.659472 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.659434 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pjbvh\"" Jul 22 19:01:06.663105 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.663083 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714994352"] Jul 22 19:01:06.843834 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.843793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5kwn\" (UniqueName: \"kubernetes.io/projected/4506b5de-15d7-4a1a-a512-5af07236a5ff-kube-api-access-f5kwn\") pod \"test-curl-7497-139754714994352\" (UID: \"4506b5de-15d7-4a1a-a512-5af07236a5ff\") " pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:06.944605 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.944573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5kwn\" (UniqueName: \"kubernetes.io/projected/4506b5de-15d7-4a1a-a512-5af07236a5ff-kube-api-access-f5kwn\") pod \"test-curl-7497-139754714994352\" (UID: \"4506b5de-15d7-4a1a-a512-5af07236a5ff\") " pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:06.957807 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.957783 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5kwn\" (UniqueName: \"kubernetes.io/projected/4506b5de-15d7-4a1a-a512-5af07236a5ff-kube-api-access-f5kwn\") pod \"test-curl-7497-139754714994352\" (UID: \"4506b5de-15d7-4a1a-a512-5af07236a5ff\") " pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:06.967712 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:06.967689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:07.101993 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:07.101968 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714994352"] Jul 22 19:01:07.103536 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:01:07.103510 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4506b5de_15d7_4a1a_a512_5af07236a5ff.slice/crio-5fd2a784c6cba944bce89b9746f3a3b85b35537058290673beaae09ead13a646 WatchSource:0}: Error finding container 5fd2a784c6cba944bce89b9746f3a3b85b35537058290673beaae09ead13a646: Status 404 returned error can't find the container with id 5fd2a784c6cba944bce89b9746f3a3b85b35537058290673beaae09ead13a646 Jul 22 19:01:07.104849 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:07.104831 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 19:01:07.552860 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:07.552818 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714994352" event={"ID":"4506b5de-15d7-4a1a-a512-5af07236a5ff","Type":"ContainerStarted","Data":"5fd2a784c6cba944bce89b9746f3a3b85b35537058290673beaae09ead13a646"} Jul 22 19:01:08.559821 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:08.559785 2562 generic.go:356] "Generic (PLEG): container finished" podID="4506b5de-15d7-4a1a-a512-5af07236a5ff" containerID="b66ee395d2c2bee36432b96da15031a40061285a63afa1f0e02488000600aba9" exitCode=0 Jul 22 19:01:08.560275 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:08.559874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714994352" event={"ID":"4506b5de-15d7-4a1a-a512-5af07236a5ff","Type":"ContainerDied","Data":"b66ee395d2c2bee36432b96da15031a40061285a63afa1f0e02488000600aba9"} Jul 22 19:01:09.698273 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.698243 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:09.737038 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.737007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139754714994352_4506b5de-15d7-4a1a-a512-5af07236a5ff/test-curl-7497-139754714994352/0.log" Jul 22 19:01:09.762754 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.762724 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139754714994352"] Jul 22 19:01:09.768922 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.768900 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139754714994352"] Jul 22 19:01:09.872018 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.871935 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5kwn\" (UniqueName: \"kubernetes.io/projected/4506b5de-15d7-4a1a-a512-5af07236a5ff-kube-api-access-f5kwn\") pod \"4506b5de-15d7-4a1a-a512-5af07236a5ff\" (UID: \"4506b5de-15d7-4a1a-a512-5af07236a5ff\") " Jul 22 19:01:09.874256 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.874220 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4506b5de-15d7-4a1a-a512-5af07236a5ff-kube-api-access-f5kwn" (OuterVolumeSpecName: "kube-api-access-f5kwn") pod "4506b5de-15d7-4a1a-a512-5af07236a5ff" (UID: "4506b5de-15d7-4a1a-a512-5af07236a5ff"). InnerVolumeSpecName "kube-api-access-f5kwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:09.893995 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.893971 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139754714996016"] Jul 22 19:01:09.894330 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.894317 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4506b5de-15d7-4a1a-a512-5af07236a5ff" containerName="test-curl-7497-139754714994352" Jul 22 19:01:09.894387 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.894333 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4506b5de-15d7-4a1a-a512-5af07236a5ff" containerName="test-curl-7497-139754714994352" Jul 22 19:01:09.894423 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.894411 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4506b5de-15d7-4a1a-a512-5af07236a5ff" containerName="test-curl-7497-139754714994352" Jul 22 19:01:09.897392 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.897376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:09.902697 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.902637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714996016"] Jul 22 19:01:09.973116 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:09.973082 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5kwn\" (UniqueName: \"kubernetes.io/projected/4506b5de-15d7-4a1a-a512-5af07236a5ff-kube-api-access-f5kwn\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 19:01:10.074366 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.074330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75gp\" (UniqueName: \"kubernetes.io/projected/ca9dc9a2-baa4-465f-8ce7-04351186506f-kube-api-access-g75gp\") pod \"test-curl-7497-139754714996016\" (UID: \"ca9dc9a2-baa4-465f-8ce7-04351186506f\") " pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:10.175089 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.175002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75gp\" (UniqueName: \"kubernetes.io/projected/ca9dc9a2-baa4-465f-8ce7-04351186506f-kube-api-access-g75gp\") pod \"test-curl-7497-139754714996016\" (UID: \"ca9dc9a2-baa4-465f-8ce7-04351186506f\") " pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:10.183628 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.183590 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75gp\" (UniqueName: \"kubernetes.io/projected/ca9dc9a2-baa4-465f-8ce7-04351186506f-kube-api-access-g75gp\") pod \"test-curl-7497-139754714996016\" (UID: \"ca9dc9a2-baa4-465f-8ce7-04351186506f\") " pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:10.207996 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.207969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:10.351124 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.351099 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714996016"] Jul 22 19:01:10.353887 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:01:10.353857 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca9dc9a2_baa4_465f_8ce7_04351186506f.slice/crio-03cc7885cceae5766249db865a94a7e4a33987bf2f07f0695b5a96a132768706 WatchSource:0}: Error finding container 03cc7885cceae5766249db865a94a7e4a33987bf2f07f0695b5a96a132768706: Status 404 returned error can't find the container with id 03cc7885cceae5766249db865a94a7e4a33987bf2f07f0695b5a96a132768706 Jul 22 19:01:10.579691 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.579641 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:10.579691 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.579676 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fd2a784c6cba944bce89b9746f3a3b85b35537058290673beaae09ead13a646" Jul 22 19:01:10.581195 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:10.581168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714996016" event={"ID":"ca9dc9a2-baa4-465f-8ce7-04351186506f","Type":"ContainerStarted","Data":"03cc7885cceae5766249db865a94a7e4a33987bf2f07f0695b5a96a132768706"} Jul 22 19:01:10.591825 ip-10-0-128-109 kubenswrapper[2562]: E0722 19:01:10.591799 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139754714994352\" is forbidden: User \"system:node:ip-10-0-128-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-109.ec2.internal' and this object" podUID="4506b5de-15d7-4a1a-a512-5af07236a5ff" pod="opendatahub/test-curl-7497-139754714994352" Jul 22 19:01:11.162121 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:11.162088 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4506b5de-15d7-4a1a-a512-5af07236a5ff" path="/var/lib/kubelet/pods/4506b5de-15d7-4a1a-a512-5af07236a5ff/volumes" Jul 22 19:01:11.588019 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:11.587981 2562 generic.go:356] "Generic (PLEG): container finished" podID="ca9dc9a2-baa4-465f-8ce7-04351186506f" containerID="1f5374700f3bd886fd241800deb0f064f19dde94b37ad51290b909c56e859fdb" exitCode=0 Jul 22 19:01:11.588213 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:11.588066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714996016" event={"ID":"ca9dc9a2-baa4-465f-8ce7-04351186506f","Type":"ContainerDied","Data":"1f5374700f3bd886fd241800deb0f064f19dde94b37ad51290b909c56e859fdb"} Jul 22 19:01:12.728392 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.728368 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:12.751186 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.751162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139754714996016_ca9dc9a2-baa4-465f-8ce7-04351186506f/test-curl-7497-139754714996016/0.log" Jul 22 19:01:12.782263 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.782235 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139754714996016"] Jul 22 19:01:12.784951 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.784928 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139754714996016"] Jul 22 19:01:12.793871 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.793850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g75gp\" (UniqueName: \"kubernetes.io/projected/ca9dc9a2-baa4-465f-8ce7-04351186506f-kube-api-access-g75gp\") pod \"ca9dc9a2-baa4-465f-8ce7-04351186506f\" (UID: \"ca9dc9a2-baa4-465f-8ce7-04351186506f\") " Jul 22 19:01:12.796145 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.796125 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9dc9a2-baa4-465f-8ce7-04351186506f-kube-api-access-g75gp" (OuterVolumeSpecName: "kube-api-access-g75gp") pod "ca9dc9a2-baa4-465f-8ce7-04351186506f" (UID: "ca9dc9a2-baa4-465f-8ce7-04351186506f"). InnerVolumeSpecName "kube-api-access-g75gp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:12.894795 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.894714 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g75gp\" (UniqueName: \"kubernetes.io/projected/ca9dc9a2-baa4-465f-8ce7-04351186506f-kube-api-access-g75gp\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 19:01:12.958064 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.958028 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:12.958403 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.958390 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9dc9a2-baa4-465f-8ce7-04351186506f" containerName="test-curl-7497-139754714996016" Jul 22 19:01:12.958488 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.958405 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9dc9a2-baa4-465f-8ce7-04351186506f" containerName="test-curl-7497-139754714996016" Jul 22 19:01:12.958488 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.958463 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca9dc9a2-baa4-465f-8ce7-04351186506f" containerName="test-curl-7497-139754714996016" Jul 22 19:01:12.961375 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.961355 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:12.968070 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.968044 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:12.995535 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:12.995504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98bk6\" (UniqueName: \"kubernetes.io/projected/8c941273-12a6-419e-a2e8-8db1469410aa-kube-api-access-98bk6\") pod \"test-curl-7497-139754714879008\" (UID: \"8c941273-12a6-419e-a2e8-8db1469410aa\") " pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:13.096481 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.096447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98bk6\" (UniqueName: \"kubernetes.io/projected/8c941273-12a6-419e-a2e8-8db1469410aa-kube-api-access-98bk6\") pod \"test-curl-7497-139754714879008\" (UID: \"8c941273-12a6-419e-a2e8-8db1469410aa\") " pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:13.105403 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.105376 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98bk6\" (UniqueName: \"kubernetes.io/projected/8c941273-12a6-419e-a2e8-8db1469410aa-kube-api-access-98bk6\") pod \"test-curl-7497-139754714879008\" (UID: \"8c941273-12a6-419e-a2e8-8db1469410aa\") " pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:13.162082 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.162013 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca9dc9a2-baa4-465f-8ce7-04351186506f" path="/var/lib/kubelet/pods/ca9dc9a2-baa4-465f-8ce7-04351186506f/volumes" Jul 22 19:01:13.271423 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.271396 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:13.405708 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.405680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:13.407276 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:01:13.407250 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c941273_12a6_419e_a2e8_8db1469410aa.slice/crio-940492e16bd7581eb9b5069570c1fe7fd8534dc95f7979c24621e59e54e01d7f WatchSource:0}: Error finding container 940492e16bd7581eb9b5069570c1fe7fd8534dc95f7979c24621e59e54e01d7f: Status 404 returned error can't find the container with id 940492e16bd7581eb9b5069570c1fe7fd8534dc95f7979c24621e59e54e01d7f Jul 22 19:01:13.599852 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.599813 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714879008" event={"ID":"8c941273-12a6-419e-a2e8-8db1469410aa","Type":"ContainerStarted","Data":"940492e16bd7581eb9b5069570c1fe7fd8534dc95f7979c24621e59e54e01d7f"} Jul 22 19:01:13.601099 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.601081 2562 scope.go:117] "RemoveContainer" containerID="1f5374700f3bd886fd241800deb0f064f19dde94b37ad51290b909c56e859fdb" Jul 22 19:01:13.601211 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:13.601084 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714996016" Jul 22 19:01:14.607993 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:14.607956 2562 generic.go:356] "Generic (PLEG): container finished" podID="8c941273-12a6-419e-a2e8-8db1469410aa" containerID="ed754e037f927d999723135352e3e1e8710ddbcf56994219de81b514b1285ff4" exitCode=0 Jul 22 19:01:14.608393 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:14.608037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714879008" event={"ID":"8c941273-12a6-419e-a2e8-8db1469410aa","Type":"ContainerDied","Data":"ed754e037f927d999723135352e3e1e8710ddbcf56994219de81b514b1285ff4"} Jul 22 19:01:15.748129 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.748107 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:15.768517 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.768495 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139754714879008_8c941273-12a6-419e-a2e8-8db1469410aa/test-curl-7497-139754714879008/0.log" Jul 22 19:01:15.794187 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.794161 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:15.798344 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.798317 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:15.817160 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.817133 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98bk6\" (UniqueName: \"kubernetes.io/projected/8c941273-12a6-419e-a2e8-8db1469410aa-kube-api-access-98bk6\") pod \"8c941273-12a6-419e-a2e8-8db1469410aa\" (UID: \"8c941273-12a6-419e-a2e8-8db1469410aa\") " Jul 22 19:01:15.819320 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.819290 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c941273-12a6-419e-a2e8-8db1469410aa-kube-api-access-98bk6" (OuterVolumeSpecName: "kube-api-access-98bk6") pod "8c941273-12a6-419e-a2e8-8db1469410aa" (UID: "8c941273-12a6-419e-a2e8-8db1469410aa"). InnerVolumeSpecName "kube-api-access-98bk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:15.918562 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.918485 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98bk6\" (UniqueName: \"kubernetes.io/projected/8c941273-12a6-419e-a2e8-8db1469410aa-kube-api-access-98bk6\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 19:01:15.919575 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.919554 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:15.919957 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.919943 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c941273-12a6-419e-a2e8-8db1469410aa" containerName="test-curl-7497-139754714879008" Jul 22 19:01:15.919999 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.919959 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c941273-12a6-419e-a2e8-8db1469410aa" containerName="test-curl-7497-139754714879008" Jul 22 19:01:15.920053 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.920044 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c941273-12a6-419e-a2e8-8db1469410aa" containerName="test-curl-7497-139754714879008" Jul 22 19:01:15.923034 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.923014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:15.929144 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:15.929123 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:16.019116 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.019081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmslq\" (UniqueName: \"kubernetes.io/projected/a7be63d6-8aca-4cdb-8d47-958aa70361e3-kube-api-access-zmslq\") pod \"test-curl-7497-139754714879008\" (UID: \"a7be63d6-8aca-4cdb-8d47-958aa70361e3\") " pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:16.119506 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.119474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmslq\" (UniqueName: \"kubernetes.io/projected/a7be63d6-8aca-4cdb-8d47-958aa70361e3-kube-api-access-zmslq\") pod \"test-curl-7497-139754714879008\" (UID: \"a7be63d6-8aca-4cdb-8d47-958aa70361e3\") " pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:16.128232 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.128206 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmslq\" (UniqueName: \"kubernetes.io/projected/a7be63d6-8aca-4cdb-8d47-958aa70361e3-kube-api-access-zmslq\") pod \"test-curl-7497-139754714879008\" (UID: \"a7be63d6-8aca-4cdb-8d47-958aa70361e3\") " pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:16.232548 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.232517 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:16.367075 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.367048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:16.368254 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:01:16.368226 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7be63d6_8aca_4cdb_8d47_958aa70361e3.slice/crio-3cd296fc3351e37ec41d4d179dcd587f163100d3d758dd3e880111ef55bde32f WatchSource:0}: Error finding container 3cd296fc3351e37ec41d4d179dcd587f163100d3d758dd3e880111ef55bde32f: Status 404 returned error can't find the container with id 3cd296fc3351e37ec41d4d179dcd587f163100d3d758dd3e880111ef55bde32f Jul 22 19:01:16.622542 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.622438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714879008" event={"ID":"a7be63d6-8aca-4cdb-8d47-958aa70361e3","Type":"ContainerStarted","Data":"3cd296fc3351e37ec41d4d179dcd587f163100d3d758dd3e880111ef55bde32f"} Jul 22 19:01:16.623935 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.623906 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="940492e16bd7581eb9b5069570c1fe7fd8534dc95f7979c24621e59e54e01d7f" Jul 22 19:01:16.624076 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.623948 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:16.638031 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:16.637988 2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7497-139754714879008" oldPodUID="8c941273-12a6-419e-a2e8-8db1469410aa" podUID="a7be63d6-8aca-4cdb-8d47-958aa70361e3" Jul 22 19:01:17.163500 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:17.163458 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c941273-12a6-419e-a2e8-8db1469410aa" path="/var/lib/kubelet/pods/8c941273-12a6-419e-a2e8-8db1469410aa/volumes" Jul 22 19:01:17.631129 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:17.631094 2562 generic.go:356] "Generic (PLEG): container finished" podID="a7be63d6-8aca-4cdb-8d47-958aa70361e3" containerID="f6526f4092c9062b07f1ae5a5bce8220d0a26567cb68a47a02de8309aa58269a" exitCode=0 Jul 22 19:01:17.631310 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:17.631161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714879008" event={"ID":"a7be63d6-8aca-4cdb-8d47-958aa70361e3","Type":"ContainerDied","Data":"f6526f4092c9062b07f1ae5a5bce8220d0a26567cb68a47a02de8309aa58269a"} Jul 22 19:01:18.772560 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.772530 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:18.792386 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.792335 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139754714879008_a7be63d6-8aca-4cdb-8d47-958aa70361e3/test-curl-7497-139754714879008/0.log" Jul 22 19:01:18.818155 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.818127 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:18.821389 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.821366 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139754714879008"] Jul 22 19:01:18.843241 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.843222 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmslq\" (UniqueName: \"kubernetes.io/projected/a7be63d6-8aca-4cdb-8d47-958aa70361e3-kube-api-access-zmslq\") pod \"a7be63d6-8aca-4cdb-8d47-958aa70361e3\" (UID: \"a7be63d6-8aca-4cdb-8d47-958aa70361e3\") " Jul 22 19:01:18.845457 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.845437 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7be63d6-8aca-4cdb-8d47-958aa70361e3-kube-api-access-zmslq" (OuterVolumeSpecName: "kube-api-access-zmslq") pod "a7be63d6-8aca-4cdb-8d47-958aa70361e3" (UID: "a7be63d6-8aca-4cdb-8d47-958aa70361e3"). InnerVolumeSpecName "kube-api-access-zmslq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:18.944255 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.944215 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmslq\" (UniqueName: \"kubernetes.io/projected/a7be63d6-8aca-4cdb-8d47-958aa70361e3-kube-api-access-zmslq\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 19:01:18.945280 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.945259 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139754714880016"] Jul 22 19:01:18.945620 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.945608 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7be63d6-8aca-4cdb-8d47-958aa70361e3" containerName="test-curl-7497-139754714879008" Jul 22 19:01:18.945670 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.945622 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7be63d6-8aca-4cdb-8d47-958aa70361e3" containerName="test-curl-7497-139754714879008" Jul 22 19:01:18.945731 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.945721 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7be63d6-8aca-4cdb-8d47-958aa70361e3" containerName="test-curl-7497-139754714879008" Jul 22 19:01:18.948722 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.948708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:18.954690 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:18.954663 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714880016"] Jul 22 19:01:19.044966 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.044938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pt6n\" (UniqueName: \"kubernetes.io/projected/62f512d6-7e14-42ad-bb56-242f197d0165-kube-api-access-6pt6n\") pod \"test-curl-7497-139754714880016\" (UID: \"62f512d6-7e14-42ad-bb56-242f197d0165\") " pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:19.145395 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.145358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pt6n\" (UniqueName: \"kubernetes.io/projected/62f512d6-7e14-42ad-bb56-242f197d0165-kube-api-access-6pt6n\") pod \"test-curl-7497-139754714880016\" (UID: \"62f512d6-7e14-42ad-bb56-242f197d0165\") " pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:19.153986 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.153963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pt6n\" (UniqueName: \"kubernetes.io/projected/62f512d6-7e14-42ad-bb56-242f197d0165-kube-api-access-6pt6n\") pod \"test-curl-7497-139754714880016\" (UID: \"62f512d6-7e14-42ad-bb56-242f197d0165\") " pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:19.162443 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.162413 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7be63d6-8aca-4cdb-8d47-958aa70361e3" path="/var/lib/kubelet/pods/a7be63d6-8aca-4cdb-8d47-958aa70361e3/volumes" Jul 22 19:01:19.259525 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.259454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:19.393921 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.393891 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139754714880016"] Jul 22 19:01:19.395463 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:01:19.395442 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62f512d6_7e14_42ad_bb56_242f197d0165.slice/crio-96352872fd8295e1b0594c45501a0a539eefd7ab7d882f3633f1c96f839d4761 WatchSource:0}: Error finding container 96352872fd8295e1b0594c45501a0a539eefd7ab7d882f3633f1c96f839d4761: Status 404 returned error can't find the container with id 96352872fd8295e1b0594c45501a0a539eefd7ab7d882f3633f1c96f839d4761 Jul 22 19:01:19.643357 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.643254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714880016" event={"ID":"62f512d6-7e14-42ad-bb56-242f197d0165","Type":"ContainerStarted","Data":"96352872fd8295e1b0594c45501a0a539eefd7ab7d882f3633f1c96f839d4761"} Jul 22 19:01:19.644562 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.644542 2562 scope.go:117] "RemoveContainer" containerID="f6526f4092c9062b07f1ae5a5bce8220d0a26567cb68a47a02de8309aa58269a" Jul 22 19:01:19.644562 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:19.644560 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714879008" Jul 22 19:01:20.651787 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:20.651750 2562 generic.go:356] "Generic (PLEG): container finished" podID="62f512d6-7e14-42ad-bb56-242f197d0165" containerID="ce5a011f574933d32138ba67dce195c81c67e6fccf158bda9dff3737b7848e72" exitCode=0 Jul 22 19:01:20.652223 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:20.651833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139754714880016" event={"ID":"62f512d6-7e14-42ad-bb56-242f197d0165","Type":"ContainerDied","Data":"ce5a011f574933d32138ba67dce195c81c67e6fccf158bda9dff3737b7848e72"} Jul 22 19:01:21.789460 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.789437 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:21.809340 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.809313 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139754714880016_62f512d6-7e14-42ad-bb56-242f197d0165/test-curl-7497-139754714880016/0.log" Jul 22 19:01:21.837778 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.837753 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139754714880016"] Jul 22 19:01:21.843074 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.843050 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139754714880016"] Jul 22 19:01:21.870664 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.870625 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pt6n\" (UniqueName: \"kubernetes.io/projected/62f512d6-7e14-42ad-bb56-242f197d0165-kube-api-access-6pt6n\") pod \"62f512d6-7e14-42ad-bb56-242f197d0165\" (UID: \"62f512d6-7e14-42ad-bb56-242f197d0165\") " Jul 22 19:01:21.872770 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.872744 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f512d6-7e14-42ad-bb56-242f197d0165-kube-api-access-6pt6n" (OuterVolumeSpecName: "kube-api-access-6pt6n") pod "62f512d6-7e14-42ad-bb56-242f197d0165" (UID: "62f512d6-7e14-42ad-bb56-242f197d0165"). InnerVolumeSpecName "kube-api-access-6pt6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:21.971598 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:21.971554 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pt6n\" (UniqueName: \"kubernetes.io/projected/62f512d6-7e14-42ad-bb56-242f197d0165-kube-api-access-6pt6n\") on node \"ip-10-0-128-109.ec2.internal\" DevicePath \"\"" Jul 22 19:01:22.664469 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:22.664442 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:22.664674 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:22.664442 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96352872fd8295e1b0594c45501a0a539eefd7ab7d882f3633f1c96f839d4761" Jul 22 19:01:22.674231 ip-10-0-128-109 kubenswrapper[2562]: E0722 19:01:22.674204 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139754714880016\" is forbidden: User \"system:node:ip-10-0-128-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-109.ec2.internal' and this object" podUID="62f512d6-7e14-42ad-bb56-242f197d0165" pod="opendatahub/test-curl-7497-139754714880016" Jul 22 19:01:23.162104 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:23.162075 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f512d6-7e14-42ad-bb56-242f197d0165" path="/var/lib/kubelet/pods/62f512d6-7e14-42ad-bb56-242f197d0165/volumes" Jul 22 19:01:36.076951 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:36.076918 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh"] Jul 22 19:01:36.082113 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:36.082089 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d24283-29745780-5jfkh"] Jul 22 19:01:37.162415 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:37.162369 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeacf5c3-f108-4725-88e2-9d702ca4c68a" path="/var/lib/kubelet/pods/eeacf5c3-f108-4725-88e2-9d702ca4c68a/volumes" Jul 22 19:01:59.187925 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:59.187889 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z"] Jul 22 19:01:59.191800 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:01:59.191775 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-63c82d-29745780-5tt6z"] Jul 22 19:02:01.161926 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:01.161887 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f7e2358-9db9-49b8-b168-7a96c9268a89" path="/var/lib/kubelet/pods/0f7e2358-9db9-49b8-b168-7a96c9268a89/volumes" Jul 22 19:02:11.774791 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:11.774760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ccfc54956-f7whv_f03e5d62-3a51-4d70-b6f9-380cb186f29b/authorino/0.log" Jul 22 19:02:18.214604 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:18.214572 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-6m257_08072f30-fde9-465b-948d-5c5a447903ee/copy-manifests/0.log" Jul 22 19:02:18.222115 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:18.222092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-6m257_08072f30-fde9-465b-948d-5c5a447903ee/manager/0.log" Jul 22 19:02:19.219162 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:19.219123 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745780-7wllt_c454483a-5791-4381-9c32-1e8b2b34d593/cleanup/0.log" Jul 22 19:02:20.173974 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.173941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq_6677ea46-b686-40bb-94d1-474cec84a688/util/0.log" Jul 22 19:02:20.182428 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.182406 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq_6677ea46-b686-40bb-94d1-474cec84a688/pull/0.log" Jul 22 19:02:20.189888 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.189853 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq_6677ea46-b686-40bb-94d1-474cec84a688/extract/0.log" Jul 22 19:02:20.304091 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.304062 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll_bf07dacf-347c-4bae-ae2c-330cf29adfbc/util/0.log" Jul 22 19:02:20.312066 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.312048 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll_bf07dacf-347c-4bae-ae2c-330cf29adfbc/pull/0.log" Jul 22 19:02:20.319014 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.318997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll_bf07dacf-347c-4bae-ae2c-330cf29adfbc/extract/0.log" Jul 22 19:02:20.456600 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.456575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w_3653dd2d-de18-4851-9fe3-bc9e3976c495/util/0.log" Jul 22 19:02:20.469224 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.469203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w_3653dd2d-de18-4851-9fe3-bc9e3976c495/pull/0.log" Jul 22 19:02:20.488026 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.487991 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w_3653dd2d-de18-4851-9fe3-bc9e3976c495/extract/0.log" Jul 22 19:02:20.611388 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.611356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb_404ec0d6-9a00-464e-8891-824476387eb1/pull/0.log" Jul 22 19:02:20.621516 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.621492 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb_404ec0d6-9a00-464e-8891-824476387eb1/extract/0.log" Jul 22 19:02:20.631970 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.631944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb_404ec0d6-9a00-464e-8891-824476387eb1/util/0.log" Jul 22 19:02:20.763956 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:20.763894 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ccfc54956-f7whv_f03e5d62-3a51-4d70-b6f9-380cb186f29b/authorino/0.log" Jul 22 19:02:21.400363 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:21.400338 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xz4h9_2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8/manager/0.log" Jul 22 19:02:22.458685 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:22.458636 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f4c4dbc87-gbbtd_853f8719-e622-4b7a-b1a0-9365885ca950/kube-auth-proxy/0.log" Jul 22 19:02:22.986840 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:22.986797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7786fd84-b4hdj_e884571b-741d-409d-9680-c76118c21c40/router/0.log" Jul 22 19:02:23.614907 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:23.614879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qtb78_72e19196-9b38-4d2e-b859-48e26a91e88f/main/0.log" Jul 22 19:02:24.003581 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:24.003542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mrh87_b3a5792e-f34e-4b25-b549-a35c4288baf9/main/0.log" Jul 22 19:02:33.093851 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:33.093819 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4tw4p_841e7253-7266-400b-bf70-a26159dd5811/global-pull-secret-syncer/0.log" Jul 22 19:02:33.243516 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:33.243490 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kjcz9_6a15ecf2-1500-4bcb-9afd-4117ed026545/konnectivity-agent/0.log" Jul 22 19:02:33.302170 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:33.302135 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-109.ec2.internal_93b88c9554c3d1c5c57b49c2ee4f8f5e/haproxy/0.log" Jul 22 19:02:37.788227 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.788198 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq_6677ea46-b686-40bb-94d1-474cec84a688/extract/0.log" Jul 22 19:02:37.809864 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.809836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq_6677ea46-b686-40bb-94d1-474cec84a688/util/0.log" Jul 22 19:02:37.830715 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.830693 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wtrq_6677ea46-b686-40bb-94d1-474cec84a688/pull/0.log" Jul 22 19:02:37.858509 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.858481 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll_bf07dacf-347c-4bae-ae2c-330cf29adfbc/extract/0.log" Jul 22 19:02:37.880003 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.879972 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll_bf07dacf-347c-4bae-ae2c-330cf29adfbc/util/0.log" Jul 22 19:02:37.900458 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.900437 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pn7ll_bf07dacf-347c-4bae-ae2c-330cf29adfbc/pull/0.log" Jul 22 19:02:37.946052 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.946025 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w_3653dd2d-de18-4851-9fe3-bc9e3976c495/extract/0.log" Jul 22 19:02:37.969321 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.969294 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w_3653dd2d-de18-4851-9fe3-bc9e3976c495/util/0.log" Jul 22 19:02:37.991639 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:37.991611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734rt2w_3653dd2d-de18-4851-9fe3-bc9e3976c495/pull/0.log" Jul 22 19:02:38.027203 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:38.027179 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb_404ec0d6-9a00-464e-8891-824476387eb1/extract/0.log" Jul 22 19:02:38.048813 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:38.048740 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb_404ec0d6-9a00-464e-8891-824476387eb1/util/0.log" Jul 22 19:02:38.070729 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:38.070686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h9vxb_404ec0d6-9a00-464e-8891-824476387eb1/pull/0.log" Jul 22 19:02:38.422080 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:38.421994 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ccfc54956-f7whv_f03e5d62-3a51-4d70-b6f9-380cb186f29b/authorino/0.log" Jul 22 19:02:38.673540 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:38.673452 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xz4h9_2ef3ddcd-c6eb-4eab-92cf-64e7dfd73cf8/manager/0.log" Jul 22 19:02:40.285060 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.285030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/alertmanager/0.log" Jul 22 19:02:40.309952 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.309930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/config-reloader/0.log" Jul 22 19:02:40.331770 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.331746 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/kube-rbac-proxy-web/0.log" Jul 22 19:02:40.357204 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.357180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/kube-rbac-proxy/0.log" Jul 22 19:02:40.385491 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.385456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/kube-rbac-proxy-metric/0.log" Jul 22 19:02:40.407193 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.407172 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/prom-label-proxy/0.log" Jul 22 19:02:40.430504 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.430480 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_816a5cb0-03a8-4509-bb45-8a326935a45b/init-config-reloader/0.log" Jul 22 19:02:40.739343 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.739316 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4b29_73c10ce5-84e3-4eed-8570-3051ea61d561/node-exporter/0.log" Jul 22 19:02:40.766166 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.766144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4b29_73c10ce5-84e3-4eed-8570-3051ea61d561/kube-rbac-proxy/0.log" Jul 22 19:02:40.789217 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.789201 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4b29_73c10ce5-84e3-4eed-8570-3051ea61d561/init-textfile/0.log" Jul 22 19:02:40.909343 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.909319 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-b62c7_96b2daf7-5e18-4998-8ca5-0ff843afd0ab/kube-rbac-proxy-main/0.log" Jul 22 19:02:40.937843 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.937818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-b62c7_96b2daf7-5e18-4998-8ca5-0ff843afd0ab/kube-rbac-proxy-self/0.log" Jul 22 19:02:40.963889 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:40.963866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-b62c7_96b2daf7-5e18-4998-8ca5-0ff843afd0ab/openshift-state-metrics/0.log" Jul 22 19:02:41.191674 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:41.191638 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-rql6j_83354a77-283f-498c-ac33-06347f5d9aae/prometheus-operator/0.log" Jul 22 19:02:41.210779 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:41.210751 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-rql6j_83354a77-283f-498c-ac33-06347f5d9aae/kube-rbac-proxy/0.log" Jul 22 19:02:41.266331 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:41.266310 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cff7c6899-cw7hp_90c209a1-ec35-46c0-a326-862416b3a7b2/telemeter-client/0.log" Jul 22 19:02:41.288043 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:41.288024 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cff7c6899-cw7hp_90c209a1-ec35-46c0-a326-862416b3a7b2/reload/0.log" Jul 22 19:02:41.308304 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:41.308279 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cff7c6899-cw7hp_90c209a1-ec35-46c0-a326-862416b3a7b2/kube-rbac-proxy/0.log" Jul 22 19:02:42.568110 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:42.568081 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-zrrvv_fca7bdbe-76eb-4dda-9d75-fe6a29e1f75e/networking-console-plugin/0.log" Jul 22 19:02:43.134889 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.134859 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts"] Jul 22 19:02:43.135256 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.135242 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f512d6-7e14-42ad-bb56-242f197d0165" containerName="test-curl-7497-139754714880016" Jul 22 19:02:43.135299 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.135258 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f512d6-7e14-42ad-bb56-242f197d0165" containerName="test-curl-7497-139754714880016" Jul 22 19:02:43.135339 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.135333 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f512d6-7e14-42ad-bb56-242f197d0165" containerName="test-curl-7497-139754714880016" Jul 22 19:02:43.138628 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.138609 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.140930 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.140901 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6bg7\"/\"openshift-service-ca.crt\"" Jul 22 19:02:43.141162 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.141147 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6bg7\"/\"kube-root-ca.crt\"" Jul 22 19:02:43.141711 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.141696 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6bg7\"/\"default-dockercfg-m6ggt\"" Jul 22 19:02:43.148470 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.148451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts"] Jul 22 19:02:43.230038 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.230005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/1.log" Jul 22 19:02:43.235107 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.235084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-fq4vs_6e4d1f5d-ae4a-4183-bf42-7882a004f2ae/console-operator/2.log" Jul 22 19:02:43.258349 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.258323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-proc\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.258468 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.258383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-lib-modules\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.258468 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.258434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-sys\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.258553 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.258471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqd2b\" (UniqueName: \"kubernetes.io/projected/54e30e27-5838-4c83-a630-aa9b09f7dc1c-kube-api-access-rqd2b\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.258553 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.258515 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-podres\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359560 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-proc\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-lib-modules\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359601 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-proc\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-sys\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqd2b\" (UniqueName: \"kubernetes.io/projected/54e30e27-5838-4c83-a630-aa9b09f7dc1c-kube-api-access-rqd2b\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-podres\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359709 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-sys\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.359768 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-lib-modules\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.360055 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.359809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54e30e27-5838-4c83-a630-aa9b09f7dc1c-podres\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.368376 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.368345 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqd2b\" (UniqueName: \"kubernetes.io/projected/54e30e27-5838-4c83-a630-aa9b09f7dc1c-kube-api-access-rqd2b\") pod \"perf-node-gather-daemonset-cfgts\" (UID: \"54e30e27-5838-4c83-a630-aa9b09f7dc1c\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.449278 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.449257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:43.582508 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:43.582485 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts"] Jul 22 19:02:43.584540 ip-10-0-128-109 kubenswrapper[2562]: W0722 19:02:43.584514 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod54e30e27_5838_4c83_a630_aa9b09f7dc1c.slice/crio-1f475d35914f2bce6c5765a1bbd3e6f4bc24404948168037fb7e043edf0c99af WatchSource:0}: Error finding container 1f475d35914f2bce6c5765a1bbd3e6f4bc24404948168037fb7e043edf0c99af: Status 404 returned error can't find the container with id 1f475d35914f2bce6c5765a1bbd3e6f4bc24404948168037fb7e043edf0c99af Jul 22 19:02:44.108873 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:44.108765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" event={"ID":"54e30e27-5838-4c83-a630-aa9b09f7dc1c","Type":"ContainerStarted","Data":"9a8af50fe698cf54d242d34e22fabad5ea22a916b04d7fe989bbf18221a0410b"} Jul 22 19:02:44.109063 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:44.108883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" event={"ID":"54e30e27-5838-4c83-a630-aa9b09f7dc1c","Type":"ContainerStarted","Data":"1f475d35914f2bce6c5765a1bbd3e6f4bc24404948168037fb7e043edf0c99af"} Jul 22 19:02:44.109289 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:44.109269 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:44.126882 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:44.126821 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" podStartSLOduration=1.126806027 podStartE2EDuration="1.126806027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 19:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:02:44.125049359 +0000 UTC m=+2937.401475692" watchObservedRunningTime="2026-07-22 19:02:44.126806027 +0000 UTC m=+2937.403232360" Jul 22 19:02:45.592672 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:45.592630 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rrx5x_d4cf2973-e2b8-48d5-9acd-06882d28e20c/dns/0.log" Jul 22 19:02:45.615935 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:45.615909 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rrx5x_d4cf2973-e2b8-48d5-9acd-06882d28e20c/kube-rbac-proxy/0.log" Jul 22 19:02:45.644324 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:45.644300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5cxjn_69d56011-97b9-4ee8-afe8-70eb144ffa91/dns-node-resolver/0.log" Jul 22 19:02:46.236467 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:46.236416 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8hv67_1b59067d-eaf3-43d8-919d-2a6b9c20c6fe/node-ca/0.log" Jul 22 19:02:47.432022 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:47.431994 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f4c4dbc87-gbbtd_853f8719-e622-4b7a-b1a0-9365885ca950/kube-auth-proxy/0.log" Jul 22 19:02:47.578670 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:47.578623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7786fd84-b4hdj_e884571b-741d-409d-9680-c76118c21c40/router/0.log" Jul 22 19:02:48.358207 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:48.358171 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tfrrf_71042e40-23dc-407a-87df-81c07653fb62/serve-healthcheck-canary/0.log" Jul 22 19:02:48.906021 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:48.905968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-wq85t_0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf/insights-operator/0.log" Jul 22 19:02:48.906558 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:48.906340 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-wq85t_0a892e02-63f8-4ab6-8ceb-7d7b75cdf9cf/insights-operator/1.log" Jul 22 19:02:48.941866 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:48.941815 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnt4z_2fbd8674-8887-4489-9855-8d07f85be979/kube-rbac-proxy/0.log" Jul 22 19:02:48.984789 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:48.984765 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnt4z_2fbd8674-8887-4489-9855-8d07f85be979/exporter/0.log" Jul 22 19:02:49.015353 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:49.015326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnt4z_2fbd8674-8887-4489-9855-8d07f85be979/extractor/0.log" Jul 22 19:02:50.125357 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:50.125323 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-cfgts" Jul 22 19:02:52.237091 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:52.237057 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-6m257_08072f30-fde9-465b-948d-5c5a447903ee/manager/0.log" Jul 22 19:02:52.262021 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:52.261953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-6m257_08072f30-fde9-465b-948d-5c5a447903ee/copy-manifests/0.log" Jul 22 19:02:53.747489 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:53.747459 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f4c4dbc87-gbbtd_853f8719-e622-4b7a-b1a0-9365885ca950/kube-auth-proxy/0.log" Jul 22 19:02:53.787825 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:53.787791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b479b546f-9pnm4_e92134c1-bdb8-4982-8faa-656b4628292c/manager/0.log" Jul 22 19:02:53.817364 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:53.817342 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-67fln_3dec8739-bcf0-4b2a-8a2a-1fd720cb4907/openshift-lws-operator/0.log" Jul 22 19:02:53.848317 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:53.848292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7786fd84-b4hdj_e884571b-741d-409d-9680-c76118c21c40/router/0.log" Jul 22 19:02:55.323464 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:55.323436 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f4c4dbc87-gbbtd_853f8719-e622-4b7a-b1a0-9365885ca950/kube-auth-proxy/0.log" Jul 22 19:02:55.425556 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:55.425494 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7786fd84-b4hdj_e884571b-741d-409d-9680-c76118c21c40/router/0.log" Jul 22 19:02:58.743528 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:58.743417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-sr9pw_2bc4a80d-c9de-40d3-9c29-01e3af5b68b4/migrator/0.log" Jul 22 19:02:58.765549 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:02:58.765521 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-sr9pw_2bc4a80d-c9de-40d3-9c29-01e3af5b68b4/graceful-termination/0.log" Jul 22 19:03:00.141960 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:03:00.141932 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4sch_1f6a9bd9-ec12-4d8a-9012-121d69a053e6/kube-multus-additional-cni-plugins/0.log" Jul 22 19:03:00.171503 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:03:00.171478 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4sch_1f6a9bd9-ec12-4d8a-9012-121d69a053e6/egress-router-binary-copy/0.log" Jul 22 19:03:00.201127 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:03:00.201104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4sch_1f6a9bd9-ec12-4d8a-9012-121d69a053e6/cni-plugins/0.log" Jul 22 19:03:00.228454 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:03:00.228428 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4sch_1f6a9bd9-ec12-4d8a-9012-121d69a053e6/bond-cni-plugin/0.log" Jul 22 19:03:00.254133 ip-10-0-128-109 kubenswrapper[2562]: I0722 19:03:00.254099 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b4sch_1f6a9bd9-ec12-4d8a-9012-121d69a053e6/routeoverride-cni/0.log"