Jul 07 14:01:52.747424 ip-10-0-129-212 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.173420 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177065 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177076 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177079 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177082 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177085 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177089 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177092 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:01:53.224886 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177094 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177097 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177100 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177102 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177105 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177107 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177110 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177112 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177115 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177127 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177130 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177132 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177135 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177138 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177140 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177143 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177145 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177148 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177151 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177154 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:01:53.225981 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177156 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177159 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177161 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177163 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177166 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177169 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177185 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177188 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177191 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177193 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177196 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177198 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177201 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177203 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177206 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177210 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177212 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177216 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177220 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:01:53.226858 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177224 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177226 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177229 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177232 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177234 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177237 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177239 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177242 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177244 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177247 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177249 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177253 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177256 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177258 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177261 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177263 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177267 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177269 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177272 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177274 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:01:53.227758 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177278 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177283 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177286 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177289 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177292 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177295 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177299 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177304 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177307 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177310 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177312 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177314 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177317 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177320 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177323 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177327 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177329 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177332 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177334 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177337 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:01:53.228664 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177339 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177342 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177344 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177347 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177349 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177352 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177354 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177357 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177359 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177362 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177364 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177367 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.177370 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178906 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178914 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178917 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178921 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178924 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178928 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:01:53.229550 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178931 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178934 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178936 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178939 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178941 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178944 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178946 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178949 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178952 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178954 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178957 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178960 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178962 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178965 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178967 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178970 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178972 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178975 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178978 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178980 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:01:53.230447 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178983 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178985 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178988 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178991 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178993 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178996 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.178998 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179001 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179003 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179006 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179008 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179011 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179014 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179017 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179019 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179021 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179024 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179027 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179029 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179032 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:01:53.231329 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179035 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179037 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179040 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179042 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179046 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179050 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179052 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179055 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179058 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179061 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179065 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179067 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179070 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179073 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179075 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179079 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179082 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179085 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179088 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:01:53.232449 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179091 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179094 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179097 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179099 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179102 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179107 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179110 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179113 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179116 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179118 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179121 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179124 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179126 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179129 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179131 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179133 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179136 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179138 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179141 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:01:53.233326 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179144 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179146 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179148 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179151 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179153 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179156 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179158 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179160 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179163 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179166 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179168 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179185 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179188 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179191 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179194 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179562 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179567 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179569 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179572 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179575 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:01:53.234437 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179578 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179581 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179583 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179588 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179591 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179594 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179596 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179599 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179601 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179604 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179606 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179609 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179611 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179614 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179616 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179619 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179621 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179624 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179628 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179630 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:01:53.235323 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179633 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179636 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179638 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179641 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179643 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179646 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179648 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179651 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179653 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179655 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179658 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179660 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179663 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179666 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179669 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179673 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179678 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179681 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179684 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179687 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:01:53.236238 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179690 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179693 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179696 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179698 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179701 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179703 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179706 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179708 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179711 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179713 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179717 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179720 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179722 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179725 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179727 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179730 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179733 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179735 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179738 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179740 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:01:53.237112 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179743 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179745 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179749 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179752 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179755 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179758 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179761 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179765 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179768 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179770 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179773 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179775 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179778 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179781 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179783 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179786 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179788 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179791 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179795 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:01:53.237976 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179798 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179800 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179803 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179807 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179809 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179812 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179814 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179817 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179819 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179822 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179824 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179826 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179829 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179831 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.179833 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179905 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179915 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179924 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179930 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179939 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179949 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:01:53.238854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179957 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179962 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179967 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179972 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179977 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179981 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179984 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179987 2580 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179990 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179993 2580 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179996 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.179999 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180003 2580 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180006 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180011 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180014 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180017 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180021 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180024 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180027 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180030 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180033 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180036 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180039 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:01:53.239750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180042 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180045 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180053 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180056 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180059 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180061 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180064 2580 flags.go:64] FLAG: --enable-server="true" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180070 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180074 2580 flags.go:64] FLAG: --event-burst="100" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180077 2580 flags.go:64] FLAG: --event-qps="50" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180080 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180083 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180085 2580 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180089 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180092 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180095 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180098 2580 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180101 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180103 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180106 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180109 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180112 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180116 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180119 2580 flags.go:64] FLAG: --feature-gates="" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180122 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:01:53.240863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180125 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:01:53.241579 ip-10-0-129-212 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180128 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180131 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180134 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180137 2580 flags.go:64] FLAG: --help="false" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180139 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180142 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180145 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180148 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180151 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180154 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180157 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180160 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180163 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180167 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180183 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180187 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180189 2580 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180193 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180196 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180199 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180214 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180217 2580 flags.go:64] FLAG: --lock-file="" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180221 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:01:53.242271 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180224 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180227 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180233 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180235 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180238 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180242 2580 flags.go:64] FLAG: --logging-format="text" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180245 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180249 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180251 2580 flags.go:64] FLAG: --manifest-url="" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180254 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180259 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180262 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180266 2580 flags.go:64] FLAG: --max-pods="110" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180269 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180272 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180274 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180277 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180280 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180283 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180286 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180292 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180295 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180299 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:01:53.247211 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180302 2580 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180310 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180315 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180318 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180321 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180324 2580 flags.go:64] FLAG: --port="10250" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180327 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180330 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e520128dcda8c300" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180333 2580 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180335 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180338 2580 flags.go:64] FLAG: --register-node="true" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180341 2580 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180345 2580 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180347 2580 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180350 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180354 2580 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180357 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180360 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180363 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180366 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180368 2580 flags.go:64] FLAG: --runonce="false" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180371 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180374 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180377 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180380 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:01:53.248512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180382 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180385 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180388 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180391 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180394 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180397 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180400 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180403 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180406 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180416 2580 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180419 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180424 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180426 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180429 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180436 2580 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180439 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180442 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180445 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180448 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180451 2580 flags.go:64] FLAG: --v="2" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180455 2580 flags.go:64] FLAG: --version="false" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180458 2580 flags.go:64] FLAG: --vmodule="" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180463 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180466 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180577 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:01:53.420003 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180581 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180584 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180587 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180590 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180593 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180595 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180598 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180602 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180606 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180609 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180613 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180615 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180618 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180623 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180626 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180629 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180632 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180637 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180640 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:01:53.421133 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180642 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180645 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180648 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180650 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180653 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180656 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180658 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180661 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180663 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180666 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180670 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180672 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180675 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180678 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180680 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180683 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180685 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180688 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180690 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180693 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:01:53.421897 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180695 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180698 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180700 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180703 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180705 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180708 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180712 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180714 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180717 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180720 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180724 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180730 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180734 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180736 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180739 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180742 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180744 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180747 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180749 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180752 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:01:53.422867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180755 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180757 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180761 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180763 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180766 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180768 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180771 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180773 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180776 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180778 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180781 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180783 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180786 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180788 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180791 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180794 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180796 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180798 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180802 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180805 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:01:53.423960 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180807 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180810 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180812 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180815 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180818 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180820 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180823 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180825 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180828 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180830 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180833 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180835 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180837 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180840 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180843 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180846 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180848 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180851 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:01:53.425078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.180853 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.180859 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.187725 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.187739 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.188531 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.188538 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188603 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188608 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188612 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188615 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188618 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188622 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188626 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188629 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:01:53.425952 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188632 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188635 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188638 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188641 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188644 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188647 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188650 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188653 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188656 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188659 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188662 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188665 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188667 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188670 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188672 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188675 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188677 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188680 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188684 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188689 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:01:53.426833 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188693 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188697 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188700 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188703 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188706 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188709 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188711 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188714 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188717 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188720 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188723 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188725 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188728 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188731 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188733 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188736 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188739 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188742 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188744 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188747 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:01:53.427919 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188750 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188752 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188755 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188757 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188760 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188763 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188765 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188768 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188770 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188773 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188775 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188778 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188781 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188784 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188787 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188789 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188792 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188795 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188798 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:01:53.428942 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188800 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188803 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188806 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188808 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188811 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188813 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188818 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188821 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188824 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188826 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188829 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188831 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188834 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188837 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188840 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188842 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188844 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188847 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188851 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188853 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:01:53.429823 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188856 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188858 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188862 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188865 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188868 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188870 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188873 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188875 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188879 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188881 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188884 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.188886 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.188891 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189028 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189033 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:01:53.430710 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189036 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189039 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189042 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189045 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189049 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189052 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189054 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189057 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189059 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189062 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189065 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189067 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189070 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189073 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189075 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189078 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189080 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189083 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189085 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189089 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:01:53.431592 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189092 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189094 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189097 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189099 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189102 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189104 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189112 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189114 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189117 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189119 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189122 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189124 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189127 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189130 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189132 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189135 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189139 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189141 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189144 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189146 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:01:53.432476 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189149 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189152 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189154 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189157 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189159 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189162 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189165 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189167 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189170 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189188 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189191 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189195 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189198 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189201 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189204 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189206 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189209 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189211 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189214 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189217 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:01:53.433352 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189219 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189224 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189227 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189230 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189233 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189236 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189239 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189241 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189245 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189248 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189250 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189253 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189255 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189258 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189260 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189263 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189266 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189268 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189271 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189273 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:01:53.434436 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189276 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189279 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189284 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189288 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189292 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189295 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189298 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189301 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189303 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189306 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189308 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189311 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189314 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189317 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189319 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189321 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:01:53.435306 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:53.189324 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.189329 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.189425 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.194768 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.196325 2580 server.go:1019] "Starting client certificate rotation" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.197345 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.197388 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.200225 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.201629 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.210720 2580 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.213010 2580 log.go:25] "Validated CRI v1 image API" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.213810 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:01:53.436217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.216789 2580 fs.go:135] Filesystem UUIDs: map[27c60335-f678-4338-9125-ee95cf0b0db5:/dev/nvme0n1p4 37988e12-cca0-418b-bea6-f94b96c26234:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 14:01:53.436856 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.216810 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.221656 2580 manager.go:216] Machine: {Timestamp:2026-07-07 14:01:53.220364274 +0000 UTC m=+0.346257994 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121991 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262d0a02fac0aac26d2e7630d34a7d SystemUUID:ec262d0a-02fa-c0aa-c26d-2e7630d34a7d BootID:d2a30eb4-2df1-4674-bbcc-c6674706641d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:da:5d:72:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:da:5d:72:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:ba:bb:b2:fe:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.221757 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.221823 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.223694 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.223717 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.224410 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.224419 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:01:53.437072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.224426 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.225204 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.227123 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.228471 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230726 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230838 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230863 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230873 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230891 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230901 2580 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.230909 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.231208 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.231225 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.233684 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.235899 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.235935 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237417 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237433 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237442 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237449 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237464 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237472 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237482 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237489 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237498 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237505 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237520 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.237528 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.238336 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.238343 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.241048 2580 server.go:1268] "Started kubelet" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.241602 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.259616 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.259678 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.259717 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pq4cz" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.259740 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pq4cz" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.261156 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.261426 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:01:53.439621 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.264437 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.264117 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-212.ec2.internal.18c006c91a78abf4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-212.ec2.internal,UID:ip-10-0-129-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-212.ec2.internal,},FirstTimestamp:2026-07-07 14:01:53.241025524 +0000 UTC m=+0.366919225,LastTimestamp:2026-07-07 14:01:53.241025524 +0000 UTC m=+0.366919225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-212.ec2.internal,}" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.266685 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.270238 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.270337 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.274872 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.274886 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.275139 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.275933 2580 factory.go:153] Registering CRI-O factory Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.275945 2580 factory.go:223] Registration of the crio container factory successfully Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.275991 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276002 2580 factory.go:55] Registering systemd factory Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276009 2580 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276024 2580 factory.go:103] Registering Raw factory Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276036 2580 manager.go:1196] Started watching for new ooms in manager Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276508 2580 manager.go:349] Starting recovery of all containers Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276607 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276612 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276632 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276783 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.276791 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.277342 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.280989 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-212.ec2.internal\" not found" node="ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.285980 2580 manager.go:354] Recovery completed Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.290737 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.292596 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.292625 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.292640 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293095 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293104 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293118 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293168 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.441369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293853 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293877 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.293889 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.294355 2580 policy_none.go:49] "None policy: Start" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.294366 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.294375 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.295757 2580 policy_none.go:47] "Start" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.334713 2580 manager.go:337] "Starting Device Plugin manager" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.334826 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.334835 2580 server.go:87] "Starting device plugin registration server" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.335008 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.335016 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.335122 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.335216 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.335226 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.335618 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.335657 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.435589 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.436379 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.436406 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.436417 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.436444 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.442760 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.449387 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.442775 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-212.ec2.internal\": node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.454929 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.461645 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.462816 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.462843 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.462860 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.462910 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.465192 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.555707 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.563847 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal"] Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.563917 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.564751 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.564775 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.564784 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.565973 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566121 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566859 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566877 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566887 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566924 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566944 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.566954 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.573035 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.573056 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.573819 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.573844 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.573854 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.577684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2f4341b6217a0591edf44c68d43070-config\") pod \"kube-apiserver-proxy-ip-10-0-129-212.ec2.internal\" (UID: \"3b2f4341b6217a0591edf44c68d43070\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.617370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.577703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3f87322b58f2fead0f2ab28015a4d5b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"f3f87322b58f2fead0f2ab28015a4d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.618786 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.577720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f87322b58f2fead0f2ab28015a4d5b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"f3f87322b58f2fead0f2ab28015a4d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.618786 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.592701 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-212.ec2.internal\" not found" node="ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.618786 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.598068 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-212.ec2.internal\" not found" node="ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.656201 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.678160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3f87322b58f2fead0f2ab28015a4d5b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"f3f87322b58f2fead0f2ab28015a4d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.678187 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3f87322b58f2fead0f2ab28015a4d5b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"f3f87322b58f2fead0f2ab28015a4d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.678212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f87322b58f2fead0f2ab28015a4d5b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"f3f87322b58f2fead0f2ab28015a4d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.678241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2f4341b6217a0591edf44c68d43070-config\") pod \"kube-apiserver-proxy-ip-10-0-129-212.ec2.internal\" (UID: \"3b2f4341b6217a0591edf44c68d43070\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.678289 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2f4341b6217a0591edf44c68d43070-config\") pod \"kube-apiserver-proxy-ip-10-0-129-212.ec2.internal\" (UID: \"3b2f4341b6217a0591edf44c68d43070\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.678305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f87322b58f2fead0f2ab28015a4d5b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal\" (UID: \"f3f87322b58f2fead0f2ab28015a4d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:53.829604 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.756394 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:54.006557 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.856962 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:54.006557 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.896980 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:54.006557 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:53.902597 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:54.006557 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:53.957936 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.060629 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-212.ec2.internal\" not found" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.117521 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.175162 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.186479 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.188373 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.195957 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.196069 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.196111 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.196111 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:01:54.197892 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.196125 2580 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://afb9d24a74cb74d289d186780fd46a38-1cdb722c16c16739.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.129.212:43782->52.3.204.80:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.231810 2580 apiserver.go:52] "Watching apiserver" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.249812 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.250126 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal","openshift-multus/multus-additional-cni-plugins-kjsmd","openshift-multus/network-metrics-daemon-htjnk","openshift-network-diagnostics/network-check-target-9x827","openshift-ovn-kubernetes/ovnkube-node-78b2b","kube-system/global-pull-secret-syncer-tj92w","kube-system/konnectivity-agent-tzl7w","kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kf6cx","openshift-dns/node-resolver-8x5pt","openshift-image-registry/node-ca-6pcrj","openshift-multus/multus-xllfc","openshift-network-operator/iptables-alerter-tprc2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6"] Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.251608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.253220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.255547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.255615 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.257169 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.257298 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.257749 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.257789 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ml7m9\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.257858 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.257929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xzl75\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.258370 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.258389 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.258389 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.259282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.260449 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.260497 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.261307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.261741 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.262470 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.262470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j6pg8\"" Jul 07 14:01:54.351827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.262515 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.262515 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.262494 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.262519 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.263045 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.263622 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.263826 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9cns5\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.264008 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.265036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.265150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6j849\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.265468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.265546 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.265626 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.266469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.267722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.268921 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.268935 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:56:53 +0000 UTC" deadline="2027-12-16 14:49:06.039596918 +0000 UTC" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.268974 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12648h47m11.770624629s" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.270991 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271084 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271120 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271184 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-749mg\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271382 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271439 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271441 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271485 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271511 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271513 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271755 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-97282\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271930 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9pqdk\"" Jul 07 14:01:54.353431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.271934 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cff42\"" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.272169 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.274957 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.277539 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-ovnkube-script-lib\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-run\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvttl\" (UniqueName: \"kubernetes.io/projected/0ab42e35-51b1-4ace-9b99-270d31d26195-kube-api-access-jvttl\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-cni-netd\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62cbe35-17db-4389-9b2f-8a2650dba86a-kubelet-config\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10aaf244-e17c-4006-90c5-c5d5171f193f-serviceca\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-system-cni-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-netns\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.280996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-kubelet\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6bcaa39-3502-443a-992b-5f4175862660-host-slash\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-etc-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-os-release\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.354999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-socket-dir-parent\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281076 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-cni-multus\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-hostroot\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-system-cni-dir\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e985d53-5969-42b4-b460-749971a3ade0-cni-binary-copy\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-log-socket\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12d8b273-027b-4225-9ef9-2534db843654-ovn-node-metrics-cert\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-device-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b65beddc-1d50-40e0-a4bc-6330da997c1a-konnectivity-ca\") pod \"konnectivity-agent-tzl7w\" (UID: \"b65beddc-1d50-40e0-a4bc-6330da997c1a\") " pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6ng7\" (UniqueName: \"kubernetes.io/projected/12d8b273-027b-4225-9ef9-2534db843654-kube-api-access-f6ng7\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.356289 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6bcaa39-3502-443a-992b-5f4175862660-iptables-alerter-script\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-ovn\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-node-log\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-cnibin\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-cni-bin\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtm4g\" (UniqueName: \"kubernetes.io/projected/28b1a700-8b23-43eb-8081-15b34ce694e4-kube-api-access-rtm4g\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-sys\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-cni-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-etc-kubernetes\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.357582 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281683 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-var-lib-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-socket-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-sys-fs\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281751 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6e577ee-2831-4750-8392-dac793958894-tmp-dir\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-modprobe-d\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10aaf244-e17c-4006-90c5-c5d5171f193f-host\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxt9l\" (UniqueName: \"kubernetes.io/projected/d6e577ee-2831-4750-8392-dac793958894-kube-api-access-pxt9l\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwwbt\" (UniqueName: \"kubernetes.io/projected/e6bcaa39-3502-443a-992b-5f4175862660-kube-api-access-jwwbt\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-run-ovn-kubernetes\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-env-overrides\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-tuned\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-k8s-cni-cncf-io\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b65beddc-1d50-40e0-a4bc-6330da997c1a-agent-certs\") pod \"konnectivity-agent-tzl7w\" (UID: \"b65beddc-1d50-40e0-a4bc-6330da997c1a\") " pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-run-netns\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.358911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-ovnkube-config\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.281989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-cnibin\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62cbe35-17db-4389-9b2f-8a2650dba86a-dbus\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysconfig\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-tmp\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvkg\" (UniqueName: \"kubernetes.io/projected/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-kube-api-access-ckvkg\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-conf-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-registration-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc9mh\" (UniqueName: \"kubernetes.io/projected/b0799b62-184a-4dd8-a5b8-fd5984c963b5-kube-api-access-bc9mh\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysctl-d\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysctl-conf\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-host\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-os-release\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.359814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282216 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e985d53-5969-42b4-b460-749971a3ade0-multus-daemon-config\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-var-lib-kubelet\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tt7v\" (UniqueName: \"kubernetes.io/projected/10aaf244-e17c-4006-90c5-c5d5171f193f-kube-api-access-6tt7v\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-multus-certs\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dc8x\" (UniqueName: \"kubernetes.io/projected/2e985d53-5969-42b4-b460-749971a3ade0-kube-api-access-7dc8x\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6e577ee-2831-4750-8392-dac793958894-hosts-file\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-kubelet\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-slash\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-cni-bin\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-kubernetes\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-systemd\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-lib-modules\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.360937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.361858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.282956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-systemd-units\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.361858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.283040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-systemd\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.361858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.288379 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:01:54.361858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.305964 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w849q" Jul 07 14:01:54.361858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.314291 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w849q" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12d8b273-027b-4225-9ef9-2534db843654-ovn-node-metrics-cert\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-device-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384289 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b65beddc-1d50-40e0-a4bc-6330da997c1a-konnectivity-ca\") pod \"konnectivity-agent-tzl7w\" (UID: \"b65beddc-1d50-40e0-a4bc-6330da997c1a\") " pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6ng7\" (UniqueName: \"kubernetes.io/projected/12d8b273-027b-4225-9ef9-2534db843654-kube-api-access-f6ng7\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384354 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-device-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6bcaa39-3502-443a-992b-5f4175862660-iptables-alerter-script\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-ovn\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-node-log\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-cnibin\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-cni-bin\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.501554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-node-log\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtm4g\" (UniqueName: \"kubernetes.io/projected/28b1a700-8b23-43eb-8081-15b34ce694e4-kube-api-access-rtm4g\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384689 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-ovn\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384767 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-sys\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-cni-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.384819 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-etc-kubernetes\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-var-lib-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.384872 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:01:54.884856921 +0000 UTC m=+2.010750609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-socket-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-cnibin\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-sys-fs\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.502519 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.384933 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384941 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-sys-fs\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384924 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b65beddc-1d50-40e0-a4bc-6330da997c1a-konnectivity-ca\") pod \"konnectivity-agent-tzl7w\" (UID: \"b65beddc-1d50-40e0-a4bc-6330da997c1a\") " pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384652 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6e577ee-2831-4750-8392-dac793958894-tmp-dir\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384763 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.384983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-modprobe-d\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10aaf244-e17c-4006-90c5-c5d5171f193f-host\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385027 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-sys\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6bcaa39-3502-443a-992b-5f4175862660-iptables-alerter-script\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385057 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-socket-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385066 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-cni-bin\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.385071 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:01:54.885054567 +0000 UTC m=+2.010948263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:54.503528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-etc-kubernetes\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9l\" (UniqueName: \"kubernetes.io/projected/d6e577ee-2831-4750-8392-dac793958894-kube-api-access-pxt9l\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwwbt\" (UniqueName: \"kubernetes.io/projected/e6bcaa39-3502-443a-992b-5f4175862660-kube-api-access-jwwbt\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10aaf244-e17c-4006-90c5-c5d5171f193f-host\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-run-ovn-kubernetes\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-env-overrides\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-var-lib-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-modprobe-d\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-tuned\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-k8s-cni-cncf-io\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385198 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-run-ovn-kubernetes\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b65beddc-1d50-40e0-a4bc-6330da997c1a-agent-certs\") pod \"konnectivity-agent-tzl7w\" (UID: \"b65beddc-1d50-40e0-a4bc-6330da997c1a\") " pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385237 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-cni-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-run-netns\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-ovnkube-config\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.504499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-run-netns\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385406 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-k8s-cni-cncf-io\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385485 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6e577ee-2831-4750-8392-dac793958894-tmp-dir\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-cnibin\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62cbe35-17db-4389-9b2f-8a2650dba86a-dbus\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysconfig\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-tmp\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvkg\" (UniqueName: \"kubernetes.io/projected/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-kube-api-access-ckvkg\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-conf-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-registration-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc9mh\" (UniqueName: \"kubernetes.io/projected/b0799b62-184a-4dd8-a5b8-fd5984c963b5-kube-api-access-bc9mh\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-env-overrides\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysctl-d\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysctl-conf\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.505447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-host\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-os-release\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e985d53-5969-42b4-b460-749971a3ade0-multus-daemon-config\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-var-lib-kubelet\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tt7v\" (UniqueName: \"kubernetes.io/projected/10aaf244-e17c-4006-90c5-c5d5171f193f-kube-api-access-6tt7v\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385858 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-ovnkube-config\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-multus-certs\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dc8x\" (UniqueName: \"kubernetes.io/projected/2e985d53-5969-42b4-b460-749971a3ade0-kube-api-access-7dc8x\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385942 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6e577ee-2831-4750-8392-dac793958894-hosts-file\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysconfig\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-kubelet\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386007 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-cnibin\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.506411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-slash\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386077 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-conf-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386090 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-slash\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-cni-bin\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-kubernetes\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386142 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-var-lib-kubelet\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-systemd\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-lib-modules\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386187 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-systemd-units\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386280 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6e577ee-2831-4750-8392-dac793958894-hosts-file\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-systemd\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386325 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-kubelet\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.507567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-ovnkube-script-lib\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-run\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386388 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-multus-certs\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386388 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0799b62-184a-4dd8-a5b8-fd5984c963b5-registration-dir\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvttl\" (UniqueName: \"kubernetes.io/projected/0ab42e35-51b1-4ace-9b99-270d31d26195-kube-api-access-jvttl\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-cni-netd\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62cbe35-17db-4389-9b2f-8a2650dba86a-kubelet-config\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10aaf244-e17c-4006-90c5-c5d5171f193f-serviceca\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-system-cni-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-netns\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-kubelet\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6bcaa39-3502-443a-992b-5f4175862660-host-slash\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386654 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-kubernetes\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-etc-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-os-release\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.510965 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-systemd\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-socket-dir-parent\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-cni-multus\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysctl-d\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-hostroot\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386811 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-lib-modules\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-sysctl-conf\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386930 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-host\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.386990 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-os-release\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.387038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-run-systemd\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.385960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62cbe35-17db-4389-9b2f-8a2650dba86a-dbus\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.387084 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-systemd-units\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.387121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-run-netns\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.388513 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-tmp\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.388587 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62cbe35-17db-4389-9b2f-8a2650dba86a-kubelet-config\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.511897 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.388737 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b65beddc-1d50-40e0-a4bc-6330da997c1a-agent-certs\") pod \"konnectivity-agent-tzl7w\" (UID: \"b65beddc-1d50-40e0-a4bc-6330da997c1a\") " pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.388809 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-cni-bin\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389248 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12d8b273-027b-4225-9ef9-2534db843654-ovnkube-script-lib\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389358 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12d8b273-027b-4225-9ef9-2534db843654-ovn-node-metrics-cert\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-etc-openvswitch\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389445 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-kubelet\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389474 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6bcaa39-3502-443a-992b-5f4175862660-host-slash\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-system-cni-dir\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389549 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-multus-socket-dir-parent\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389560 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10aaf244-e17c-4006-90c5-c5d5171f193f-serviceca\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-host-var-lib-cni-multus\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389619 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-os-release\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389630 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-run\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.389740 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e985d53-5969-42b4-b460-749971a3ade0-hostroot\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.390583 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-etc-tuned\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.512814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.388621 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-host-cni-netd\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-system-cni-dir\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e985d53-5969-42b4-b460-749971a3ade0-cni-binary-copy\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393404 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-log-socket\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393447 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ab42e35-51b1-4ace-9b99-270d31d26195-system-cni-dir\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393618 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12d8b273-027b-4225-9ef9-2534db843654-log-socket\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393651 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e985d53-5969-42b4-b460-749971a3ade0-multus-daemon-config\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393857 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ab42e35-51b1-4ace-9b99-270d31d26195-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.393897 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e985d53-5969-42b4-b460-749971a3ade0-cni-binary-copy\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.395883 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6ng7\" (UniqueName: \"kubernetes.io/projected/12d8b273-027b-4225-9ef9-2534db843654-kube-api-access-f6ng7\") pod \"ovnkube-node-78b2b\" (UID: \"12d8b273-027b-4225-9ef9-2534db843654\") " pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.397324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxt9l\" (UniqueName: \"kubernetes.io/projected/d6e577ee-2831-4750-8392-dac793958894-kube-api-access-pxt9l\") pod \"node-resolver-8x5pt\" (UID: \"d6e577ee-2831-4750-8392-dac793958894\") " pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.514156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.398010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwwbt\" (UniqueName: \"kubernetes.io/projected/e6bcaa39-3502-443a-992b-5f4175862660-kube-api-access-jwwbt\") pod \"iptables-alerter-tprc2\" (UID: \"e6bcaa39-3502-443a-992b-5f4175862660\") " pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.398308 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc9mh\" (UniqueName: \"kubernetes.io/projected/b0799b62-184a-4dd8-a5b8-fd5984c963b5-kube-api-access-bc9mh\") pod \"aws-ebs-csi-driver-node-cmrt6\" (UID: \"b0799b62-184a-4dd8-a5b8-fd5984c963b5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.398524 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dc8x\" (UniqueName: \"kubernetes.io/projected/2e985d53-5969-42b4-b460-749971a3ade0-kube-api-access-7dc8x\") pod \"multus-xllfc\" (UID: \"2e985d53-5969-42b4-b460-749971a3ade0\") " pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.398888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvkg\" (UniqueName: \"kubernetes.io/projected/cb83a4eb-0c34-440c-bbb8-106cd6e951a9-kube-api-access-ckvkg\") pod \"tuned-kf6cx\" (UID: \"cb83a4eb-0c34-440c-bbb8-106cd6e951a9\") " pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.398933 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.398946 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.398956 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.399011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tt7v\" (UniqueName: \"kubernetes.io/projected/10aaf244-e17c-4006-90c5-c5d5171f193f-kube-api-access-6tt7v\") pod \"node-ca-6pcrj\" (UID: \"10aaf244-e17c-4006-90c5-c5d5171f193f\") " pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.399062 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:01:54.899036855 +0000 UTC m=+2.024930544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.399546 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtm4g\" (UniqueName: \"kubernetes.io/projected/28b1a700-8b23-43eb-8081-15b34ce694e4-kube-api-access-rtm4g\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.399634 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvttl\" (UniqueName: \"kubernetes.io/projected/0ab42e35-51b1-4ace-9b99-270d31d26195-kube-api-access-jvttl\") pod \"multus-additional-cni-plugins-kjsmd\" (UID: \"0ab42e35-51b1-4ace-9b99-270d31d26195\") " pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.413643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.418908 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.438058 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8x5pt" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.453844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6pcrj" Jul 07 14:01:54.515070 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.459587 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xllfc" Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.538966 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f87322b58f2fead0f2ab28015a4d5b.slice/crio-0ae30964bc7620a02d1406c2c23ecf949b258610cfa2326e9f9b3d208b12e31c WatchSource:0}: Error finding container 0ae30964bc7620a02d1406c2c23ecf949b258610cfa2326e9f9b3d208b12e31c: Status 404 returned error can't find the container with id 0ae30964bc7620a02d1406c2c23ecf949b258610cfa2326e9f9b3d208b12e31c Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.539361 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2f4341b6217a0591edf44c68d43070.slice/crio-4a3400dfd770b89e7861db9e9ac2d8b70aabfce173771ebc4f0f660b2d1bd43e WatchSource:0}: Error finding container 4a3400dfd770b89e7861db9e9ac2d8b70aabfce173771ebc4f0f660b2d1bd43e: Status 404 returned error can't find the container with id 4a3400dfd770b89e7861db9e9ac2d8b70aabfce173771ebc4f0f660b2d1bd43e Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.543648 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.594025 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.601568 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65beddc_1d50_40e0_a4bc_6330da997c1a.slice/crio-7f40b3ab953e6ec9345a126d8574bfb376f6a6aa3d08e1b08466e2454445bc79 WatchSource:0}: Error finding container 7f40b3ab953e6ec9345a126d8574bfb376f6a6aa3d08e1b08466e2454445bc79: Status 404 returned error can't find the container with id 7f40b3ab953e6ec9345a126d8574bfb376f6a6aa3d08e1b08466e2454445bc79 Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.626265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tprc2" Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.635622 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bcaa39_3502_443a_992b_5f4175862660.slice/crio-4842d9fde728039d7f0cd6a2250eefb76f1910f042e39c9f484185b68f700859 WatchSource:0}: Error finding container 4842d9fde728039d7f0cd6a2250eefb76f1910f042e39c9f484185b68f700859: Status 404 returned error can't find the container with id 4842d9fde728039d7f0cd6a2250eefb76f1910f042e39c9f484185b68f700859 Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.645126 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:01:54.663650 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.652288 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d8b273_027b_4225_9ef9_2534db843654.slice/crio-670e168c0f687fa664387edad418b079756d26e772f9f7fc7e1feb0c744b1270 WatchSource:0}: Error finding container 670e168c0f687fa664387edad418b079756d26e772f9f7fc7e1feb0c744b1270: Status 404 returned error can't find the container with id 670e168c0f687fa664387edad418b079756d26e772f9f7fc7e1feb0c744b1270 Jul 07 14:01:54.682922 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.681203 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" Jul 07 14:01:54.793516 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.687970 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb83a4eb_0c34_440c_bbb8_106cd6e951a9.slice/crio-09436ba7baf4fca79acdc66c490cfa3d892bb2b4ce95a949f51cd05fb9c346bf WatchSource:0}: Error finding container 09436ba7baf4fca79acdc66c490cfa3d892bb2b4ce95a949f51cd05fb9c346bf: Status 404 returned error can't find the container with id 09436ba7baf4fca79acdc66c490cfa3d892bb2b4ce95a949f51cd05fb9c346bf Jul 07 14:01:54.793516 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.775371 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0799b62_184a_4dd8_a5b8_fd5984c963b5.slice/crio-583b545dd11b3db3076e45789a5ecf6e5f47c73b73f465eb3b3aa40fc54db61f WatchSource:0}: Error finding container 583b545dd11b3db3076e45789a5ecf6e5f47c73b73f465eb3b3aa40fc54db61f: Status 404 returned error can't find the container with id 583b545dd11b3db3076e45789a5ecf6e5f47c73b73f465eb3b3aa40fc54db61f Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.800685 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e577ee_2831_4750_8392_dac793958894.slice/crio-7c228a5a6ae24adaaa25fd80786e5e3f882d8c8e084a9bc25c7dea02d8f9b7f1 WatchSource:0}: Error finding container 7c228a5a6ae24adaaa25fd80786e5e3f882d8c8e084a9bc25c7dea02d8f9b7f1: Status 404 returned error can't find the container with id 7c228a5a6ae24adaaa25fd80786e5e3f882d8c8e084a9bc25c7dea02d8f9b7f1 Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.824136 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.877769 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab42e35_51b1_4ace_9b99_270d31d26195.slice/crio-5d3fee640484613218a8453b3599e61fae48ef2c6f4d63896816c5a709052b56 WatchSource:0}: Error finding container 5d3fee640484613218a8453b3599e61fae48ef2c6f4d63896816c5a709052b56: Status 404 returned error can't find the container with id 5d3fee640484613218a8453b3599e61fae48ef2c6f4d63896816c5a709052b56 Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.897483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.897506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.897602 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.897626 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.897650 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:01:55.897637851 +0000 UTC m=+3.023531539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.897670 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:01:55.897658129 +0000 UTC m=+3.023551817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:54.933726 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:01:54.901137 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e985d53_5969_42b4_b460_749971a3ade0.slice/crio-bbbbe7a883802d60fbcae960dc3bd87dac78665fb18d05ae38cfb4ff40bdabbc WatchSource:0}: Error finding container bbbbe7a883802d60fbcae960dc3bd87dac78665fb18d05ae38cfb4ff40bdabbc: Status 404 returned error can't find the container with id bbbbe7a883802d60fbcae960dc3bd87dac78665fb18d05ae38cfb4ff40bdabbc Jul 07 14:01:55.077054 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:54.998630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:55.077054 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.998775 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:01:55.077054 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.998796 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:01:55.077054 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.998808 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:55.077054 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:54.998854 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:01:55.998842305 +0000 UTC m=+3.124735992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:55.233599 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.233572 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:55.249198 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.249160 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:55.316914 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.316879 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:56:54 +0000 UTC" deadline="2028-03-17 13:28:13.990288746 +0000 UTC" Jul 07 14:01:55.316914 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.316914 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14855h26m18.673378334s" Jul 07 14:01:55.464683 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.464295 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:55.464683 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:55.464422 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:01:55.464683 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.464302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:55.464683 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:55.464559 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:01:55.485943 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.485890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xllfc" event={"ID":"2e985d53-5969-42b4-b460-749971a3ade0","Type":"ContainerStarted","Data":"bbbbe7a883802d60fbcae960dc3bd87dac78665fb18d05ae38cfb4ff40bdabbc"} Jul 07 14:01:55.490823 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.490766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" event={"ID":"cb83a4eb-0c34-440c-bbb8-106cd6e951a9","Type":"ContainerStarted","Data":"09436ba7baf4fca79acdc66c490cfa3d892bb2b4ce95a949f51cd05fb9c346bf"} Jul 07 14:01:55.492942 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.492839 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"670e168c0f687fa664387edad418b079756d26e772f9f7fc7e1feb0c744b1270"} Jul 07 14:01:55.496489 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.496439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tprc2" event={"ID":"e6bcaa39-3502-443a-992b-5f4175862660","Type":"ContainerStarted","Data":"4842d9fde728039d7f0cd6a2250eefb76f1910f042e39c9f484185b68f700859"} Jul 07 14:01:55.499706 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.499674 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" event={"ID":"3b2f4341b6217a0591edf44c68d43070","Type":"ContainerStarted","Data":"4a3400dfd770b89e7861db9e9ac2d8b70aabfce173771ebc4f0f660b2d1bd43e"} Jul 07 14:01:55.502024 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.501986 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerStarted","Data":"5d3fee640484613218a8453b3599e61fae48ef2c6f4d63896816c5a709052b56"} Jul 07 14:01:55.504830 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.504805 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8x5pt" event={"ID":"d6e577ee-2831-4750-8392-dac793958894","Type":"ContainerStarted","Data":"7c228a5a6ae24adaaa25fd80786e5e3f882d8c8e084a9bc25c7dea02d8f9b7f1"} Jul 07 14:01:55.508452 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.508425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" event={"ID":"b0799b62-184a-4dd8-a5b8-fd5984c963b5","Type":"ContainerStarted","Data":"583b545dd11b3db3076e45789a5ecf6e5f47c73b73f465eb3b3aa40fc54db61f"} Jul 07 14:01:55.512862 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.512837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzl7w" event={"ID":"b65beddc-1d50-40e0-a4bc-6330da997c1a","Type":"ContainerStarted","Data":"7f40b3ab953e6ec9345a126d8574bfb376f6a6aa3d08e1b08466e2454445bc79"} Jul 07 14:01:55.518425 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.518402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" event={"ID":"f3f87322b58f2fead0f2ab28015a4d5b","Type":"ContainerStarted","Data":"0ae30964bc7620a02d1406c2c23ecf949b258610cfa2326e9f9b3d208b12e31c"} Jul 07 14:01:55.907319 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.906584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:55.907319 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:55.906631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:55.907319 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:55.906758 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:55.907319 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:55.906814 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:01:57.906796877 +0000 UTC m=+5.032690568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:55.907319 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:55.907205 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:55.907319 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:55.907267 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:01:57.907239949 +0000 UTC m=+5.033133646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:56.007918 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:56.007304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:56.007918 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:56.007503 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:01:56.007918 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:56.007524 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:01:56.007918 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:56.007537 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:56.007918 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:56.007592 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:01:58.007574863 +0000 UTC m=+5.133468552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:56.317827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:56.317687 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:56:54 +0000 UTC" deadline="2028-01-16 22:11:04.865892776 +0000 UTC" Jul 07 14:01:56.317827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:56.317775 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13400h9m8.548122299s" Jul 07 14:01:56.464402 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:56.463910 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:56.464402 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:56.464028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:01:57.043607 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:57.043185 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:01:57.464349 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:57.464274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:57.464513 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:57.464403 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:01:57.464513 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:57.464452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:57.464644 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:57.464559 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:01:57.926163 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:57.926090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:57.926337 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:57.926197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:57.926409 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:57.926363 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:57.926461 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:57.926428 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:02:01.926408891 +0000 UTC m=+9.052302598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:01:57.926839 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:57.926822 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:57.926936 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:57.926869 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:01.926855028 +0000 UTC m=+9.052748729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:01:58.027240 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:58.027209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:58.027400 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:58.027361 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:01:58.027400 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:58.027385 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:01:58.027400 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:58.027399 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:58.027560 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:58.027463 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:02:02.027444883 +0000 UTC m=+9.153338574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:01:58.463107 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:58.463063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:01:58.463590 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:58.463211 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:01:59.463165 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:59.463128 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:01:59.463165 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:01:59.463188 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:01:59.463696 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:59.463308 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:01:59.463696 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:01:59.463420 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:00.463232 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:00.463199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:00.463706 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:00.463355 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:01.463639 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:01.463609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:01.464001 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:01.463609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:01.464001 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:01.463743 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:01.464001 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:01.463785 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:01.956992 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:01.956956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:01.957205 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:01.957006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:01.957205 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:01.957126 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:02:01.957205 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:01.957150 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:02:01.957351 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:01.957218 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:09.957196008 +0000 UTC m=+17.083089715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:02:01.957351 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:01.957239 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:02:09.95722858 +0000 UTC m=+17.083122272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:02:02.058805 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:02.058297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:02.058805 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:02.058525 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:02:02.058805 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:02.058549 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:02:02.058805 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:02.058561 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:02:02.058805 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:02.058616 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:02:10.058597528 +0000 UTC m=+17.184491233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:02:02.463026 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:02.462998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:02.463220 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:02.463123 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:03.465373 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:03.464708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:03.465373 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:03.464829 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:03.465373 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:03.465238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:03.465373 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:03.465331 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:04.463374 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:04.463341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:04.463498 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:04.463477 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:05.463362 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:05.463332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:05.463946 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:05.463511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:05.464084 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:05.463488 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:05.466489 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:05.464212 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:06.463617 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:06.463582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:06.464006 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:06.463687 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:07.463874 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:07.463842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:07.463874 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:07.463862 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:07.464358 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:07.463974 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:07.464358 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:07.464070 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:08.463672 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:08.463644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:08.463820 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:08.463754 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:09.463270 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:09.463227 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:09.463702 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:09.463232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:09.463702 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:09.463359 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:09.463702 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:09.463437 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:10.019619 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:10.018346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:10.019619 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:10.018404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:10.019619 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.018552 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:02:10.019619 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.018673 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:02:26.018646714 +0000 UTC m=+33.144540409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:02:10.019619 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.019138 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:02:10.019619 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.019215 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:26.019196698 +0000 UTC m=+33.145090399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:02:10.119017 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:10.118985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:10.119167 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.119150 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:02:10.119228 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.119185 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:02:10.119228 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.119200 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:02:10.119342 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.119288 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:02:26.119271875 +0000 UTC m=+33.245165564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:02:10.463391 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:10.463320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:10.463755 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:10.463434 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:11.464021 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:11.463819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:11.464501 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:11.463819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:11.464501 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:11.464139 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:11.464501 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:11.464241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:12.463347 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:12.463315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:12.463502 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:12.463427 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:13.456188 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:13.456133 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10aaf244_e17c_4006_90c5_c5d5171f193f.slice/crio-7465e69fc06324c9c99646d8c70f5a24ee40a0f2705add20286bc04a519ef8b0 WatchSource:0}: Error finding container 7465e69fc06324c9c99646d8c70f5a24ee40a0f2705add20286bc04a519ef8b0: Status 404 returned error can't find the container with id 7465e69fc06324c9c99646d8c70f5a24ee40a0f2705add20286bc04a519ef8b0 Jul 07 14:02:13.464154 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:13.464133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:13.464270 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:13.464250 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:13.464342 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:13.464298 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:13.464394 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:13.464347 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:13.556377 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:13.556352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6pcrj" event={"ID":"10aaf244-e17c-4006-90c5-c5d5171f193f","Type":"ContainerStarted","Data":"7465e69fc06324c9c99646d8c70f5a24ee40a0f2705add20286bc04a519ef8b0"} Jul 07 14:02:14.463569 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.463392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:14.464292 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:14.463666 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:14.562069 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.562037 2580 generic.go:356] "Generic (PLEG): container finished" podID="f3f87322b58f2fead0f2ab28015a4d5b" containerID="1e3998c028687ded5b50b7c06bfd85cd115ace699c3aee0d58e64f96d6cfbee8" exitCode=0 Jul 07 14:02:14.562209 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.562127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" event={"ID":"f3f87322b58f2fead0f2ab28015a4d5b","Type":"ContainerDied","Data":"1e3998c028687ded5b50b7c06bfd85cd115ace699c3aee0d58e64f96d6cfbee8"} Jul 07 14:02:14.564206 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.563988 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xllfc" event={"ID":"2e985d53-5969-42b4-b460-749971a3ade0","Type":"ContainerStarted","Data":"f90865739cc0799b82605e3ba3822674ef442b590ef06b87c761892ffb41fee9"} Jul 07 14:02:14.565647 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.565619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" event={"ID":"cb83a4eb-0c34-440c-bbb8-106cd6e951a9","Type":"ContainerStarted","Data":"d1a1ae96705988853670e2413a409d27bb4c80604f560facf10af1665bdd7144"} Jul 07 14:02:14.568814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.568788 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:02:14.569251 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569229 2580 generic.go:356] "Generic (PLEG): container finished" podID="12d8b273-027b-4225-9ef9-2534db843654" containerID="387f6e1e27d2e2f4e06f72d2a84d05f795d79e9b5be7a40d021485f7bd6378f7" exitCode=1 Jul 07 14:02:14.569343 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"df17e322a1f9c9d2f41d82c0c00a45f3bc5dd435ac647b0c7a01d9a64b5f4510"} Jul 07 14:02:14.569409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"eec74f7344664b92907824c56bd5c1e781525f4e0735dd3712444edb2a7f9231"} Jul 07 14:02:14.569409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569396 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"f8b0f0fff2edbf6fc5d41b3606a88ef06319b95154ff252250b36375b27f3c81"} Jul 07 14:02:14.569502 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"fac83b9d5d81af3fc604f46b58d512e737b0b57af4c05651ad06cf52b89d8be6"} Jul 07 14:02:14.569502 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerDied","Data":"387f6e1e27d2e2f4e06f72d2a84d05f795d79e9b5be7a40d021485f7bd6378f7"} Jul 07 14:02:14.569567 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.569531 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"77a175909bc91d38c9f90eef900962b4cb54152a71e3b3240a5035d182530ab6"} Jul 07 14:02:14.570854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.570832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" event={"ID":"3b2f4341b6217a0591edf44c68d43070","Type":"ContainerStarted","Data":"95504ac8280ae6c901986dc8d2e71d01393a4955b45b932f6777bf28d0911142"} Jul 07 14:02:14.572509 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.572489 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab42e35-51b1-4ace-9b99-270d31d26195" containerID="c092b176e29816d05805f5e4f2550aa41f37e29966560638b2fe6b0aab6157eb" exitCode=0 Jul 07 14:02:14.572587 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.572553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerDied","Data":"c092b176e29816d05805f5e4f2550aa41f37e29966560638b2fe6b0aab6157eb"} Jul 07 14:02:14.574297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.574278 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8x5pt" event={"ID":"d6e577ee-2831-4750-8392-dac793958894","Type":"ContainerStarted","Data":"fe1e905694c5ae2320b4b7cf436914bb37faeea8eb6280aad967ee4c42ebe3c0"} Jul 07 14:02:14.576105 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.576077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" event={"ID":"b0799b62-184a-4dd8-a5b8-fd5984c963b5","Type":"ContainerStarted","Data":"5013fa986e7dd28ef2973d4792a9c634d055adf5b3df0181ad63bd0fa9183a65"} Jul 07 14:02:14.577999 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.577978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzl7w" event={"ID":"b65beddc-1d50-40e0-a4bc-6330da997c1a","Type":"ContainerStarted","Data":"d669e8916fd053942b642daf7cc99b408d56bdcf73b7c38af905e53f36e6bf2f"} Jul 07 14:02:14.593919 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.593877 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8x5pt" podStartSLOduration=3.505100604 podStartE2EDuration="21.593862842s" totalImagesPullingTime="18.088762238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:14.592557823 +0000 UTC m=+21.718451552" watchObservedRunningTime="2026-07-07 14:02:14.593862842 +0000 UTC m=+21.719756553" Jul 07 14:02:14.616118 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.616075 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xllfc" podStartSLOduration=2.8792501919999998 podStartE2EDuration="21.616057135s" totalImagesPullingTime="18.736806943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:14.615417418 +0000 UTC m=+21.741311129" watchObservedRunningTime="2026-07-07 14:02:14.616057135 +0000 UTC m=+21.741950847" Jul 07 14:02:14.628518 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.628482 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-212.ec2.internal" podStartSLOduration=20.628472021 podStartE2EDuration="20.628472021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:14.628221634 +0000 UTC m=+21.754115371" watchObservedRunningTime="2026-07-07 14:02:14.628472021 +0000 UTC m=+21.754365730" Jul 07 14:02:14.645323 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.645280 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kf6cx" podStartSLOduration=3.444061949 podStartE2EDuration="21.645266325s" totalImagesPullingTime="18.201204376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:14.645257489 +0000 UTC m=+21.771151220" watchObservedRunningTime="2026-07-07 14:02:14.645266325 +0000 UTC m=+21.771160034" Jul 07 14:02:14.693385 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:14.693300 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tzl7w" podStartSLOduration=3.405494997 podStartE2EDuration="21.693285453s" totalImagesPullingTime="18.287790456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:14.693075681 +0000 UTC m=+21.818969409" watchObservedRunningTime="2026-07-07 14:02:14.693285453 +0000 UTC m=+21.819179162" Jul 07 14:02:15.052269 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.052236 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:02:15.052957 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.052932 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:02:15.463473 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.463443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:15.463619 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:15.463589 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:15.463962 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.463642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:15.463962 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:15.463746 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:15.580820 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.580789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tprc2" event={"ID":"e6bcaa39-3502-443a-992b-5f4175862660","Type":"ContainerStarted","Data":"1d9153fd468f349b69103dad0b14c0a18a2a7e4b98707f9b5102ca1c7cc503ea"} Jul 07 14:02:15.582413 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.582388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" event={"ID":"f3f87322b58f2fead0f2ab28015a4d5b","Type":"ContainerStarted","Data":"fcb16d736518132bd1210a94325c0e62067e8092fdb6699fadf50bd6631dc339"} Jul 07 14:02:15.583766 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.583745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6pcrj" event={"ID":"10aaf244-e17c-4006-90c5-c5d5171f193f","Type":"ContainerStarted","Data":"c008240e62c3dc9cdc4d6625e19d0a651139815179e9799cee6f930f83516730"} Jul 07 14:02:15.584484 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.584465 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:02:15.584869 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.584854 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tzl7w" Jul 07 14:02:15.617984 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.617947 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tprc2" podStartSLOduration=3.82896035 podStartE2EDuration="22.617934826s" totalImagesPullingTime="18.788974476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:15.596433015 +0000 UTC m=+22.722326725" watchObservedRunningTime="2026-07-07 14:02:15.617934826 +0000 UTC m=+22.743828535" Jul 07 14:02:15.631787 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.631753 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6pcrj" podStartSLOduration=20.625532128 podStartE2EDuration="22.631737824s" totalImagesPullingTime="2.006205696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:15.617900898 +0000 UTC m=+22.743794608" watchObservedRunningTime="2026-07-07 14:02:15.631737824 +0000 UTC m=+22.757631534" Jul 07 14:02:15.632017 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:15.631992 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-212.ec2.internal" podStartSLOduration=21.631983832 podStartE2EDuration="21.631983832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:15.631696885 +0000 UTC m=+22.757590596" watchObservedRunningTime="2026-07-07 14:02:15.631983832 +0000 UTC m=+22.757877541" Jul 07 14:02:16.416684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:16.416663 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:02:16.463213 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:16.463194 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:16.463308 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:16.463287 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:16.587075 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:16.587021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" event={"ID":"b0799b62-184a-4dd8-a5b8-fd5984c963b5","Type":"ContainerStarted","Data":"5771f930c74675edbe65b1e1953bee67f74fdfc4e4515cecea73e9ba26af9971"} Jul 07 14:02:16.589846 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:16.589831 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:02:16.590187 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:16.590152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"cc64a4fa8db0bff06348d1b8892c60557f8ad9a41c7353f53236f02255e8894b"} Jul 07 14:02:17.348033 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.347945 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:02:16.41667961Z","UUID":"2ff41058-3a07-4594-8273-f66f68fe6758","Handler":null,"Name":"","Endpoint":""} Jul 07 14:02:17.349977 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.349956 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:02:17.350103 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.349999 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:02:17.463516 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.463488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:17.463516 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.463500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:17.463649 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:17.463598 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:17.463710 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:17.463651 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:17.595020 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.594955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" event={"ID":"b0799b62-184a-4dd8-a5b8-fd5984c963b5","Type":"ContainerStarted","Data":"4ab745d2583589c9d803e4ad794569d723c5ad5842c3837dec5aecbe8dc927ed"} Jul 07 14:02:17.612252 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:17.612210 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmrt6" podStartSLOduration=3.282099849 podStartE2EDuration="24.61219868s" totalImagesPullingTime="21.330098831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:17.61212512 +0000 UTC m=+24.738018829" watchObservedRunningTime="2026-07-07 14:02:17.61219868 +0000 UTC m=+24.738092387" Jul 07 14:02:18.463753 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:18.463543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:18.464008 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:18.463803 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:18.599828 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:18.599802 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:02:18.600606 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:18.600216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"46bdf8ea97ca733b941e7c3c1144846c5ad6dacbc3e37afa269f5e5a7b171657"} Jul 07 14:02:18.600753 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:18.600719 2580 scope.go:117] "RemoveContainer" containerID="387f6e1e27d2e2f4e06f72d2a84d05f795d79e9b5be7a40d021485f7bd6378f7" Jul 07 14:02:19.463286 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.463243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:19.463466 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.463243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:19.463466 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:19.463389 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:19.463466 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:19.463444 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:19.607253 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.607221 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:02:19.607748 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.607726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" event={"ID":"12d8b273-027b-4225-9ef9-2534db843654","Type":"ContainerStarted","Data":"7025f46692d85dd34078eea875002419456bb477e570d698cd03db3e55e36c6c"} Jul 07 14:02:19.608121 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.608101 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:02:19.608246 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.608152 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:02:19.608246 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.608203 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:02:19.628209 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.628187 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:02:19.628345 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.628315 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:02:19.638299 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:19.638260 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" podStartSLOduration=7.86683984 podStartE2EDuration="26.638248206s" totalImagesPullingTime="18.771408366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:19.636265858 +0000 UTC m=+26.762159583" watchObservedRunningTime="2026-07-07 14:02:19.638248206 +0000 UTC m=+26.764141914" Jul 07 14:02:20.102218 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:20.101988 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tj92w"] Jul 07 14:02:20.102383 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:20.102325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:20.102445 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:20.102427 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:20.107004 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:20.106978 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9x827"] Jul 07 14:02:20.107190 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:20.107030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-htjnk"] Jul 07 14:02:20.107190 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:20.107109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:20.107324 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:20.107247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:20.107324 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:20.107261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:20.107427 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:20.107366 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:21.463906 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:21.463864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:21.463906 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:21.463892 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:21.464442 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:21.463864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:21.464442 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:21.463967 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:21.464442 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:21.464046 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:21.464442 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:21.464114 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:22.616223 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:22.616193 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab42e35-51b1-4ace-9b99-270d31d26195" containerID="897fc0c8ad1759dde509e9abe71374ca4e35bc5acba2f7c3f417a05aef70cdcb" exitCode=0 Jul 07 14:02:22.616703 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:22.616262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerDied","Data":"897fc0c8ad1759dde509e9abe71374ca4e35bc5acba2f7c3f417a05aef70cdcb"} Jul 07 14:02:23.464449 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:23.464415 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:23.464604 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:23.464485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:23.464604 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:23.464574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:23.464750 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:23.464654 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:23.464750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:23.464697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:23.464858 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:23.464752 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:25.463922 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:25.463901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:25.463922 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:25.463911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:25.463922 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:25.463919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:25.464421 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:25.463992 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x827" podUID="219fad73-e0b3-4a16-a4a5-9983e7d3b5ce" Jul 07 14:02:25.464421 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:25.464045 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj92w" podUID="d62cbe35-17db-4389-9b2f-8a2650dba86a" Jul 07 14:02:25.464421 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:25.464103 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-htjnk" podUID="28b1a700-8b23-43eb-8081-15b34ce694e4" Jul 07 14:02:25.623387 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:25.623211 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab42e35-51b1-4ace-9b99-270d31d26195" containerID="6de0340b9501fdbe9472df01f085a8d6f66ded85b97b29eb47274240aceefa67" exitCode=0 Jul 07 14:02:25.623511 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:25.623247 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerDied","Data":"6de0340b9501fdbe9472df01f085a8d6f66ded85b97b29eb47274240aceefa67"} Jul 07 14:02:26.041246 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.041216 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:26.041246 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.041250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:26.041457 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.041349 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:02:26.041457 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.041365 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:02:26.041457 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.041398 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret podName:d62cbe35-17db-4389-9b2f-8a2650dba86a nodeName:}" failed. No retries permitted until 2026-07-07 14:02:58.041380556 +0000 UTC m=+65.167274248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret") pod "global-pull-secret-syncer-tj92w" (UID: "d62cbe35-17db-4389-9b2f-8a2650dba86a") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:02:26.041457 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.041423 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs podName:28b1a700-8b23-43eb-8081-15b34ce694e4 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:58.041404312 +0000 UTC m=+65.167298004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs") pod "network-metrics-daemon-htjnk" (UID: "28b1a700-8b23-43eb-8081-15b34ce694e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:02:26.141989 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.141961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:26.142098 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.142086 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:02:26.142137 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.142105 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:02:26.142137 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.142113 2580 projected.go:196] Error preparing data for projected volume kube-api-access-phr4m for pod openshift-network-diagnostics/network-check-target-9x827: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:02:26.142216 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.142157 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m podName:219fad73-e0b3-4a16-a4a5-9983e7d3b5ce nodeName:}" failed. No retries permitted until 2026-07-07 14:02:58.142145509 +0000 UTC m=+65.268039196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-phr4m" (UniqueName: "kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m") pod "network-check-target-9x827" (UID: "219fad73-e0b3-4a16-a4a5-9983e7d3b5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:02:26.593548 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.593525 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-212.ec2.internal" event="NodeReady" Jul 07 14:02:26.593858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.593629 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:02:26.627806 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.627786 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab42e35-51b1-4ace-9b99-270d31d26195" containerID="5aa8f877af271fd6d7d66dd2f22b199b3fa50e921348fcc274933adb7f171cbb" exitCode=0 Jul 07 14:02:26.627905 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.627819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerDied","Data":"5aa8f877af271fd6d7d66dd2f22b199b3fa50e921348fcc274933adb7f171cbb"} Jul 07 14:02:26.643928 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.643862 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-24nbv"] Jul 07 14:02:26.645566 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.645550 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lj9gs"] Jul 07 14:02:26.645675 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.645659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.647448 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.647419 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.648869 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.648846 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:02:26.648960 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.648928 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:02:26.649019 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.648965 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zxjmt\"" Jul 07 14:02:26.649019 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.648970 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:02:26.649520 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.649503 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:02:26.649520 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.649509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:02:26.649641 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.649503 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kndhx\"" Jul 07 14:02:26.658920 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.658660 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24nbv"] Jul 07 14:02:26.659310 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.659292 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lj9gs"] Jul 07 14:02:26.746005 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.745982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136ff185-8b6d-4058-b9f6-a07fb7df1d26-config-volume\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.746097 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.746008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rzmt\" (UniqueName: \"kubernetes.io/projected/136ff185-8b6d-4058-b9f6-a07fb7df1d26-kube-api-access-5rzmt\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.746097 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.746081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0852b7a6-02c8-49e7-bf17-1b25bf759660-cert\") pod \"ingress-canary-24nbv\" (UID: \"0852b7a6-02c8-49e7-bf17-1b25bf759660\") " pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.746234 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.746223 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjqqx\" (UniqueName: \"kubernetes.io/projected/0852b7a6-02c8-49e7-bf17-1b25bf759660-kube-api-access-vjqqx\") pod \"ingress-canary-24nbv\" (UID: \"0852b7a6-02c8-49e7-bf17-1b25bf759660\") " pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.746301 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.746239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.746362 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.746296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136ff185-8b6d-4058-b9f6-a07fb7df1d26-tmp-dir\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.847316 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0852b7a6-02c8-49e7-bf17-1b25bf759660-cert\") pod \"ingress-canary-24nbv\" (UID: \"0852b7a6-02c8-49e7-bf17-1b25bf759660\") " pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.847390 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjqqx\" (UniqueName: \"kubernetes.io/projected/0852b7a6-02c8-49e7-bf17-1b25bf759660-kube-api-access-vjqqx\") pod \"ingress-canary-24nbv\" (UID: \"0852b7a6-02c8-49e7-bf17-1b25bf759660\") " pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.847390 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.847390 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136ff185-8b6d-4058-b9f6-a07fb7df1d26-tmp-dir\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.847509 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.847447 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:02:26.847509 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:26.847503 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls podName:136ff185-8b6d-4058-b9f6-a07fb7df1d26 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:27.347485855 +0000 UTC m=+34.473379553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls") pod "dns-default-lj9gs" (UID: "136ff185-8b6d-4058-b9f6-a07fb7df1d26") : secret "dns-default-metrics-tls" not found Jul 07 14:02:26.847608 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136ff185-8b6d-4058-b9f6-a07fb7df1d26-config-volume\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.847608 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rzmt\" (UniqueName: \"kubernetes.io/projected/136ff185-8b6d-4058-b9f6-a07fb7df1d26-kube-api-access-5rzmt\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.847707 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136ff185-8b6d-4058-b9f6-a07fb7df1d26-tmp-dir\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.847993 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.847977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136ff185-8b6d-4058-b9f6-a07fb7df1d26-config-volume\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.851375 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.851356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0852b7a6-02c8-49e7-bf17-1b25bf759660-cert\") pod \"ingress-canary-24nbv\" (UID: \"0852b7a6-02c8-49e7-bf17-1b25bf759660\") " pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.859267 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.859245 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjqqx\" (UniqueName: \"kubernetes.io/projected/0852b7a6-02c8-49e7-bf17-1b25bf759660-kube-api-access-vjqqx\") pod \"ingress-canary-24nbv\" (UID: \"0852b7a6-02c8-49e7-bf17-1b25bf759660\") " pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:26.859344 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.859305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rzmt\" (UniqueName: \"kubernetes.io/projected/136ff185-8b6d-4058-b9f6-a07fb7df1d26-kube-api-access-5rzmt\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:26.955357 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:26.955309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24nbv" Jul 07 14:02:27.084606 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.084572 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24nbv"] Jul 07 14:02:27.089491 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:27.089463 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0852b7a6_02c8_49e7_bf17_1b25bf759660.slice/crio-eddba3cd9a35f8a242fb4012d81a2c6b477246fd402dff2997c26e425c2aea2e WatchSource:0}: Error finding container eddba3cd9a35f8a242fb4012d81a2c6b477246fd402dff2997c26e425c2aea2e: Status 404 returned error can't find the container with id eddba3cd9a35f8a242fb4012d81a2c6b477246fd402dff2997c26e425c2aea2e Jul 07 14:02:27.356845 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.356815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:27.357009 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:27.356922 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:02:27.357009 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:27.356975 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls podName:136ff185-8b6d-4058-b9f6-a07fb7df1d26 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:28.356960614 +0000 UTC m=+35.482854303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls") pod "dns-default-lj9gs" (UID: "136ff185-8b6d-4058-b9f6-a07fb7df1d26") : secret "dns-default-metrics-tls" not found Jul 07 14:02:27.463902 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.463871 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:27.463902 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.463889 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:27.464074 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.463871 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:27.467694 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.467638 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:02:27.467694 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.467655 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:02:27.467694 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.467673 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:02:27.467925 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.467754 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bprp4\"" Jul 07 14:02:27.467925 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.467638 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:02:27.467925 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.467638 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gcgvf\"" Jul 07 14:02:27.632403 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:27.632279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24nbv" event={"ID":"0852b7a6-02c8-49e7-bf17-1b25bf759660","Type":"ContainerStarted","Data":"eddba3cd9a35f8a242fb4012d81a2c6b477246fd402dff2997c26e425c2aea2e"} Jul 07 14:02:28.097012 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.096958 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw"] Jul 07 14:02:28.124224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.124201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw"] Jul 07 14:02:28.124357 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.124305 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" Jul 07 14:02:28.127090 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.127048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pgwhc\"" Jul 07 14:02:28.127859 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.127838 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:02:28.127975 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.127866 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 14:02:28.210836 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.210643 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85d88db887-vwxxw"] Jul 07 14:02:28.230028 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.229996 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-68hdm"] Jul 07 14:02:28.230165 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.230129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.232707 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.232400 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 14:02:28.232707 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.232413 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 14:02:28.232707 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.232471 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 14:02:28.232941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.232729 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rxl4l\"" Jul 07 14:02:28.232941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.232918 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:02:28.233082 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.233066 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 14:02:28.233495 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.233353 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:02:28.256088 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.256066 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-68hdm"] Jul 07 14:02:28.256217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.256104 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d88db887-vwxxw"] Jul 07 14:02:28.256262 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.256236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.258169 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.258148 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 14:02:28.258169 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.258227 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:02:28.258411 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.258227 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 14:02:28.258470 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.258414 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tcd4b\"" Jul 07 14:02:28.258687 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.258673 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:02:28.263140 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.263118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjmfs\" (UniqueName: \"kubernetes.io/projected/22244b0c-dc71-4f82-86bc-fc4e674d83a9-kube-api-access-xjmfs\") pod \"volume-data-source-validator-5d456fdbcd-2wtcw\" (UID: \"22244b0c-dc71-4f82-86bc-fc4e674d83a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" Jul 07 14:02:28.264412 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.264393 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 14:02:28.311787 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.311762 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk"] Jul 07 14:02:28.336030 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.336010 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk"] Jul 07 14:02:28.336143 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.336107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" Jul 07 14:02:28.338373 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.338352 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8fx9j\"" Jul 07 14:02:28.363493 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckg8m\" (UniqueName: \"kubernetes.io/projected/a5420a40-5676-43da-818c-9b2f055953f0-kube-api-access-ckg8m\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.363493 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-stats-auth\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.363636 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d35c21-6a80-4386-87aa-f77458df215a-tmp\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.363636 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:28.363636 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-default-certificate\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.363636 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kknwr\" (UniqueName: \"kubernetes.io/projected/30d35c21-6a80-4386-87aa-f77458df215a-kube-api-access-kknwr\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.363833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30d35c21-6a80-4386-87aa-f77458df215a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.363833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30d35c21-6a80-4386-87aa-f77458df215a-snapshots\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.363833 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.363671 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:02:28.363833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30d35c21-6a80-4386-87aa-f77458df215a-serving-cert\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.363833 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.363733 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls podName:136ff185-8b6d-4058-b9f6-a07fb7df1d26 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:30.363715998 +0000 UTC m=+37.489609699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls") pod "dns-default-lj9gs" (UID: "136ff185-8b6d-4058-b9f6-a07fb7df1d26") : secret "dns-default-metrics-tls" not found Jul 07 14:02:28.363833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.364122 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30d35c21-6a80-4386-87aa-f77458df215a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.364122 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjmfs\" (UniqueName: \"kubernetes.io/projected/22244b0c-dc71-4f82-86bc-fc4e674d83a9-kube-api-access-xjmfs\") pod \"volume-data-source-validator-5d456fdbcd-2wtcw\" (UID: \"22244b0c-dc71-4f82-86bc-fc4e674d83a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" Jul 07 14:02:28.364122 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.363918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.376802 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.376784 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjmfs\" (UniqueName: \"kubernetes.io/projected/22244b0c-dc71-4f82-86bc-fc4e674d83a9-kube-api-access-xjmfs\") pod \"volume-data-source-validator-5d456fdbcd-2wtcw\" (UID: \"22244b0c-dc71-4f82-86bc-fc4e674d83a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" Jul 07 14:02:28.434880 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.434855 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" Jul 07 14:02:28.465102 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.464927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-default-certificate\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.465253 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kknwr\" (UniqueName: \"kubernetes.io/projected/30d35c21-6a80-4386-87aa-f77458df215a-kube-api-access-kknwr\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.465253 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30d35c21-6a80-4386-87aa-f77458df215a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.465253 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30d35c21-6a80-4386-87aa-f77458df215a-snapshots\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.465418 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30d35c21-6a80-4386-87aa-f77458df215a-serving-cert\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.465418 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.465418 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30d35c21-6a80-4386-87aa-f77458df215a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.465581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbsp\" (UniqueName: \"kubernetes.io/projected/2affa900-c1c6-4e93-a868-387e404a81c3-kube-api-access-hkbsp\") pod \"network-check-source-989f8b8dc-5lvxk\" (UID: \"2affa900-c1c6-4e93-a868-387e404a81c3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" Jul 07 14:02:28.465581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.465581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckg8m\" (UniqueName: \"kubernetes.io/projected/a5420a40-5676-43da-818c-9b2f055953f0-kube-api-access-ckg8m\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.465581 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.465542 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:02:28.465779 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.465616 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:28.965594145 +0000 UTC m=+36.091487853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : secret "router-metrics-certs-default" not found Jul 07 14:02:28.465779 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.465658 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:28.965641629 +0000 UTC m=+36.091535342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : configmap references non-existent config key: service-ca.crt Jul 07 14:02:28.465779 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-stats-auth\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.465779 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.465725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d35c21-6a80-4386-87aa-f77458df215a-tmp\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.466627 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.466061 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/30d35c21-6a80-4386-87aa-f77458df215a-snapshots\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.466627 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.466071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d35c21-6a80-4386-87aa-f77458df215a-tmp\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.466627 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.466582 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30d35c21-6a80-4386-87aa-f77458df215a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.466821 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.466702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30d35c21-6a80-4386-87aa-f77458df215a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.468892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.468868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30d35c21-6a80-4386-87aa-f77458df215a-serving-cert\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.469487 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.469468 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-default-certificate\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.469971 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.469951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-stats-auth\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.492780 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.492750 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckg8m\" (UniqueName: \"kubernetes.io/projected/a5420a40-5676-43da-818c-9b2f055953f0-kube-api-access-ckg8m\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.492881 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.492867 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kknwr\" (UniqueName: \"kubernetes.io/projected/30d35c21-6a80-4386-87aa-f77458df215a-kube-api-access-kknwr\") pod \"insights-operator-5c847dcfc4-68hdm\" (UID: \"30d35c21-6a80-4386-87aa-f77458df215a\") " pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.565806 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.565777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" Jul 07 14:02:28.567001 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.566966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbsp\" (UniqueName: \"kubernetes.io/projected/2affa900-c1c6-4e93-a868-387e404a81c3-kube-api-access-hkbsp\") pod \"network-check-source-989f8b8dc-5lvxk\" (UID: \"2affa900-c1c6-4e93-a868-387e404a81c3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" Jul 07 14:02:28.581022 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.581003 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbsp\" (UniqueName: \"kubernetes.io/projected/2affa900-c1c6-4e93-a868-387e404a81c3-kube-api-access-hkbsp\") pod \"network-check-source-989f8b8dc-5lvxk\" (UID: \"2affa900-c1c6-4e93-a868-387e404a81c3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" Jul 07 14:02:28.597886 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.597842 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw"] Jul 07 14:02:28.601878 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:28.601851 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22244b0c_dc71_4f82_86bc_fc4e674d83a9.slice/crio-503d27274e020e58299a652411d9665cdb902455dc15e275f63430adca3d4dcb WatchSource:0}: Error finding container 503d27274e020e58299a652411d9665cdb902455dc15e275f63430adca3d4dcb: Status 404 returned error can't find the container with id 503d27274e020e58299a652411d9665cdb902455dc15e275f63430adca3d4dcb Jul 07 14:02:28.636141 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.636083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" event={"ID":"22244b0c-dc71-4f82-86bc-fc4e674d83a9","Type":"ContainerStarted","Data":"503d27274e020e58299a652411d9665cdb902455dc15e275f63430adca3d4dcb"} Jul 07 14:02:28.646296 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.646274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" Jul 07 14:02:28.780230 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.780118 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-68hdm"] Jul 07 14:02:28.783568 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:28.783539 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d35c21_6a80_4386_87aa_f77458df215a.slice/crio-5b4f884138d6d04bd460825bd3f3176d898f3f358af1911f5c9bfd81e8df828d WatchSource:0}: Error finding container 5b4f884138d6d04bd460825bd3f3176d898f3f358af1911f5c9bfd81e8df828d: Status 404 returned error can't find the container with id 5b4f884138d6d04bd460825bd3f3176d898f3f358af1911f5c9bfd81e8df828d Jul 07 14:02:28.817975 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.817958 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk"] Jul 07 14:02:28.820867 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:28.820843 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2affa900_c1c6_4e93_a868_387e404a81c3.slice/crio-99cd1fa5f9fb3e0c63cb3d05bbd3e01b349882b0a8f8a89cd09ef291be57f041 WatchSource:0}: Error finding container 99cd1fa5f9fb3e0c63cb3d05bbd3e01b349882b0a8f8a89cd09ef291be57f041: Status 404 returned error can't find the container with id 99cd1fa5f9fb3e0c63cb3d05bbd3e01b349882b0a8f8a89cd09ef291be57f041 Jul 07 14:02:28.972032 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.971957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.972032 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:28.972016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:28.972237 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.972158 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:29.972140093 +0000 UTC m=+37.098033783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : configmap references non-existent config key: service-ca.crt Jul 07 14:02:28.972237 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.972119 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:02:28.972329 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:28.972293 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:29.972271885 +0000 UTC m=+37.098165579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : secret "router-metrics-certs-default" not found Jul 07 14:02:29.642072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:29.642041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" event={"ID":"30d35c21-6a80-4386-87aa-f77458df215a","Type":"ContainerStarted","Data":"5b4f884138d6d04bd460825bd3f3176d898f3f358af1911f5c9bfd81e8df828d"} Jul 07 14:02:29.643760 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:29.643733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" event={"ID":"2affa900-c1c6-4e93-a868-387e404a81c3","Type":"ContainerStarted","Data":"99cd1fa5f9fb3e0c63cb3d05bbd3e01b349882b0a8f8a89cd09ef291be57f041"} Jul 07 14:02:29.980640 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:29.980558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:29.980640 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:29.980625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:29.980855 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:29.980727 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:02:29.980855 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:29.980809 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:31.980788952 +0000 UTC m=+39.106682644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : secret "router-metrics-certs-default" not found Jul 07 14:02:29.980855 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:29.980830 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:31.980821082 +0000 UTC m=+39.106714773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : configmap references non-existent config key: service-ca.crt Jul 07 14:02:30.383819 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:30.383784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:30.384007 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:30.383921 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:02:30.384007 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:30.383998 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls podName:136ff185-8b6d-4058-b9f6-a07fb7df1d26 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:34.383975996 +0000 UTC m=+41.509869688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls") pod "dns-default-lj9gs" (UID: "136ff185-8b6d-4058-b9f6-a07fb7df1d26") : secret "dns-default-metrics-tls" not found Jul 07 14:02:31.994988 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:31.994954 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:31.995419 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:31.995013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:31.995419 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:31.995093 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:02:31.995419 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:31.995168 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:35.995151487 +0000 UTC m=+43.121045176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : secret "router-metrics-certs-default" not found Jul 07 14:02:31.995419 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:31.995227 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:35.995200603 +0000 UTC m=+43.121094297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : configmap references non-existent config key: service-ca.crt Jul 07 14:02:33.655769 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:33.655733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24nbv" event={"ID":"0852b7a6-02c8-49e7-bf17-1b25bf759660","Type":"ContainerStarted","Data":"0f9a61de22fa01828c6e5dff1797b3a9c1edde28eef41d73c8029bb8686417fe"} Jul 07 14:02:33.657494 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:33.657463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" event={"ID":"22244b0c-dc71-4f82-86bc-fc4e674d83a9","Type":"ContainerStarted","Data":"56f75a6dc2be2b3a7c3301e4733c5f2e3bb6b945fee5318afe26be38495ed89c"} Jul 07 14:02:33.661229 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:33.661199 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab42e35-51b1-4ace-9b99-270d31d26195" containerID="4486ab5c0dab71e7952204f0840e9eec40cfb18e221bd466ead7b5c673e90aa7" exitCode=0 Jul 07 14:02:33.661328 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:33.661244 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerDied","Data":"4486ab5c0dab71e7952204f0840e9eec40cfb18e221bd466ead7b5c673e90aa7"} Jul 07 14:02:33.672076 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:33.672023 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-24nbv" podStartSLOduration=2.157218384 podStartE2EDuration="7.672006766s" totalImagesPullingTime="5.514788382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:33.670413379 +0000 UTC m=+40.796307090" watchObservedRunningTime="2026-07-07 14:02:33.672006766 +0000 UTC m=+40.797900477" Jul 07 14:02:33.709986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:33.709910 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wtcw" podStartSLOduration=1.703889691 podStartE2EDuration="5.709895218s" totalImagesPullingTime="4.006005527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:33.709269358 +0000 UTC m=+40.835163093" watchObservedRunningTime="2026-07-07 14:02:33.709895218 +0000 UTC m=+40.835788928" Jul 07 14:02:34.413753 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:34.413721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:34.413903 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:34.413864 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:02:34.413955 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:34.413921 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls podName:136ff185-8b6d-4058-b9f6-a07fb7df1d26 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:42.413902748 +0000 UTC m=+49.539796442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls") pod "dns-default-lj9gs" (UID: "136ff185-8b6d-4058-b9f6-a07fb7df1d26") : secret "dns-default-metrics-tls" not found Jul 07 14:02:35.670758 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:35.670726 2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab42e35-51b1-4ace-9b99-270d31d26195" containerID="088b9a07170629d6c1ef2932055996bd44da00a1170e298e81299dc3a001625a" exitCode=0 Jul 07 14:02:35.671196 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:35.670806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerDied","Data":"088b9a07170629d6c1ef2932055996bd44da00a1170e298e81299dc3a001625a"} Jul 07 14:02:35.672466 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:35.672444 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" event={"ID":"2affa900-c1c6-4e93-a868-387e404a81c3","Type":"ContainerStarted","Data":"74e2bbe48502236bb45fec8d10e2cb805055e8b5e103f49c27fc889ba2626d05"} Jul 07 14:02:35.673945 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:35.673924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" event={"ID":"30d35c21-6a80-4386-87aa-f77458df215a","Type":"ContainerStarted","Data":"3267d6461503b275fbea645c5577f1c2c4a9666d67859f5fd2bfef24e277987f"} Jul 07 14:02:35.726888 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:35.726727 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lvxk" podStartSLOduration=1.429607581 podStartE2EDuration="7.726710611s" totalImagesPullingTime="6.29710303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:35.725639183 +0000 UTC m=+42.851532918" watchObservedRunningTime="2026-07-07 14:02:35.726710611 +0000 UTC m=+42.852604322" Jul 07 14:02:35.746767 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:35.746718 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" podStartSLOduration=1.407135689 podStartE2EDuration="7.746705469s" totalImagesPullingTime="6.33956978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:35.745489749 +0000 UTC m=+42.871383463" watchObservedRunningTime="2026-07-07 14:02:35.746705469 +0000 UTC m=+42.872599179" Jul 07 14:02:36.023790 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.023762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:36.023884 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.023814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:36.023951 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.023917 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:02:36.023951 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.023932 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:44.023913932 +0000 UTC m=+51.149807626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : configmap references non-existent config key: service-ca.crt Jul 07 14:02:36.024054 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.023990 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:44.023972325 +0000 UTC m=+51.149866017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : secret "router-metrics-certs-default" not found Jul 07 14:02:36.288510 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.288438 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5njgv"] Jul 07 14:02:36.307282 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.307259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.309698 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.309673 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:02:36.310130 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.310041 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tr2w4\"" Jul 07 14:02:36.310130 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.310059 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5njgv"] Jul 07 14:02:36.310130 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.310088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:02:36.326894 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.326873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.327005 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.326914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4de2b4fc-82b0-4f52-98bd-50680361104b-crio-socket\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.327005 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.326937 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4de2b4fc-82b0-4f52-98bd-50680361104b-data-volume\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.327116 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.327004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.327116 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.327024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghxn\" (UniqueName: \"kubernetes.io/projected/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-api-access-wghxn\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427371 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427371 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghxn\" (UniqueName: \"kubernetes.io/projected/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-api-access-wghxn\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427589 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427589 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4de2b4fc-82b0-4f52-98bd-50680361104b-crio-socket\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427589 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4de2b4fc-82b0-4f52-98bd-50680361104b-data-volume\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427589 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.427488 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:02:36.427589 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.427561 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:36.927540895 +0000 UTC m=+44.053434588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : configmap "kube-rbac-proxy" not found Jul 07 14:02:36.427800 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.427587 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:02:36.427800 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427591 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4de2b4fc-82b0-4f52-98bd-50680361104b-crio-socket\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.427800 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.427665 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:36.927645641 +0000 UTC m=+44.053539336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : secret "insights-runtime-extractor-tls" not found Jul 07 14:02:36.427891 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.427848 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4de2b4fc-82b0-4f52-98bd-50680361104b-data-volume\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.440416 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.440395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghxn\" (UniqueName: \"kubernetes.io/projected/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-api-access-wghxn\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.679937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.679868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" event={"ID":"0ab42e35-51b1-4ace-9b99-270d31d26195","Type":"ContainerStarted","Data":"8620ac1cb8f10f7418a99105d0efe94684f20eaa6ac8c633dcfd1eb0f3a00bff"} Jul 07 14:02:36.710517 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.710467 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kjsmd" podStartSLOduration=8.554026055 podStartE2EDuration="43.71045073s" totalImagesPullingTime="35.156424675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:36.709942824 +0000 UTC m=+43.835836530" watchObservedRunningTime="2026-07-07 14:02:36.71045073 +0000 UTC m=+43.836344441" Jul 07 14:02:36.931642 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.931453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.931642 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.931565 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:02:36.931848 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.931650 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:37.931628916 +0000 UTC m=+45.057522620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : configmap "kube-rbac-proxy" not found Jul 07 14:02:36.931848 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:36.931770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:36.934537 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.932038 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:02:36.934537 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:36.932093 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:37.932071218 +0000 UTC m=+45.057964925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : secret "insights-runtime-extractor-tls" not found Jul 07 14:02:37.930921 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.930889 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n9d2r"] Jul 07 14:02:37.939305 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.939283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:37.939416 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.939337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:37.939477 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:37.939413 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:02:37.939527 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:37.939492 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:39.939469658 +0000 UTC m=+47.065363364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : configmap "kube-rbac-proxy" not found Jul 07 14:02:37.939527 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:37.939419 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:02:37.939634 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:37.939550 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:39.939538432 +0000 UTC m=+47.065432120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : secret "insights-runtime-extractor-tls" not found Jul 07 14:02:37.952362 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.952341 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n9d2r"] Jul 07 14:02:37.952477 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.952424 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:37.954808 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.954787 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 14:02:37.954909 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.954824 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 14:02:37.955660 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.955637 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 14:02:37.955759 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.955713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hs2lz\"" Jul 07 14:02:37.955824 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:37.955781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 14:02:38.040462 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.040439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcbdp\" (UniqueName: \"kubernetes.io/projected/166e201b-34ee-46ee-abd7-dc072121f2e6-kube-api-access-jcbdp\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.040554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.040493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/166e201b-34ee-46ee-abd7-dc072121f2e6-signing-key\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.040554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.040531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/166e201b-34ee-46ee-abd7-dc072121f2e6-signing-cabundle\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.069820 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.069798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8x5pt_d6e577ee-2831-4750-8392-dac793958894/dns-node-resolver/0.log" Jul 07 14:02:38.140985 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.140961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/166e201b-34ee-46ee-abd7-dc072121f2e6-signing-key\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.141091 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.141007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/166e201b-34ee-46ee-abd7-dc072121f2e6-signing-cabundle\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.141152 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.141137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcbdp\" (UniqueName: \"kubernetes.io/projected/166e201b-34ee-46ee-abd7-dc072121f2e6-kube-api-access-jcbdp\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.141775 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.141759 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/166e201b-34ee-46ee-abd7-dc072121f2e6-signing-cabundle\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.143574 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.143552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/166e201b-34ee-46ee-abd7-dc072121f2e6-signing-key\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.153462 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.153442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcbdp\" (UniqueName: \"kubernetes.io/projected/166e201b-34ee-46ee-abd7-dc072121f2e6-kube-api-access-jcbdp\") pod \"service-ca-758f599c5-n9d2r\" (UID: \"166e201b-34ee-46ee-abd7-dc072121f2e6\") " pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.261009 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.260989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n9d2r" Jul 07 14:02:38.408916 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.408886 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n9d2r"] Jul 07 14:02:38.411847 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:38.411812 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166e201b_34ee_46ee_abd7_dc072121f2e6.slice/crio-98fe0819c3c292dfd55c3cde4e41a2aacd2d43deed5d90fba85cd8769ff57420 WatchSource:0}: Error finding container 98fe0819c3c292dfd55c3cde4e41a2aacd2d43deed5d90fba85cd8769ff57420: Status 404 returned error can't find the container with id 98fe0819c3c292dfd55c3cde4e41a2aacd2d43deed5d90fba85cd8769ff57420 Jul 07 14:02:38.685826 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:38.685765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n9d2r" event={"ID":"166e201b-34ee-46ee-abd7-dc072121f2e6","Type":"ContainerStarted","Data":"98fe0819c3c292dfd55c3cde4e41a2aacd2d43deed5d90fba85cd8769ff57420"} Jul 07 14:02:39.068917 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:39.068891 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6pcrj_10aaf244-e17c-4006-90c5-c5d5171f193f/node-ca/0.log" Jul 07 14:02:39.867091 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:39.867064 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24nbv_0852b7a6-02c8-49e7-bf17-1b25bf759660/serve-healthcheck-canary/0.log" Jul 07 14:02:39.956067 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:39.956038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:39.956216 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:39.956085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:39.956216 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:39.956163 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:02:39.956289 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:39.956239 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:43.956223018 +0000 UTC m=+51.082116706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : configmap "kube-rbac-proxy" not found Jul 07 14:02:39.956289 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:39.956242 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:02:39.956289 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:39.956269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:43.956262969 +0000 UTC m=+51.082156712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : secret "insights-runtime-extractor-tls" not found Jul 07 14:02:42.474469 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:42.473767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:42.474469 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:42.473903 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:02:42.474469 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:42.474001 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls podName:136ff185-8b6d-4058-b9f6-a07fb7df1d26 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:58.473964202 +0000 UTC m=+65.599857892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls") pod "dns-default-lj9gs" (UID: "136ff185-8b6d-4058-b9f6-a07fb7df1d26") : secret "dns-default-metrics-tls" not found Jul 07 14:02:43.700069 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:43.700027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n9d2r" event={"ID":"166e201b-34ee-46ee-abd7-dc072121f2e6","Type":"ContainerStarted","Data":"cffad3945ad70bee22acc1d4d5c43ba2e557771c3fd7548b0e73b2f1a565dae5"} Jul 07 14:02:43.720021 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:43.719973 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-n9d2r" podStartSLOduration=2.385661364 podStartE2EDuration="6.719955523s" totalImagesPullingTime="4.334294159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:43.719497621 +0000 UTC m=+50.845391332" watchObservedRunningTime="2026-07-07 14:02:43.719955523 +0000 UTC m=+50.845849233" Jul 07 14:02:43.986338 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:43.986251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:43.986338 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:43.986319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:43.986566 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:43.986401 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:02:43.986566 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:43.986481 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:51.98645775 +0000 UTC m=+59.112351440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : configmap "kube-rbac-proxy" not found Jul 07 14:02:43.986566 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:43.986482 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:02:43.986566 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:43.986544 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:02:51.986525534 +0000 UTC m=+59.112419245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : secret "insights-runtime-extractor-tls" not found Jul 07 14:02:44.087598 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:44.087561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:44.087824 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:44.087611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:02:44.087824 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:44.087725 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:03:00.087708213 +0000 UTC m=+67.213601907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : configmap references non-existent config key: service-ca.crt Jul 07 14:02:44.087824 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:44.087733 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:02:44.088110 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:44.088096 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs podName:a5420a40-5676-43da-818c-9b2f055953f0 nodeName:}" failed. No retries permitted until 2026-07-07 14:03:00.088076322 +0000 UTC m=+67.213970015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs") pod "router-default-85d88db887-vwxxw" (UID: "a5420a40-5676-43da-818c-9b2f055953f0") : secret "router-metrics-certs-default" not found Jul 07 14:02:51.622455 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:51.622420 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78b2b" Jul 07 14:02:52.046905 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:52.046870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:52.047064 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:52.046924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:52.047064 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:52.047014 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:02:52.047139 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:02:52.047065 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls podName:4de2b4fc-82b0-4f52-98bd-50680361104b nodeName:}" failed. No retries permitted until 2026-07-07 14:03:08.047050816 +0000 UTC m=+75.172944504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5njgv" (UID: "4de2b4fc-82b0-4f52-98bd-50680361104b") : secret "insights-runtime-extractor-tls" not found Jul 07 14:02:52.047406 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:52.047387 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4de2b4fc-82b0-4f52-98bd-50680361104b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:02:58.090460 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.090414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:58.090941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.090509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:58.092865 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.092842 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:02:58.092980 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.092884 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:02:58.102854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.102825 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62cbe35-17db-4389-9b2f-8a2650dba86a-original-pull-secret\") pod \"global-pull-secret-syncer-tj92w\" (UID: \"d62cbe35-17db-4389-9b2f-8a2650dba86a\") " pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:58.102950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.102886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b1a700-8b23-43eb-8081-15b34ce694e4-metrics-certs\") pod \"network-metrics-daemon-htjnk\" (UID: \"28b1a700-8b23-43eb-8081-15b34ce694e4\") " pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:58.191515 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.191480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:58.193818 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.193794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phr4m\" (UniqueName: \"kubernetes.io/projected/219fad73-e0b3-4a16-a4a5-9983e7d3b5ce-kube-api-access-phr4m\") pod \"network-check-target-9x827\" (UID: \"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce\") " pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:58.378933 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.378874 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bprp4\"" Jul 07 14:02:58.382989 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.382973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj92w" Jul 07 14:02:58.387165 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.387152 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:58.390634 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.390617 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gcgvf\"" Jul 07 14:02:58.399397 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.399372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-htjnk" Jul 07 14:02:58.494628 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.494597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:58.497224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.497201 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136ff185-8b6d-4058-b9f6-a07fb7df1d26-metrics-tls\") pod \"dns-default-lj9gs\" (UID: \"136ff185-8b6d-4058-b9f6-a07fb7df1d26\") " pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:58.526279 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.526251 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tj92w"] Jul 07 14:02:58.529789 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:58.529765 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62cbe35_17db_4389_9b2f_8a2650dba86a.slice/crio-01e48e82acb5e39c50a2a72e19eb072f984c8e81261e1bde2f0aba1e68cba80a WatchSource:0}: Error finding container 01e48e82acb5e39c50a2a72e19eb072f984c8e81261e1bde2f0aba1e68cba80a: Status 404 returned error can't find the container with id 01e48e82acb5e39c50a2a72e19eb072f984c8e81261e1bde2f0aba1e68cba80a Jul 07 14:02:58.745273 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.745213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tj92w" event={"ID":"d62cbe35-17db-4389-9b2f-8a2650dba86a","Type":"ContainerStarted","Data":"01e48e82acb5e39c50a2a72e19eb072f984c8e81261e1bde2f0aba1e68cba80a"} Jul 07 14:02:58.750135 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.750112 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-htjnk"] Jul 07 14:02:58.751997 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.751974 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9x827"] Jul 07 14:02:58.753359 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:58.753337 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b1a700_8b23_43eb_8081_15b34ce694e4.slice/crio-56d6adebbe3ece53f4e3c80033dc5f0793ca00ae085dbaafece514a2f79c19f2 WatchSource:0}: Error finding container 56d6adebbe3ece53f4e3c80033dc5f0793ca00ae085dbaafece514a2f79c19f2: Status 404 returned error can't find the container with id 56d6adebbe3ece53f4e3c80033dc5f0793ca00ae085dbaafece514a2f79c19f2 Jul 07 14:02:58.754776 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:58.754751 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219fad73_e0b3_4a16_a4a5_9983e7d3b5ce.slice/crio-b097038e97e7ad93b4e17d8111577766e2fe11f34ba43f06227e0464f9d07e96 WatchSource:0}: Error finding container b097038e97e7ad93b4e17d8111577766e2fe11f34ba43f06227e0464f9d07e96: Status 404 returned error can't find the container with id b097038e97e7ad93b4e17d8111577766e2fe11f34ba43f06227e0464f9d07e96 Jul 07 14:02:58.763775 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.763756 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kndhx\"" Jul 07 14:02:58.772635 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.772617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lj9gs" Jul 07 14:02:58.899214 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:58.899185 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lj9gs"] Jul 07 14:02:58.902088 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:02:58.902068 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136ff185_8b6d_4058_b9f6_a07fb7df1d26.slice/crio-dc39e3faa093956744db417f28cba9232534aacef25dee27bd4d4ef3e623e24c WatchSource:0}: Error finding container dc39e3faa093956744db417f28cba9232534aacef25dee27bd4d4ef3e623e24c: Status 404 returned error can't find the container with id dc39e3faa093956744db417f28cba9232534aacef25dee27bd4d4ef3e623e24c Jul 07 14:02:59.304971 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.304325 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp"] Jul 07 14:02:59.307338 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.307048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.309973 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.309614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 14:02:59.309973 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.309875 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 14:02:59.309973 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.309916 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 14:02:59.310735 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.310689 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 14:02:59.319626 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.319574 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp"] Jul 07 14:02:59.401352 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.401325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2bdcd2f9-751a-4a08-bf18-2ab30533decf-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.401464 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.401371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29vgm\" (UniqueName: \"kubernetes.io/projected/2bdcd2f9-751a-4a08-bf18-2ab30533decf-kube-api-access-29vgm\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.401464 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.401438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bdcd2f9-751a-4a08-bf18-2ab30533decf-tmp\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.488201 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.488140 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-779bcb7c54-mv568"] Jul 07 14:02:59.490518 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.490493 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.493832 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.492881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:02:59.493832 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.493351 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jlsh6\"" Jul 07 14:02:59.493832 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.493574 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:02:59.494065 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.493989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:02:59.509549 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.506407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2bdcd2f9-751a-4a08-bf18-2ab30533decf-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.509549 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.506473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29vgm\" (UniqueName: \"kubernetes.io/projected/2bdcd2f9-751a-4a08-bf18-2ab30533decf-kube-api-access-29vgm\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.509549 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.506584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bdcd2f9-751a-4a08-bf18-2ab30533decf-tmp\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.509549 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.507265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bdcd2f9-751a-4a08-bf18-2ab30533decf-tmp\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.516564 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.514965 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779bcb7c54-mv568"] Jul 07 14:02:59.516967 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.516777 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:02:59.517947 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.517905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2bdcd2f9-751a-4a08-bf18-2ab30533decf-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.537972 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.537950 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29vgm\" (UniqueName: \"kubernetes.io/projected/2bdcd2f9-751a-4a08-bf18-2ab30533decf-kube-api-access-29vgm\") pod \"klusterlet-addon-workmgr-5d99cc6b6b-2qhrp\" (UID: \"2bdcd2f9-751a-4a08-bf18-2ab30533decf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.607761 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-registry-tls\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.607761 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-bound-sa-token\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.607914 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1380a05-fe60-4e60-a936-3ae3fe16f31e-trusted-ca\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.607914 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1380a05-fe60-4e60-a936-3ae3fe16f31e-registry-certificates\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.607914 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1380a05-fe60-4e60-a936-3ae3fe16f31e-image-registry-private-configuration\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.607914 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1380a05-fe60-4e60-a936-3ae3fe16f31e-ca-trust-extracted\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.608098 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1380a05-fe60-4e60-a936-3ae3fe16f31e-installation-pull-secrets\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.608098 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.607957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgn5h\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-kube-api-access-pgn5h\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.620666 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.620639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:02:59.708822 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.708791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1380a05-fe60-4e60-a936-3ae3fe16f31e-trusted-ca\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.708953 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.708848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1380a05-fe60-4e60-a936-3ae3fe16f31e-registry-certificates\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.708953 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.708881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1380a05-fe60-4e60-a936-3ae3fe16f31e-image-registry-private-configuration\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.708953 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.708934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1380a05-fe60-4e60-a936-3ae3fe16f31e-ca-trust-extracted\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.709086 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.708961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1380a05-fe60-4e60-a936-3ae3fe16f31e-installation-pull-secrets\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.709086 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.708986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgn5h\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-kube-api-access-pgn5h\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.709086 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.709066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-registry-tls\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.709269 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.709104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-bound-sa-token\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.709832 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.709721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d1380a05-fe60-4e60-a936-3ae3fe16f31e-registry-certificates\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.710092 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.710041 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d1380a05-fe60-4e60-a936-3ae3fe16f31e-ca-trust-extracted\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.710234 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.710098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1380a05-fe60-4e60-a936-3ae3fe16f31e-trusted-ca\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.712615 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.712570 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d1380a05-fe60-4e60-a936-3ae3fe16f31e-image-registry-private-configuration\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.712774 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.712753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d1380a05-fe60-4e60-a936-3ae3fe16f31e-installation-pull-secrets\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.713240 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.713222 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-registry-tls\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.721023 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.720977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-bound-sa-token\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.721291 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.721266 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgn5h\" (UniqueName: \"kubernetes.io/projected/d1380a05-fe60-4e60-a936-3ae3fe16f31e-kube-api-access-pgn5h\") pod \"image-registry-779bcb7c54-mv568\" (UID: \"d1380a05-fe60-4e60-a936-3ae3fe16f31e\") " pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:02:59.751972 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.751932 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lj9gs" event={"ID":"136ff185-8b6d-4058-b9f6-a07fb7df1d26","Type":"ContainerStarted","Data":"dc39e3faa093956744db417f28cba9232534aacef25dee27bd4d4ef3e623e24c"} Jul 07 14:02:59.754764 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.754734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9x827" event={"ID":"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce","Type":"ContainerStarted","Data":"19c0af5adce838578e851f932215ec20ef5f31afb06cc9d784677ddb319c0c45"} Jul 07 14:02:59.754882 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.754785 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9x827" event={"ID":"219fad73-e0b3-4a16-a4a5-9983e7d3b5ce","Type":"ContainerStarted","Data":"b097038e97e7ad93b4e17d8111577766e2fe11f34ba43f06227e0464f9d07e96"} Jul 07 14:02:59.755133 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.755115 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:02:59.757315 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.757258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-htjnk" event={"ID":"28b1a700-8b23-43eb-8081-15b34ce694e4","Type":"ContainerStarted","Data":"56d6adebbe3ece53f4e3c80033dc5f0793ca00ae085dbaafece514a2f79c19f2"} Jul 07 14:02:59.788198 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.787780 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp"] Jul 07 14:02:59.788733 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.788689 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9x827" podStartSLOduration=66.788676895 podStartE2EDuration="1m6.788676895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:59.78595984 +0000 UTC m=+66.911853570" watchObservedRunningTime="2026-07-07 14:02:59.788676895 +0000 UTC m=+66.914570582" Jul 07 14:02:59.823950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:02:59.823712 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:03:00.032050 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:00.032021 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdcd2f9_751a_4a08_bf18_2ab30533decf.slice/crio-44307bfade2b0f915ab5a89cec5b842ca70910810bf111a26d6221e179a632c8 WatchSource:0}: Error finding container 44307bfade2b0f915ab5a89cec5b842ca70910810bf111a26d6221e179a632c8: Status 404 returned error can't find the container with id 44307bfade2b0f915ab5a89cec5b842ca70910810bf111a26d6221e179a632c8 Jul 07 14:03:00.113083 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.113045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:00.113245 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.113098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:00.113805 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.113782 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5420a40-5676-43da-818c-9b2f055953f0-service-ca-bundle\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:00.119811 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.119761 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5420a40-5676-43da-818c-9b2f055953f0-metrics-certs\") pod \"router-default-85d88db887-vwxxw\" (UID: \"a5420a40-5676-43da-818c-9b2f055953f0\") " pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:00.193079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.191488 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779bcb7c54-mv568"] Jul 07 14:03:00.343760 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.343683 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rxl4l\"" Jul 07 14:03:00.352657 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.352631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:00.768771 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.768728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-htjnk" event={"ID":"28b1a700-8b23-43eb-8081-15b34ce694e4","Type":"ContainerStarted","Data":"c891774b1a8d2dd89a02328a55ea4cd49f4757176cf11fe550087300b4ae2022"} Jul 07 14:03:00.768941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.768805 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-htjnk" event={"ID":"28b1a700-8b23-43eb-8081-15b34ce694e4","Type":"ContainerStarted","Data":"d2475f5316b948a80eed7e1c6674eb78bb840a4f0236bd91a817ec3e372d52a2"} Jul 07 14:03:00.770097 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.770038 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" event={"ID":"2bdcd2f9-751a-4a08-bf18-2ab30533decf","Type":"ContainerStarted","Data":"44307bfade2b0f915ab5a89cec5b842ca70910810bf111a26d6221e179a632c8"} Jul 07 14:03:00.771928 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.771792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" event={"ID":"d1380a05-fe60-4e60-a936-3ae3fe16f31e","Type":"ContainerStarted","Data":"197124b8e16901e55935213a8df04b88323975472e15e21b5db40afd532913e1"} Jul 07 14:03:00.771928 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.771841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" event={"ID":"d1380a05-fe60-4e60-a936-3ae3fe16f31e","Type":"ContainerStarted","Data":"4a18b809a23098789271fb90cae3c90e21ddb433c849f23bbfaa88bffcecfe37"} Jul 07 14:03:00.771928 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.771887 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:03:00.788936 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.788855 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-htjnk" podStartSLOduration=66.478736479 podStartE2EDuration="1m7.788834834s" totalImagesPullingTime="1.310098355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:00.787553719 +0000 UTC m=+67.913447449" watchObservedRunningTime="2026-07-07 14:03:00.788834834 +0000 UTC m=+67.914728546" Jul 07 14:03:00.806248 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:00.806193 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" podStartSLOduration=1.806159816 podStartE2EDuration="1.806159816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:00.805611004 +0000 UTC m=+67.931504742" watchObservedRunningTime="2026-07-07 14:03:00.806159816 +0000 UTC m=+67.932053577" Jul 07 14:03:01.056692 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.056663 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d88db887-vwxxw"] Jul 07 14:03:01.060560 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:01.060494 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5420a40_5676_43da_818c_9b2f055953f0.slice/crio-593f63878d7838ac4fdfe39f9c9550549a1a42492e5e828e6a336c23440a303f WatchSource:0}: Error finding container 593f63878d7838ac4fdfe39f9c9550549a1a42492e5e828e6a336c23440a303f: Status 404 returned error can't find the container with id 593f63878d7838ac4fdfe39f9c9550549a1a42492e5e828e6a336c23440a303f Jul 07 14:03:01.782795 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.782760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d88db887-vwxxw" event={"ID":"a5420a40-5676-43da-818c-9b2f055953f0","Type":"ContainerStarted","Data":"b6a0389ab385b32b2d6332cc36ff30f5efaab31a7f71ed9057490888288d1f6f"} Jul 07 14:03:01.783380 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.783359 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d88db887-vwxxw" event={"ID":"a5420a40-5676-43da-818c-9b2f055953f0","Type":"ContainerStarted","Data":"593f63878d7838ac4fdfe39f9c9550549a1a42492e5e828e6a336c23440a303f"} Jul 07 14:03:01.786725 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.785856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lj9gs" event={"ID":"136ff185-8b6d-4058-b9f6-a07fb7df1d26","Type":"ContainerStarted","Data":"9464831965fb3dcc451638a76684a67ca0fec08949659732e7b2d93db96a4a69"} Jul 07 14:03:01.786725 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.785902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lj9gs" event={"ID":"136ff185-8b6d-4058-b9f6-a07fb7df1d26","Type":"ContainerStarted","Data":"42130dbdcf9cfaed7b595b59958797623c98459621edc331096f1b4a4cb04ac6"} Jul 07 14:03:01.786725 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.786698 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lj9gs" Jul 07 14:03:01.805413 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.804261 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85d88db887-vwxxw" podStartSLOduration=33.804244947 podStartE2EDuration="33.804244947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:01.803331135 +0000 UTC m=+68.929224859" watchObservedRunningTime="2026-07-07 14:03:01.804244947 +0000 UTC m=+68.930138658" Jul 07 14:03:01.824068 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:01.824018 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lj9gs" podStartSLOduration=33.784503907 podStartE2EDuration="35.824000834s" totalImagesPullingTime="2.039496927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:01.822857184 +0000 UTC m=+68.948750919" watchObservedRunningTime="2026-07-07 14:03:01.824000834 +0000 UTC m=+68.949894547" Jul 07 14:03:02.353511 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:02.353469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:02.356607 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:02.356538 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:02.791156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:02.790937 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:02.792702 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:02.792682 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85d88db887-vwxxw" Jul 07 14:03:05.802345 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:05.802307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tj92w" event={"ID":"d62cbe35-17db-4389-9b2f-8a2650dba86a","Type":"ContainerStarted","Data":"17f24731de1af4bd05f87554d2b225f1e0ac015fa5cbbcb17cb526864ef7f804"} Jul 07 14:03:05.822392 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:05.822344 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tj92w" podStartSLOduration=66.020576438 podStartE2EDuration="1m12.822330408s" totalImagesPullingTime="6.80175397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:05.821454785 +0000 UTC m=+72.947348500" watchObservedRunningTime="2026-07-07 14:03:05.822330408 +0000 UTC m=+72.948224118" Jul 07 14:03:06.807649 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:06.807607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" event={"ID":"2bdcd2f9-751a-4a08-bf18-2ab30533decf","Type":"ContainerStarted","Data":"a9035c05cc20005a6bb5bcc2be2379d8ba291d0e0b8c599fd4dc0351e06eb785"} Jul 07 14:03:06.808141 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:06.807730 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:03:06.809630 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:06.809611 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" Jul 07 14:03:06.841650 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:06.841607 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d99cc6b6b-2qhrp" podStartSLOduration=2.163285074 podStartE2EDuration="7.841576627s" totalImagesPullingTime="5.678291553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:06.841025391 +0000 UTC m=+73.966919101" watchObservedRunningTime="2026-07-07 14:03:06.841576627 +0000 UTC m=+73.967470336" Jul 07 14:03:08.076359 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.076330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:03:08.078518 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.078499 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4de2b4fc-82b0-4f52-98bd-50680361104b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5njgv\" (UID: \"4de2b4fc-82b0-4f52-98bd-50680361104b\") " pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:03:08.086859 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.086832 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8"] Jul 07 14:03:08.119636 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.119607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tr2w4\"" Jul 07 14:03:08.122812 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.122134 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8"] Jul 07 14:03:08.122812 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.122268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.124698 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.124674 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 14:03:08.125032 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.125014 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 14:03:08.125441 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.125421 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gbfls\"" Jul 07 14:03:08.125782 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.125764 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:03:08.125961 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.125945 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:03:08.126199 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.126165 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:03:08.127236 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.127217 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5njgv" Jul 07 14:03:08.265686 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.265657 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5njgv"] Jul 07 14:03:08.269078 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:08.269052 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de2b4fc_82b0_4f52_98bd_50680361104b.slice/crio-9dbee004bca5f25117fdc1156375ba1cbb147972017678f3464f4dd78dbd0b87 WatchSource:0}: Error finding container 9dbee004bca5f25117fdc1156375ba1cbb147972017678f3464f4dd78dbd0b87: Status 404 returned error can't find the container with id 9dbee004bca5f25117fdc1156375ba1cbb147972017678f3464f4dd78dbd0b87 Jul 07 14:03:08.277938 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.277916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpvj\" (UniqueName: \"kubernetes.io/projected/e685b6a0-0551-4f4f-9470-613241f3676d-kube-api-access-4fpvj\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.278057 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.277959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e685b6a0-0551-4f4f-9470-613241f3676d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.278057 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.278002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e685b6a0-0551-4f4f-9470-613241f3676d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.278155 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.278063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e685b6a0-0551-4f4f-9470-613241f3676d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.378507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.378458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e685b6a0-0551-4f4f-9470-613241f3676d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.378507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.378489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpvj\" (UniqueName: \"kubernetes.io/projected/e685b6a0-0551-4f4f-9470-613241f3676d-kube-api-access-4fpvj\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.378637 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.378511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e685b6a0-0551-4f4f-9470-613241f3676d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.378637 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.378537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e685b6a0-0551-4f4f-9470-613241f3676d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.379168 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.379148 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e685b6a0-0551-4f4f-9470-613241f3676d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.380865 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.380845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e685b6a0-0551-4f4f-9470-613241f3676d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.380865 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.380852 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e685b6a0-0551-4f4f-9470-613241f3676d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.391850 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.391829 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpvj\" (UniqueName: \"kubernetes.io/projected/e685b6a0-0551-4f4f-9470-613241f3676d-kube-api-access-4fpvj\") pod \"prometheus-operator-567f7b8b7c-r8mz8\" (UID: \"e685b6a0-0551-4f4f-9470-613241f3676d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.439833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.439814 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" Jul 07 14:03:08.560407 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.560380 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8"] Jul 07 14:03:08.563235 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:08.563208 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode685b6a0_0551_4f4f_9470_613241f3676d.slice/crio-ba558e627c502635650965b8d76e88ba923420a2f598c64ec08ec49507a0c6e8 WatchSource:0}: Error finding container ba558e627c502635650965b8d76e88ba923420a2f598c64ec08ec49507a0c6e8: Status 404 returned error can't find the container with id ba558e627c502635650965b8d76e88ba923420a2f598c64ec08ec49507a0c6e8 Jul 07 14:03:08.819166 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.819126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" event={"ID":"e685b6a0-0551-4f4f-9470-613241f3676d","Type":"ContainerStarted","Data":"ba558e627c502635650965b8d76e88ba923420a2f598c64ec08ec49507a0c6e8"} Jul 07 14:03:08.821724 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:08.821691 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5njgv" event={"ID":"4de2b4fc-82b0-4f52-98bd-50680361104b","Type":"ContainerStarted","Data":"9dbee004bca5f25117fdc1156375ba1cbb147972017678f3464f4dd78dbd0b87"} Jul 07 14:03:11.925724 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.925687 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77956d7557-rgsxj"] Jul 07 14:03:11.935457 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.935436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:11.939333 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.939307 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:03:11.939333 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.939307 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:03:11.939998 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.939980 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:03:11.940137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.940018 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:03:11.940293 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.940277 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:03:11.940293 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.940294 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:03:11.940474 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.940409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kfckn\"" Jul 07 14:03:11.941001 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.940985 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:03:11.952110 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.952093 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:03:11.989827 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:11.989790 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77956d7557-rgsxj"] Jul 07 14:03:12.007295 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007264 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-config\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.007409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-service-ca\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.007409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-oauth-config\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.007525 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nflmv\" (UniqueName: \"kubernetes.io/projected/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-kube-api-access-nflmv\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.007525 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-serving-cert\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.007525 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-trusted-ca-bundle\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.007676 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.007537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-oauth-serving-cert\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108595 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-oauth-config\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108723 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nflmv\" (UniqueName: \"kubernetes.io/projected/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-kube-api-access-nflmv\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108723 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-serving-cert\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108723 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-trusted-ca-bundle\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108723 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-oauth-serving-cert\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108723 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-config\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.108992 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.108740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-service-ca\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.109583 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.109559 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-service-ca\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.109658 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.109597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-trusted-ca-bundle\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.109898 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.109872 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-oauth-serving-cert\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.110051 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.110004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-config\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.111209 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.111149 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-oauth-config\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.111328 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.111312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-serving-cert\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.121998 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.121972 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nflmv\" (UniqueName: \"kubernetes.io/projected/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-kube-api-access-nflmv\") pod \"console-77956d7557-rgsxj\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.245346 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.245264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:12.437292 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.437264 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77956d7557-rgsxj"] Jul 07 14:03:12.440806 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:12.440782 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa4385c_5ebc_4dea_bd03_f97020a2bff6.slice/crio-174022e5dd496bc8f300c3e34570cc04f6dbc77ae14a9d8e8320cf2197086281 WatchSource:0}: Error finding container 174022e5dd496bc8f300c3e34570cc04f6dbc77ae14a9d8e8320cf2197086281: Status 404 returned error can't find the container with id 174022e5dd496bc8f300c3e34570cc04f6dbc77ae14a9d8e8320cf2197086281 Jul 07 14:03:12.796727 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.796699 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lj9gs" Jul 07 14:03:12.844478 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.844441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5njgv" event={"ID":"4de2b4fc-82b0-4f52-98bd-50680361104b","Type":"ContainerStarted","Data":"5e68da3286b50db1735a7aa1f18c973861b33320b50f6a8dfaeb0dfed6097ecb"} Jul 07 14:03:12.846544 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.846512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" event={"ID":"e685b6a0-0551-4f4f-9470-613241f3676d","Type":"ContainerStarted","Data":"0177ea01e919e053d42050d98be3c7ac4c3f6f1762dc113383f17437a309a922"} Jul 07 14:03:12.846706 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.846570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" event={"ID":"e685b6a0-0551-4f4f-9470-613241f3676d","Type":"ContainerStarted","Data":"0bd411dba4ee84efff352423e2b5ed72592a867a13cacbf6e512656d34a87de3"} Jul 07 14:03:12.847922 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.847891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77956d7557-rgsxj" event={"ID":"9aa4385c-5ebc-4dea-bd03-f97020a2bff6","Type":"ContainerStarted","Data":"174022e5dd496bc8f300c3e34570cc04f6dbc77ae14a9d8e8320cf2197086281"} Jul 07 14:03:12.868898 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:12.868846 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-r8mz8" podStartSLOduration=1.141708028 podStartE2EDuration="4.868827349s" totalImagesPullingTime="3.727119321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:12.867762669 +0000 UTC m=+79.993656399" watchObservedRunningTime="2026-07-07 14:03:12.868827349 +0000 UTC m=+79.994721062" Jul 07 14:03:13.854923 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:13.854880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5njgv" event={"ID":"4de2b4fc-82b0-4f52-98bd-50680361104b","Type":"ContainerStarted","Data":"41bc922dd45c588111913ebfd8bada4346e604b1ae3662daea6e3ac20df66f2a"} Jul 07 14:03:14.638392 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.638359 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-czbhc"] Jul 07 14:03:14.641558 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.641118 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.645880 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.644326 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d9phh\"" Jul 07 14:03:14.645880 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.644549 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:03:14.645880 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.644825 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:03:14.645880 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.645055 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:03:14.731472 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-root\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731613 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-wtmp\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731613 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731613 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731613 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-sys\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731836 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-textfile\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731836 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq88k\" (UniqueName: \"kubernetes.io/projected/30533477-f233-468b-a885-bc67162bb7b5-kube-api-access-qq88k\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731836 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.731836 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.731714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30533477-f233-468b-a885-bc67162bb7b5-metrics-client-ca\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.832832 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.832799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-textfile\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.832986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.832848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq88k\" (UniqueName: \"kubernetes.io/projected/30533477-f233-468b-a885-bc67162bb7b5-kube-api-access-qq88k\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.832986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.832880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.832986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.832912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30533477-f233-468b-a885-bc67162bb7b5-metrics-client-ca\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.832986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.832940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-root\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.832986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.832982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-wtmp\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833156 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-sys\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833323 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-sys\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833323 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833200 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-textfile\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833323 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833218 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-root\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833323 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:03:14.833302 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:03:14.833323 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833311 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-wtmp\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833544 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:03:14.833359 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls podName:30533477-f233-468b-a885-bc67162bb7b5 nodeName:}" failed. No retries permitted until 2026-07-07 14:03:15.333339769 +0000 UTC m=+82.459233463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls") pod "node-exporter-czbhc" (UID: "30533477-f233-468b-a885-bc67162bb7b5") : secret "node-exporter-tls" not found Jul 07 14:03:14.833883 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833861 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.833994 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.833922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30533477-f233-468b-a885-bc67162bb7b5-metrics-client-ca\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.835977 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.835952 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:14.845856 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:14.845837 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq88k\" (UniqueName: \"kubernetes.io/projected/30533477-f233-468b-a885-bc67162bb7b5-kube-api-access-qq88k\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:15.337033 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:15.336846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:15.337033 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:03:15.336976 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:03:15.337448 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:03:15.337045 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls podName:30533477-f233-468b-a885-bc67162bb7b5 nodeName:}" failed. No retries permitted until 2026-07-07 14:03:16.33702675 +0000 UTC m=+83.462920437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls") pod "node-exporter-czbhc" (UID: "30533477-f233-468b-a885-bc67162bb7b5") : secret "node-exporter-tls" not found Jul 07 14:03:16.346690 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.346647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:16.349073 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.349047 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30533477-f233-468b-a885-bc67162bb7b5-node-exporter-tls\") pod \"node-exporter-czbhc\" (UID: \"30533477-f233-468b-a885-bc67162bb7b5\") " pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:16.455511 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.455483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-czbhc" Jul 07 14:03:16.529742 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:16.529711 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30533477_f233_468b_a885_bc67162bb7b5.slice/crio-7093a895aff43940595c709d62a7ebed93880f6605f7101b2d1b97bdb0dec4c2 WatchSource:0}: Error finding container 7093a895aff43940595c709d62a7ebed93880f6605f7101b2d1b97bdb0dec4c2: Status 404 returned error can't find the container with id 7093a895aff43940595c709d62a7ebed93880f6605f7101b2d1b97bdb0dec4c2 Jul 07 14:03:16.869560 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.869469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77956d7557-rgsxj" event={"ID":"9aa4385c-5ebc-4dea-bd03-f97020a2bff6","Type":"ContainerStarted","Data":"ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced"} Jul 07 14:03:16.870634 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.870612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czbhc" event={"ID":"30533477-f233-468b-a885-bc67162bb7b5","Type":"ContainerStarted","Data":"7093a895aff43940595c709d62a7ebed93880f6605f7101b2d1b97bdb0dec4c2"} Jul 07 14:03:16.872528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.872507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5njgv" event={"ID":"4de2b4fc-82b0-4f52-98bd-50680361104b","Type":"ContainerStarted","Data":"d3864a9a70af79fb4fd945757434f76e0b14c2fadae6071316ba8f2e85258fd7"} Jul 07 14:03:16.892460 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.892414 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77956d7557-rgsxj" podStartSLOduration=1.804357237 podStartE2EDuration="5.892401102s" totalImagesPullingTime="4.088043865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:16.89145124 +0000 UTC m=+84.017344968" watchObservedRunningTime="2026-07-07 14:03:16.892401102 +0000 UTC m=+84.018294811" Jul 07 14:03:16.912457 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:16.912412 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5njgv" podStartSLOduration=32.773057487 podStartE2EDuration="40.912399602s" totalImagesPullingTime="8.139342115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:02:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:16.911618667 +0000 UTC m=+84.037512377" watchObservedRunningTime="2026-07-07 14:03:16.912399602 +0000 UTC m=+84.038293311" Jul 07 14:03:17.627634 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.627606 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b87bdc769-zddvr"] Jul 07 14:03:17.630554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.630529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.632890 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.632968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a07kmj2u4ohga\"" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.632996 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xscg7\"" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.633150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.633221 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.633283 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 14:03:17.633507 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.633359 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 14:03:17.659080 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.659057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b87bdc769-zddvr"] Jul 07 14:03:17.755645 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755619 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-grpc-tls\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755746 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755746 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2416e5e8-64a5-4b24-9388-bc9590b00f01-metrics-client-ca\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755826 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-tls\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755826 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755896 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7lm6\" (UniqueName: \"kubernetes.io/projected/2416e5e8-64a5-4b24-9388-bc9590b00f01-kube-api-access-d7lm6\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755896 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.755896 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.755890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856557 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856557 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-grpc-tls\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2416e5e8-64a5-4b24-9388-bc9590b00f01-metrics-client-ca\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856807 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-tls\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856807 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.856807 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.856768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7lm6\" (UniqueName: \"kubernetes.io/projected/2416e5e8-64a5-4b24-9388-bc9590b00f01-kube-api-access-d7lm6\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.857505 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.857483 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2416e5e8-64a5-4b24-9388-bc9590b00f01-metrics-client-ca\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.859221 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.859197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.859339 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.859291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.859509 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.859486 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.859583 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.859535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-tls\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.859583 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.859556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-grpc-tls\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.859689 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.859673 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2416e5e8-64a5-4b24-9388-bc9590b00f01-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.867322 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.867299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7lm6\" (UniqueName: \"kubernetes.io/projected/2416e5e8-64a5-4b24-9388-bc9590b00f01-kube-api-access-d7lm6\") pod \"thanos-querier-6b87bdc769-zddvr\" (UID: \"2416e5e8-64a5-4b24-9388-bc9590b00f01\") " pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:17.878447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.878420 2580 generic.go:356] "Generic (PLEG): container finished" podID="30533477-f233-468b-a885-bc67162bb7b5" containerID="62deb6ce370dca741bfdc2d948a4fa32ec2a1a5c683b5dcb731438d664264527" exitCode=0 Jul 07 14:03:17.878538 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.878501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czbhc" event={"ID":"30533477-f233-468b-a885-bc67162bb7b5","Type":"ContainerDied","Data":"62deb6ce370dca741bfdc2d948a4fa32ec2a1a5c683b5dcb731438d664264527"} Jul 07 14:03:17.941796 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:17.941774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:18.079278 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:18.079247 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2416e5e8_64a5_4b24_9388_bc9590b00f01.slice/crio-59ccbcdf90324f2f5c1c1ec3865bbbcb7b9d6d48fc067e682eb9d33f60db735f WatchSource:0}: Error finding container 59ccbcdf90324f2f5c1c1ec3865bbbcb7b9d6d48fc067e682eb9d33f60db735f: Status 404 returned error can't find the container with id 59ccbcdf90324f2f5c1c1ec3865bbbcb7b9d6d48fc067e682eb9d33f60db735f Jul 07 14:03:18.079798 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:18.079777 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b87bdc769-zddvr"] Jul 07 14:03:18.884115 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:18.884077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"59ccbcdf90324f2f5c1c1ec3865bbbcb7b9d6d48fc067e682eb9d33f60db735f"} Jul 07 14:03:18.886506 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:18.886472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czbhc" event={"ID":"30533477-f233-468b-a885-bc67162bb7b5","Type":"ContainerStarted","Data":"a806ec9c80c27a40fb15a57cf860e83ce099ecaf4800500d7eda3414ad039b38"} Jul 07 14:03:18.886624 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:18.886534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czbhc" event={"ID":"30533477-f233-468b-a885-bc67162bb7b5","Type":"ContainerStarted","Data":"f3bde66c724e4ffbe07719cb48229a6e96fb9010c0e0b74068a6b854f8bf0281"} Jul 07 14:03:18.909208 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:18.909142 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-czbhc" podStartSLOduration=3.815743485 podStartE2EDuration="4.909123029s" totalImagesPullingTime="1.019142644s" totalInitContainerRuntime="74.2369ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:18.90878432 +0000 UTC m=+86.034678032" watchObservedRunningTime="2026-07-07 14:03:18.909123029 +0000 UTC m=+86.035016740" Jul 07 14:03:19.261360 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.261329 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk"] Jul 07 14:03:19.263510 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.263495 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.265749 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.265729 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 14:03:19.265853 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.265757 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zfc4k\"" Jul 07 14:03:19.280441 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.280412 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk"] Jul 07 14:03:19.371551 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.371527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfg7c\" (UniqueName: \"kubernetes.io/projected/6b443c08-82cc-4620-b690-c1e4e922c2ff-kube-api-access-dfg7c\") pod \"monitoring-plugin-d5dcff7cf-nvfvk\" (UID: \"6b443c08-82cc-4620-b690-c1e4e922c2ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.371662 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.371568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b443c08-82cc-4620-b690-c1e4e922c2ff-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nvfvk\" (UID: \"6b443c08-82cc-4620-b690-c1e4e922c2ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.472442 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.472418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfg7c\" (UniqueName: \"kubernetes.io/projected/6b443c08-82cc-4620-b690-c1e4e922c2ff-kube-api-access-dfg7c\") pod \"monitoring-plugin-d5dcff7cf-nvfvk\" (UID: \"6b443c08-82cc-4620-b690-c1e4e922c2ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.472579 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.472453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b443c08-82cc-4620-b690-c1e4e922c2ff-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nvfvk\" (UID: \"6b443c08-82cc-4620-b690-c1e4e922c2ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.474730 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.474710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b443c08-82cc-4620-b690-c1e4e922c2ff-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-nvfvk\" (UID: \"6b443c08-82cc-4620-b690-c1e4e922c2ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.483297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.483266 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfg7c\" (UniqueName: \"kubernetes.io/projected/6b443c08-82cc-4620-b690-c1e4e922c2ff-kube-api-access-dfg7c\") pod \"monitoring-plugin-d5dcff7cf-nvfvk\" (UID: \"6b443c08-82cc-4620-b690-c1e4e922c2ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.571554 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.571493 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-849f8f4f8f-w86hv"] Jul 07 14:03:19.573230 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.573210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:19.574229 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.574208 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.585299 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.585279 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849f8f4f8f-w86hv"] Jul 07 14:03:19.674660 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdbm\" (UniqueName: \"kubernetes.io/projected/73c29b49-f957-4c32-90d1-51882716280b-kube-api-access-phdbm\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.674790 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-oauth-config\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.674790 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-service-ca\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.674790 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674751 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-serving-cert\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.674790 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-oauth-serving-cert\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.675005 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-console-config\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.675005 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.674858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-trusted-ca-bundle\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.712164 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.712137 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk"] Jul 07 14:03:19.715110 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:19.715088 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b443c08_82cc_4620_b690_c1e4e922c2ff.slice/crio-3d19bf20ad7ab3733d83cbd57de3e26e17037a32d0ad2ecda6348a8c2a11d3b6 WatchSource:0}: Error finding container 3d19bf20ad7ab3733d83cbd57de3e26e17037a32d0ad2ecda6348a8c2a11d3b6: Status 404 returned error can't find the container with id 3d19bf20ad7ab3733d83cbd57de3e26e17037a32d0ad2ecda6348a8c2a11d3b6 Jul 07 14:03:19.775292 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-trusted-ca-bundle\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.775409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdbm\" (UniqueName: \"kubernetes.io/projected/73c29b49-f957-4c32-90d1-51882716280b-kube-api-access-phdbm\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.775409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-oauth-config\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.775409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-service-ca\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.775591 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-serving-cert\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.775591 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-oauth-serving-cert\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.775591 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.775480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-console-config\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.776313 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.776257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-trusted-ca-bundle\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.776407 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.776323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-oauth-serving-cert\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.776407 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.776360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-console-config\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.776407 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.776373 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-service-ca\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.778206 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.778164 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-serving-cert\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.778300 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.778202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-oauth-config\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.784717 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.784685 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdbm\" (UniqueName: \"kubernetes.io/projected/73c29b49-f957-4c32-90d1-51882716280b-kube-api-access-phdbm\") pod \"console-849f8f4f8f-w86hv\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:19.827895 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.827842 2580 patch_prober.go:28] interesting pod/image-registry-779bcb7c54-mv568 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 14:03:19.827895 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.827883 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" podUID="d1380a05-fe60-4e60-a936-3ae3fe16f31e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:03:19.893243 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.893212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" event={"ID":"6b443c08-82cc-4620-b690-c1e4e922c2ff","Type":"ContainerStarted","Data":"3d19bf20ad7ab3733d83cbd57de3e26e17037a32d0ad2ecda6348a8c2a11d3b6"} Jul 07 14:03:19.900645 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:19.900629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:20.033809 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.033777 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849f8f4f8f-w86hv"] Jul 07 14:03:20.037641 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:03:20.037617 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c29b49_f957_4c32_90d1_51882716280b.slice/crio-e7a3f118e46862df8c1c053c721663980ddd02e49e628929412890f7e4f08dcd WatchSource:0}: Error finding container e7a3f118e46862df8c1c053c721663980ddd02e49e628929412890f7e4f08dcd: Status 404 returned error can't find the container with id e7a3f118e46862df8c1c053c721663980ddd02e49e628929412890f7e4f08dcd Jul 07 14:03:20.899404 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.899312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849f8f4f8f-w86hv" event={"ID":"73c29b49-f957-4c32-90d1-51882716280b","Type":"ContainerStarted","Data":"cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767"} Jul 07 14:03:20.899404 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.899364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849f8f4f8f-w86hv" event={"ID":"73c29b49-f957-4c32-90d1-51882716280b","Type":"ContainerStarted","Data":"e7a3f118e46862df8c1c053c721663980ddd02e49e628929412890f7e4f08dcd"} Jul 07 14:03:20.901473 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.901450 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"51970723b21c2df5d7996f0d85a5abffbced20c740849d8a9e1a0ca2213e1696"} Jul 07 14:03:20.901581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.901507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"92e9cdf04d467fe4343e7535886e1497ec33404f2b8c391b890bad44519d691a"} Jul 07 14:03:20.901581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.901537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"229be51c99bce69cbdb167655ee11e359121b26ca1cffc903164eab20d77e6d5"} Jul 07 14:03:20.928919 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:20.928876 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-849f8f4f8f-w86hv" podStartSLOduration=1.928861132 podStartE2EDuration="1.928861132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:20.927866437 +0000 UTC m=+88.053760171" watchObservedRunningTime="2026-07-07 14:03:20.928861132 +0000 UTC m=+88.054754842" Jul 07 14:03:21.791850 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:21.791819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-779bcb7c54-mv568" Jul 07 14:03:21.908395 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:21.908346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"87ee1bf6dd2853cee6617ef6e2d44f8ec76b5be4d6e6f56a031b595870558d3e"} Jul 07 14:03:21.908818 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:21.908422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"c39b679e0a1974750cd29e54eded499c9f55f3a43d12cb25d01beaf85620b710"} Jul 07 14:03:21.908818 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:21.908450 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" event={"ID":"2416e5e8-64a5-4b24-9388-bc9590b00f01","Type":"ContainerStarted","Data":"8e3cfdbad7c2f9b23967d7f2a09483946a239820a21c48689e53cf5e2b0b15f0"} Jul 07 14:03:21.935098 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:21.935056 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" podStartSLOduration=1.7360198759999999 podStartE2EDuration="4.93503966s" totalImagesPullingTime="3.199019784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:21.934163583 +0000 UTC m=+89.060057290" watchObservedRunningTime="2026-07-07 14:03:21.93503966 +0000 UTC m=+89.060933371" Jul 07 14:03:22.246432 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.246346 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:22.246432 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.246414 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:22.252521 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.252494 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:22.915814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.915772 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" event={"ID":"6b443c08-82cc-4620-b690-c1e4e922c2ff","Type":"ContainerStarted","Data":"b0c032539381e64c16175d9215f30be8fc5c448205da59e2f21f26042e213b94"} Jul 07 14:03:22.916366 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.916334 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:22.916514 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.916382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:22.919849 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.919829 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:22.920801 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.920782 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" Jul 07 14:03:22.937059 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:22.937017 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-nvfvk" podStartSLOduration=1.272489653 podStartE2EDuration="3.937002804s" totalImagesPullingTime="2.664513151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:22.935264825 +0000 UTC m=+90.061158550" watchObservedRunningTime="2026-07-07 14:03:22.937002804 +0000 UTC m=+90.062896514" Jul 07 14:03:28.924868 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:28.924835 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b87bdc769-zddvr" Jul 07 14:03:29.901237 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:29.901137 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:29.901237 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:29.901212 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:29.905860 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:29.905839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:29.951805 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:29.951771 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:03:30.026436 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:30.026396 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77956d7557-rgsxj"] Jul 07 14:03:30.774121 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:30.774096 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9x827" Jul 07 14:03:55.051228 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.051144 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77956d7557-rgsxj" podUID="9aa4385c-5ebc-4dea-bd03-f97020a2bff6" containerName="console" containerID="cri-o://ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced" gracePeriod=15 Jul 07 14:03:55.299013 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.298992 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:55.340781 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340726 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-oauth-config\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.340781 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340759 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-oauth-serving-cert\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.340967 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nflmv\" (UniqueName: \"kubernetes.io/projected/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-kube-api-access-nflmv\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.340967 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340896 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-serving-cert\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.340967 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340930 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-config\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.340967 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340966 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-service-ca\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.341187 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.340989 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-trusted-ca-bundle\") pod \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\" (UID: \"9aa4385c-5ebc-4dea-bd03-f97020a2bff6\") " Jul 07 14:03:55.341297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.341254 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:03:55.341430 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.341405 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-config" (OuterVolumeSpecName: "console-config") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:03:55.341496 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.341412 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-service-ca" (OuterVolumeSpecName: "service-ca") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:03:55.341496 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.341474 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:03:55.343575 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.343553 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:03:55.343684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.343616 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:03:55.343684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.343651 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-kube-api-access-nflmv" (OuterVolumeSpecName: "kube-api-access-nflmv") pod "9aa4385c-5ebc-4dea-bd03-f97020a2bff6" (UID: "9aa4385c-5ebc-4dea-bd03-f97020a2bff6"). InnerVolumeSpecName "kube-api-access-nflmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:03:55.442117 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442093 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:55.442117 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442113 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:55.442117 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442122 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:55.442315 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442130 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:55.442315 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442137 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:55.442315 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442145 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:55.442315 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:55.442153 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nflmv\" (UniqueName: \"kubernetes.io/projected/9aa4385c-5ebc-4dea-bd03-f97020a2bff6-kube-api-access-nflmv\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:03:56.047704 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.047673 2580 generic.go:356] "Generic (PLEG): container finished" podID="9aa4385c-5ebc-4dea-bd03-f97020a2bff6" containerID="ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced" exitCode=0 Jul 07 14:03:56.047878 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.047726 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77956d7557-rgsxj" Jul 07 14:03:56.047878 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.047760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77956d7557-rgsxj" event={"ID":"9aa4385c-5ebc-4dea-bd03-f97020a2bff6","Type":"ContainerDied","Data":"ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced"} Jul 07 14:03:56.047878 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.047810 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77956d7557-rgsxj" event={"ID":"9aa4385c-5ebc-4dea-bd03-f97020a2bff6","Type":"ContainerDied","Data":"174022e5dd496bc8f300c3e34570cc04f6dbc77ae14a9d8e8320cf2197086281"} Jul 07 14:03:56.048758 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.048742 2580 scope.go:117] "RemoveContainer" containerID="ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced" Jul 07 14:03:56.057015 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.056911 2580 scope.go:117] "RemoveContainer" containerID="ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced" Jul 07 14:03:56.057317 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:03:56.057295 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced\": container with ID starting with ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced not found: ID does not exist" containerID="ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced" Jul 07 14:03:56.057363 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.057326 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced"} err="failed to get container status \"ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced\": rpc error: code = NotFound desc = could not find container \"ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced\": container with ID starting with ab88e6fad2086ba5e871d7d51bb86d1ada4486a8661d83a628f0ff4b508deced not found: ID does not exist" Jul 07 14:03:56.076017 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.075993 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77956d7557-rgsxj"] Jul 07 14:03:56.084009 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:56.083991 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77956d7557-rgsxj"] Jul 07 14:03:57.467850 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:03:57.467819 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa4385c-5ebc-4dea-bd03-f97020a2bff6" path="/var/lib/kubelet/pods/9aa4385c-5ebc-4dea-bd03-f97020a2bff6/volumes" Jul 07 14:04:11.107799 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:11.107769 2580 generic.go:356] "Generic (PLEG): container finished" podID="30d35c21-6a80-4386-87aa-f77458df215a" containerID="3267d6461503b275fbea645c5577f1c2c4a9666d67859f5fd2bfef24e277987f" exitCode=0 Jul 07 14:04:11.108223 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:11.107873 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" event={"ID":"30d35c21-6a80-4386-87aa-f77458df215a","Type":"ContainerDied","Data":"3267d6461503b275fbea645c5577f1c2c4a9666d67859f5fd2bfef24e277987f"} Jul 07 14:04:11.108223 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:11.108197 2580 scope.go:117] "RemoveContainer" containerID="3267d6461503b275fbea645c5577f1c2c4a9666d67859f5fd2bfef24e277987f" Jul 07 14:04:12.113435 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:12.113404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-68hdm" event={"ID":"30d35c21-6a80-4386-87aa-f77458df215a","Type":"ContainerStarted","Data":"8fce6fc769dd19635ab9abaa967935f356b9357b34694c537effc2fd14150f02"} Jul 07 14:04:43.579027 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.578991 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fbcbcc589-nkr76"] Jul 07 14:04:43.579486 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.579300 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa4385c-5ebc-4dea-bd03-f97020a2bff6" containerName="console" Jul 07 14:04:43.579486 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.579313 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa4385c-5ebc-4dea-bd03-f97020a2bff6" containerName="console" Jul 07 14:04:43.579486 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.579369 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa4385c-5ebc-4dea-bd03-f97020a2bff6" containerName="console" Jul 07 14:04:43.582796 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.582774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.592973 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.592948 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbcbcc589-nkr76"] Jul 07 14:04:43.675877 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.675848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-serving-cert\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.675877 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.675877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-trusted-ca-bundle\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.676137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.675906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcshn\" (UniqueName: \"kubernetes.io/projected/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-kube-api-access-tcshn\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.676137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.675924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-oauth-serving-cert\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.676137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.676046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-service-ca\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.676137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.676077 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-oauth-config\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.676137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.676101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-config\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777282 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-oauth-serving-cert\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777401 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-service-ca\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777401 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-oauth-config\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777401 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-config\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777401 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-serving-cert\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777579 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-trusted-ca-bundle\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.777579 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.777442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcshn\" (UniqueName: \"kubernetes.io/projected/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-kube-api-access-tcshn\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.778052 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.778028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-oauth-serving-cert\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.778155 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.778079 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-config\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.778155 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.778106 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-service-ca\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.778466 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.778430 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-trusted-ca-bundle\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.779894 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.779868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-oauth-config\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.779968 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.779956 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-serving-cert\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.793974 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.793956 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcshn\" (UniqueName: \"kubernetes.io/projected/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-kube-api-access-tcshn\") pod \"console-5fbcbcc589-nkr76\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:43.893112 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:43.893059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:44.018307 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:44.018282 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbcbcc589-nkr76"] Jul 07 14:04:44.020804 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:04:44.020779 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0522406c_8a2e_45fb_abd0_fa52ab3e8f77.slice/crio-1e18521fa13874a4b239a9d70f5b9fc7785539e6a03ad64044fa37e7068c8e8f WatchSource:0}: Error finding container 1e18521fa13874a4b239a9d70f5b9fc7785539e6a03ad64044fa37e7068c8e8f: Status 404 returned error can't find the container with id 1e18521fa13874a4b239a9d70f5b9fc7785539e6a03ad64044fa37e7068c8e8f Jul 07 14:04:44.243313 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:44.243236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbcbcc589-nkr76" event={"ID":"0522406c-8a2e-45fb-abd0-fa52ab3e8f77","Type":"ContainerStarted","Data":"ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b"} Jul 07 14:04:44.243313 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:44.243280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbcbcc589-nkr76" event={"ID":"0522406c-8a2e-45fb-abd0-fa52ab3e8f77","Type":"ContainerStarted","Data":"1e18521fa13874a4b239a9d70f5b9fc7785539e6a03ad64044fa37e7068c8e8f"} Jul 07 14:04:44.263386 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:44.263336 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fbcbcc589-nkr76" podStartSLOduration=1.263322013 podStartE2EDuration="1.263322013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:44.262649763 +0000 UTC m=+171.388543472" watchObservedRunningTime="2026-07-07 14:04:44.263322013 +0000 UTC m=+171.389215723" Jul 07 14:04:53.894082 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:53.894053 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:53.894459 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:53.894144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:53.898644 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:53.898624 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:54.289907 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:54.289888 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:04:54.357754 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:04:54.357525 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-849f8f4f8f-w86hv"] Jul 07 14:05:19.378720 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.378657 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-849f8f4f8f-w86hv" podUID="73c29b49-f957-4c32-90d1-51882716280b" containerName="console" containerID="cri-o://cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767" gracePeriod=15 Jul 07 14:05:19.628911 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.628849 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:05:19.738431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738382 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-serving-cert\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.738431 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738433 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-trusted-ca-bundle\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.738688 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738460 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-oauth-config\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.738688 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738485 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-console-config\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.738688 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738506 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-oauth-serving-cert\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.738688 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738536 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phdbm\" (UniqueName: \"kubernetes.io/projected/73c29b49-f957-4c32-90d1-51882716280b-kube-api-access-phdbm\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.738688 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738562 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-service-ca\") pod \"73c29b49-f957-4c32-90d1-51882716280b\" (UID: \"73c29b49-f957-4c32-90d1-51882716280b\") " Jul 07 14:05:19.739015 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.738973 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-console-config" (OuterVolumeSpecName: "console-config") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:05:19.739075 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.739024 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:05:19.739217 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.739159 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-service-ca" (OuterVolumeSpecName: "service-ca") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:05:19.739350 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.739237 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:05:19.740685 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.740657 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:05:19.740770 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.740692 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:05:19.740770 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.740742 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73c29b49-f957-4c32-90d1-51882716280b-kube-api-access-phdbm" (OuterVolumeSpecName: "kube-api-access-phdbm") pod "73c29b49-f957-4c32-90d1-51882716280b" (UID: "73c29b49-f957-4c32-90d1-51882716280b"). InnerVolumeSpecName "kube-api-access-phdbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:05:19.839872 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839827 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:19.839872 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839868 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:19.839872 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839878 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:19.839872 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839887 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phdbm\" (UniqueName: \"kubernetes.io/projected/73c29b49-f957-4c32-90d1-51882716280b-kube-api-access-phdbm\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:19.840133 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839897 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:19.840133 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839906 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73c29b49-f957-4c32-90d1-51882716280b-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:19.840133 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:19.839914 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73c29b49-f957-4c32-90d1-51882716280b-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:05:20.389396 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.389364 2580 generic.go:356] "Generic (PLEG): container finished" podID="73c29b49-f957-4c32-90d1-51882716280b" containerID="cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767" exitCode=0 Jul 07 14:05:20.389792 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.389406 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849f8f4f8f-w86hv" Jul 07 14:05:20.389792 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.389453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849f8f4f8f-w86hv" event={"ID":"73c29b49-f957-4c32-90d1-51882716280b","Type":"ContainerDied","Data":"cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767"} Jul 07 14:05:20.389792 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.389506 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849f8f4f8f-w86hv" event={"ID":"73c29b49-f957-4c32-90d1-51882716280b","Type":"ContainerDied","Data":"e7a3f118e46862df8c1c053c721663980ddd02e49e628929412890f7e4f08dcd"} Jul 07 14:05:20.389792 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.389527 2580 scope.go:117] "RemoveContainer" containerID="cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767" Jul 07 14:05:20.398438 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.398417 2580 scope.go:117] "RemoveContainer" containerID="cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767" Jul 07 14:05:20.398691 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:05:20.398675 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767\": container with ID starting with cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767 not found: ID does not exist" containerID="cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767" Jul 07 14:05:20.398755 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.398704 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767"} err="failed to get container status \"cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767\": rpc error: code = NotFound desc = could not find container \"cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767\": container with ID starting with cb0b9b9ebc8c76da27cb4b116ade554799d56fdaa78d6dcaf87c7d710e6f5767 not found: ID does not exist" Jul 07 14:05:20.411912 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.411884 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-849f8f4f8f-w86hv"] Jul 07 14:05:20.417649 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:20.417623 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-849f8f4f8f-w86hv"] Jul 07 14:05:21.468151 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:21.468119 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73c29b49-f957-4c32-90d1-51882716280b" path="/var/lib/kubelet/pods/73c29b49-f957-4c32-90d1-51882716280b/volumes" Jul 07 14:05:51.013678 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.013636 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6475dc8c85-g4vbz"] Jul 07 14:05:51.014137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.013964 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c29b49-f957-4c32-90d1-51882716280b" containerName="console" Jul 07 14:05:51.014137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.013977 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c29b49-f957-4c32-90d1-51882716280b" containerName="console" Jul 07 14:05:51.014137 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.014033 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="73c29b49-f957-4c32-90d1-51882716280b" containerName="console" Jul 07 14:05:51.016346 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.016325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.025563 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.025534 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6475dc8c85-g4vbz"] Jul 07 14:05:51.160342 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-serving-cert\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.160459 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-config\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.160459 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-oauth-serving-cert\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.160459 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzb9\" (UniqueName: \"kubernetes.io/projected/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-kube-api-access-mgzb9\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.160611 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-service-ca\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.160611 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-oauth-config\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.160686 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.160604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-trusted-ca-bundle\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.261795 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.261764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-config\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.261795 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.261799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-oauth-serving-cert\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.261966 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.261816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzb9\" (UniqueName: \"kubernetes.io/projected/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-kube-api-access-mgzb9\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.261966 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.261838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-service-ca\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.261966 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.261866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-oauth-config\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.262118 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.262072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-trusted-ca-bundle\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.262200 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.262142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-serving-cert\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.262605 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.262578 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-oauth-serving-cert\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.262718 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.262625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-config\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.262785 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.262760 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-service-ca\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.262926 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.262904 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-trusted-ca-bundle\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.264414 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.264361 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-oauth-config\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.264593 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.264575 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-serving-cert\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.270659 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.270639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzb9\" (UniqueName: \"kubernetes.io/projected/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-kube-api-access-mgzb9\") pod \"console-6475dc8c85-g4vbz\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.325551 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.325526 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:05:51.453068 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.453043 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6475dc8c85-g4vbz"] Jul 07 14:05:51.455679 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:05:51.455650 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb2ee32_b57f_4c56_a98d_75ee7f7f2fcf.slice/crio-1dbbfea0b16cebd62137bee9e5b8de768d1496b8161a4032bf7380a44dd83587 WatchSource:0}: Error finding container 1dbbfea0b16cebd62137bee9e5b8de768d1496b8161a4032bf7380a44dd83587: Status 404 returned error can't find the container with id 1dbbfea0b16cebd62137bee9e5b8de768d1496b8161a4032bf7380a44dd83587 Jul 07 14:05:51.509887 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:51.509859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475dc8c85-g4vbz" event={"ID":"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf","Type":"ContainerStarted","Data":"1dbbfea0b16cebd62137bee9e5b8de768d1496b8161a4032bf7380a44dd83587"} Jul 07 14:05:52.515408 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:52.515373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475dc8c85-g4vbz" event={"ID":"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf","Type":"ContainerStarted","Data":"db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0"} Jul 07 14:05:52.530788 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:05:52.530721 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6475dc8c85-g4vbz" podStartSLOduration=2.530708957 podStartE2EDuration="2.530708957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:05:52.530374721 +0000 UTC m=+239.656268433" watchObservedRunningTime="2026-07-07 14:05:52.530708957 +0000 UTC m=+239.656602667" Jul 07 14:06:01.325871 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:01.325837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:06:01.326266 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:01.325898 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:06:01.330576 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:01.330553 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:06:01.552529 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:01.552499 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:06:01.610613 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:01.610537 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbcbcc589-nkr76"] Jul 07 14:06:26.632244 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:26.632123 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fbcbcc589-nkr76" podUID="0522406c-8a2e-45fb-abd0-fa52ab3e8f77" containerName="console" containerID="cri-o://ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b" gracePeriod=15 Jul 07 14:06:26.866400 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:26.866378 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:06:27.008794 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.008764 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-oauth-serving-cert\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.008934 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.008808 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-service-ca\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.008934 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.008834 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-oauth-config\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.008997 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.008941 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-serving-cert\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.009033 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.009001 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcshn\" (UniqueName: \"kubernetes.io/projected/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-kube-api-access-tcshn\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.009033 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.009026 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-config\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.009116 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.009054 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-trusted-ca-bundle\") pod \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\" (UID: \"0522406c-8a2e-45fb-abd0-fa52ab3e8f77\") " Jul 07 14:06:27.009360 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.009316 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-service-ca" (OuterVolumeSpecName: "service-ca") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:27.009360 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.009316 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:27.009862 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.009829 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-config" (OuterVolumeSpecName: "console-config") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:27.010170 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.010139 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:27.011227 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.011163 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:06:27.012425 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.012363 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:06:27.016119 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.012608 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-kube-api-access-tcshn" (OuterVolumeSpecName: "kube-api-access-tcshn") pod "0522406c-8a2e-45fb-abd0-fa52ab3e8f77" (UID: "0522406c-8a2e-45fb-abd0-fa52ab3e8f77"). InnerVolumeSpecName "kube-api-access-tcshn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:06:27.110079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110057 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcshn\" (UniqueName: \"kubernetes.io/projected/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-kube-api-access-tcshn\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.110079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110078 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.110224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110088 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.110224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110097 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.110224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110105 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.110224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110113 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.110224 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.110121 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0522406c-8a2e-45fb-abd0-fa52ab3e8f77-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:06:27.642417 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.642381 2580 generic.go:356] "Generic (PLEG): container finished" podID="0522406c-8a2e-45fb-abd0-fa52ab3e8f77" containerID="ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b" exitCode=0 Jul 07 14:06:27.642814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.642433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbcbcc589-nkr76" event={"ID":"0522406c-8a2e-45fb-abd0-fa52ab3e8f77","Type":"ContainerDied","Data":"ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b"} Jul 07 14:06:27.642814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.642455 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbcbcc589-nkr76" Jul 07 14:06:27.642814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.642474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbcbcc589-nkr76" event={"ID":"0522406c-8a2e-45fb-abd0-fa52ab3e8f77","Type":"ContainerDied","Data":"1e18521fa13874a4b239a9d70f5b9fc7785539e6a03ad64044fa37e7068c8e8f"} Jul 07 14:06:27.642814 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.642494 2580 scope.go:117] "RemoveContainer" containerID="ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b" Jul 07 14:06:27.651295 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.651276 2580 scope.go:117] "RemoveContainer" containerID="ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b" Jul 07 14:06:27.651574 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:06:27.651551 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b\": container with ID starting with ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b not found: ID does not exist" containerID="ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b" Jul 07 14:06:27.651642 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.651582 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b"} err="failed to get container status \"ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b\": rpc error: code = NotFound desc = could not find container \"ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b\": container with ID starting with ce96c8757a59979ecb2fdd7460cefc579ae3a0758532ab58b8aff808ac37b14b not found: ID does not exist" Jul 07 14:06:27.658870 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.658843 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbcbcc589-nkr76"] Jul 07 14:06:27.662435 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:27.662412 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fbcbcc589-nkr76"] Jul 07 14:06:29.467901 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:29.467854 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0522406c-8a2e-45fb-abd0-fa52ab3e8f77" path="/var/lib/kubelet/pods/0522406c-8a2e-45fb-abd0-fa52ab3e8f77/volumes" Jul 07 14:06:53.286673 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:53.286637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:06:53.290351 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:53.290325 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:06:53.296088 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:06:53.296065 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:07:30.906443 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.906410 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh"] Jul 07 14:07:30.908599 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.906692 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0522406c-8a2e-45fb-abd0-fa52ab3e8f77" containerName="console" Jul 07 14:07:30.908599 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.906702 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0522406c-8a2e-45fb-abd0-fa52ab3e8f77" containerName="console" Jul 07 14:07:30.908599 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.906754 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0522406c-8a2e-45fb-abd0-fa52ab3e8f77" containerName="console" Jul 07 14:07:30.909743 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.909727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:30.913132 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.913110 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:07:30.913277 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.913250 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:07:30.914221 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.914207 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-28xdx\"" Jul 07 14:07:30.932115 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.932096 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh"] Jul 07 14:07:30.933833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.933810 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkt78\" (UniqueName: \"kubernetes.io/projected/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-kube-api-access-vkt78\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:30.933942 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.933845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:30.933942 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:30.933881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.034942 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.034921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkt78\" (UniqueName: \"kubernetes.io/projected/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-kube-api-access-vkt78\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.035045 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.034954 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.035045 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.034979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.035314 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.035295 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.035357 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.035319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.044527 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.044497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkt78\" (UniqueName: \"kubernetes.io/projected/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-kube-api-access-vkt78\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.218444 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.218394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:31.345127 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.345097 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh"] Jul 07 14:07:31.347619 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:07:31.347591 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f53b1c_bd63_40f6_9ec1_da22ec35edbc.slice/crio-95ed73a6d7458f8587cf7875e41ad5cbd6d88978062ea7b399e2b2d85d6f8fd6 WatchSource:0}: Error finding container 95ed73a6d7458f8587cf7875e41ad5cbd6d88978062ea7b399e2b2d85d6f8fd6: Status 404 returned error can't find the container with id 95ed73a6d7458f8587cf7875e41ad5cbd6d88978062ea7b399e2b2d85d6f8fd6 Jul 07 14:07:31.349591 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.349576 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:07:31.881311 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:31.881279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" event={"ID":"30f53b1c-bd63-40f6-9ec1-da22ec35edbc","Type":"ContainerStarted","Data":"95ed73a6d7458f8587cf7875e41ad5cbd6d88978062ea7b399e2b2d85d6f8fd6"} Jul 07 14:07:38.912876 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:38.912846 2580 generic.go:356] "Generic (PLEG): container finished" podID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerID="2a662cedac0bb0779234245596fb197082ceb743aa75ae364ab03534b4c88658" exitCode=0 Jul 07 14:07:38.913253 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:38.912883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" event={"ID":"30f53b1c-bd63-40f6-9ec1-da22ec35edbc","Type":"ContainerDied","Data":"2a662cedac0bb0779234245596fb197082ceb743aa75ae364ab03534b4c88658"} Jul 07 14:07:41.927015 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:41.926977 2580 generic.go:356] "Generic (PLEG): container finished" podID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerID="f4b3d7531e155d06be3b1d4f7dcdf26664ea70826f4b4f474b4f3cc877b5cd9e" exitCode=0 Jul 07 14:07:41.927412 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:41.927063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" event={"ID":"30f53b1c-bd63-40f6-9ec1-da22ec35edbc","Type":"ContainerDied","Data":"f4b3d7531e155d06be3b1d4f7dcdf26664ea70826f4b4f474b4f3cc877b5cd9e"} Jul 07 14:07:50.969815 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:50.969744 2580 generic.go:356] "Generic (PLEG): container finished" podID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerID="b52ce085ba7e8039d12d91742f6d7d5e6ba364fea2b71ea762c870ae620cfeed" exitCode=0 Jul 07 14:07:50.969815 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:50.969799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" event={"ID":"30f53b1c-bd63-40f6-9ec1-da22ec35edbc","Type":"ContainerDied","Data":"b52ce085ba7e8039d12d91742f6d7d5e6ba364fea2b71ea762c870ae620cfeed"} Jul 07 14:07:52.095833 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.095810 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:52.202665 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.202627 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-bundle\") pod \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " Jul 07 14:07:52.202859 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.202709 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-util\") pod \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " Jul 07 14:07:52.202859 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.202765 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkt78\" (UniqueName: \"kubernetes.io/projected/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-kube-api-access-vkt78\") pod \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\" (UID: \"30f53b1c-bd63-40f6-9ec1-da22ec35edbc\") " Jul 07 14:07:52.203272 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.203245 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-bundle" (OuterVolumeSpecName: "bundle") pod "30f53b1c-bd63-40f6-9ec1-da22ec35edbc" (UID: "30f53b1c-bd63-40f6-9ec1-da22ec35edbc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:07:52.204876 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.204850 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-kube-api-access-vkt78" (OuterVolumeSpecName: "kube-api-access-vkt78") pod "30f53b1c-bd63-40f6-9ec1-da22ec35edbc" (UID: "30f53b1c-bd63-40f6-9ec1-da22ec35edbc"). InnerVolumeSpecName "kube-api-access-vkt78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:07:52.208090 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.208066 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-util" (OuterVolumeSpecName: "util") pod "30f53b1c-bd63-40f6-9ec1-da22ec35edbc" (UID: "30f53b1c-bd63-40f6-9ec1-da22ec35edbc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:07:52.303941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.303915 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-util\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:07:52.303941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.303939 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkt78\" (UniqueName: \"kubernetes.io/projected/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-kube-api-access-vkt78\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:07:52.304072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.303954 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30f53b1c-bd63-40f6-9ec1-da22ec35edbc-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:07:52.979318 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.979282 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" event={"ID":"30f53b1c-bd63-40f6-9ec1-da22ec35edbc","Type":"ContainerDied","Data":"95ed73a6d7458f8587cf7875e41ad5cbd6d88978062ea7b399e2b2d85d6f8fd6"} Jul 07 14:07:52.979466 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.979329 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95ed73a6d7458f8587cf7875e41ad5cbd6d88978062ea7b399e2b2d85d6f8fd6" Jul 07 14:07:52.979466 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:52.979293 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5cvpnh" Jul 07 14:07:57.960422 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960388 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx"] Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960650 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="util" Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960660 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="util" Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960669 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="extract" Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960674 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="extract" Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960695 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="pull" Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960702 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="pull" Jul 07 14:07:57.960841 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.960748 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f53b1c-bd63-40f6-9ec1-da22ec35edbc" containerName="extract" Jul 07 14:07:57.964447 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.964429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:57.967158 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.967138 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 14:07:57.967158 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.967149 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bdx66\"" Jul 07 14:07:57.967309 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.967196 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:07:57.978235 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:57.978213 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx"] Jul 07 14:07:58.042321 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.042296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2d7967-1e63-4c61-8755-471a2e01ecae-tmp\") pod \"cert-manager-operator-controller-manager-6f76f69cbd-8p5lx\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.042418 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.042333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kng7z\" (UniqueName: \"kubernetes.io/projected/9d2d7967-1e63-4c61-8755-471a2e01ecae-kube-api-access-kng7z\") pod \"cert-manager-operator-controller-manager-6f76f69cbd-8p5lx\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.142796 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.142775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2d7967-1e63-4c61-8755-471a2e01ecae-tmp\") pod \"cert-manager-operator-controller-manager-6f76f69cbd-8p5lx\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.142912 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.142812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kng7z\" (UniqueName: \"kubernetes.io/projected/9d2d7967-1e63-4c61-8755-471a2e01ecae-kube-api-access-kng7z\") pod \"cert-manager-operator-controller-manager-6f76f69cbd-8p5lx\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.143128 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.143111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2d7967-1e63-4c61-8755-471a2e01ecae-tmp\") pod \"cert-manager-operator-controller-manager-6f76f69cbd-8p5lx\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.156200 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.156150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kng7z\" (UniqueName: \"kubernetes.io/projected/9d2d7967-1e63-4c61-8755-471a2e01ecae-kube-api-access-kng7z\") pod \"cert-manager-operator-controller-manager-6f76f69cbd-8p5lx\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.273120 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.273097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:07:58.400765 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:58.400739 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx"] Jul 07 14:07:58.403561 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:07:58.403530 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2d7967_1e63_4c61_8755_471a2e01ecae.slice/crio-282ddbe581cb56971a6ba6ef04b7693870429c6b36e090811652957b7c8c0439 WatchSource:0}: Error finding container 282ddbe581cb56971a6ba6ef04b7693870429c6b36e090811652957b7c8c0439: Status 404 returned error can't find the container with id 282ddbe581cb56971a6ba6ef04b7693870429c6b36e090811652957b7c8c0439 Jul 07 14:07:59.003492 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.003459 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" event={"ID":"9d2d7967-1e63-4c61-8755-471a2e01ecae","Type":"ContainerStarted","Data":"282ddbe581cb56971a6ba6ef04b7693870429c6b36e090811652957b7c8c0439"} Jul 07 14:07:59.452539 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.452462 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8"] Jul 07 14:07:59.455520 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.455501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.457907 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.457882 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:07:59.458512 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.458493 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:07:59.458610 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.458493 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-28xdx\"" Jul 07 14:07:59.471445 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.471423 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8"] Jul 07 14:07:59.555843 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.555812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.555983 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.555893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.555983 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.555920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp2g4\" (UniqueName: \"kubernetes.io/projected/8b0418ff-3181-4315-a3ba-3d9d346c0247-kube-api-access-vp2g4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.657327 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.657293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.657327 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.657330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp2g4\" (UniqueName: \"kubernetes.io/projected/8b0418ff-3181-4315-a3ba-3d9d346c0247-kube-api-access-vp2g4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.657516 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.657387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.657731 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.657700 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.657846 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.657746 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.665969 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.665943 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp2g4\" (UniqueName: \"kubernetes.io/projected/8b0418ff-3181-4315-a3ba-3d9d346c0247-kube-api-access-vp2g4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:07:59.767374 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:07:59.767345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:08:00.050549 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.050469 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92"] Jul 07 14:08:00.053056 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.053035 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.063080 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.063057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92"] Jul 07 14:08:00.162145 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.162105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.162313 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.162217 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.162313 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.162280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8264h\" (UniqueName: \"kubernetes.io/projected/c7f3886e-b1d6-430c-8181-e462db7a1e50-kube-api-access-8264h\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.262935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.262909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.263039 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.262955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.263039 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.262987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8264h\" (UniqueName: \"kubernetes.io/projected/c7f3886e-b1d6-430c-8181-e462db7a1e50-kube-api-access-8264h\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.263673 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.263553 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.263673 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.263565 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.272948 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.272926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8264h\" (UniqueName: \"kubernetes.io/projected/c7f3886e-b1d6-430c-8181-e462db7a1e50-kube-api-access-8264h\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.344012 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.343977 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8"] Jul 07 14:08:00.348025 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:08:00.348002 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0418ff_3181_4315_a3ba_3d9d346c0247.slice/crio-8acdffb5dc46be003e345cb892e11f89784ea80581df4d274dfd61ee149ff8d5 WatchSource:0}: Error finding container 8acdffb5dc46be003e345cb892e11f89784ea80581df4d274dfd61ee149ff8d5: Status 404 returned error can't find the container with id 8acdffb5dc46be003e345cb892e11f89784ea80581df4d274dfd61ee149ff8d5 Jul 07 14:08:00.364812 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.364792 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:00.508772 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:00.508754 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92"] Jul 07 14:08:00.510697 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:08:00.510672 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f3886e_b1d6_430c_8181_e462db7a1e50.slice/crio-aee0464177f46f3c8660d1a12d1d230e8d00adabe61f1189671c6f7aad2dc558 WatchSource:0}: Error finding container aee0464177f46f3c8660d1a12d1d230e8d00adabe61f1189671c6f7aad2dc558: Status 404 returned error can't find the container with id aee0464177f46f3c8660d1a12d1d230e8d00adabe61f1189671c6f7aad2dc558 Jul 07 14:08:01.013300 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.013269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" event={"ID":"9d2d7967-1e63-4c61-8755-471a2e01ecae","Type":"ContainerStarted","Data":"5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706"} Jul 07 14:08:01.014781 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.014755 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerID="95ebfc571848e221d2f3cca993ffda87d4c8db07fe3304172a33ae526970d9e2" exitCode=0 Jul 07 14:08:01.014909 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.014840 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" event={"ID":"8b0418ff-3181-4315-a3ba-3d9d346c0247","Type":"ContainerDied","Data":"95ebfc571848e221d2f3cca993ffda87d4c8db07fe3304172a33ae526970d9e2"} Jul 07 14:08:01.014909 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.014876 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" event={"ID":"8b0418ff-3181-4315-a3ba-3d9d346c0247","Type":"ContainerStarted","Data":"8acdffb5dc46be003e345cb892e11f89784ea80581df4d274dfd61ee149ff8d5"} Jul 07 14:08:01.016468 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.016449 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerID="6739e2d22b8121195923901d425169c03d731319d11ce6f3e7ddc666cd0d7ba2" exitCode=0 Jul 07 14:08:01.016558 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.016494 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" event={"ID":"c7f3886e-b1d6-430c-8181-e462db7a1e50","Type":"ContainerDied","Data":"6739e2d22b8121195923901d425169c03d731319d11ce6f3e7ddc666cd0d7ba2"} Jul 07 14:08:01.016558 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.016523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" event={"ID":"c7f3886e-b1d6-430c-8181-e462db7a1e50","Type":"ContainerStarted","Data":"aee0464177f46f3c8660d1a12d1d230e8d00adabe61f1189671c6f7aad2dc558"} Jul 07 14:08:01.032131 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:01.032094 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" podStartSLOduration=2.18741866 podStartE2EDuration="4.032082574s" totalImagesPullingTime="1.844663914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:01.031272827 +0000 UTC m=+368.157166557" watchObservedRunningTime="2026-07-07 14:08:01.032082574 +0000 UTC m=+368.157976283" Jul 07 14:08:04.032588 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:04.032558 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerID="b98ec59916c9c2f859ca76baec8ad805f6c8a02e0d08395549f25ba8f89b32eb" exitCode=0 Jul 07 14:08:04.032963 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:04.032645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" event={"ID":"c7f3886e-b1d6-430c-8181-e462db7a1e50","Type":"ContainerDied","Data":"b98ec59916c9c2f859ca76baec8ad805f6c8a02e0d08395549f25ba8f89b32eb"} Jul 07 14:08:04.034704 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:04.034679 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerID="df0f5e02f14a3ed52946691a236502b2cf326149b2005f8feddfa917d2a28e9a" exitCode=0 Jul 07 14:08:04.034831 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:04.034736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" event={"ID":"8b0418ff-3181-4315-a3ba-3d9d346c0247","Type":"ContainerDied","Data":"df0f5e02f14a3ed52946691a236502b2cf326149b2005f8feddfa917d2a28e9a"} Jul 07 14:08:05.042018 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:05.041984 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerID="ce3fc1e74a3de22fbd14a84c9ed708856a5c6499e2e127f5c28122b53cbb51a0" exitCode=0 Jul 07 14:08:05.042460 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:05.042075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" event={"ID":"c7f3886e-b1d6-430c-8181-e462db7a1e50","Type":"ContainerDied","Data":"ce3fc1e74a3de22fbd14a84c9ed708856a5c6499e2e127f5c28122b53cbb51a0"} Jul 07 14:08:05.044455 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:05.044425 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerID="2225efdb5f5f7296bc33d7c1df348ce68f43b50cfb9b64ae51f7edecbd0b74de" exitCode=0 Jul 07 14:08:05.044565 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:05.044503 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" event={"ID":"8b0418ff-3181-4315-a3ba-3d9d346c0247","Type":"ContainerDied","Data":"2225efdb5f5f7296bc33d7c1df348ce68f43b50cfb9b64ae51f7edecbd0b74de"} Jul 07 14:08:06.196335 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.196306 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:08:06.199253 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.199234 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:06.313321 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313258 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8264h\" (UniqueName: \"kubernetes.io/projected/c7f3886e-b1d6-430c-8181-e462db7a1e50-kube-api-access-8264h\") pod \"c7f3886e-b1d6-430c-8181-e462db7a1e50\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " Jul 07 14:08:06.313321 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313290 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-bundle\") pod \"8b0418ff-3181-4315-a3ba-3d9d346c0247\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " Jul 07 14:08:06.313488 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313336 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-util\") pod \"c7f3886e-b1d6-430c-8181-e462db7a1e50\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " Jul 07 14:08:06.313488 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313444 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-bundle\") pod \"c7f3886e-b1d6-430c-8181-e462db7a1e50\" (UID: \"c7f3886e-b1d6-430c-8181-e462db7a1e50\") " Jul 07 14:08:06.313593 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313508 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-util\") pod \"8b0418ff-3181-4315-a3ba-3d9d346c0247\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " Jul 07 14:08:06.313593 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313539 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp2g4\" (UniqueName: \"kubernetes.io/projected/8b0418ff-3181-4315-a3ba-3d9d346c0247-kube-api-access-vp2g4\") pod \"8b0418ff-3181-4315-a3ba-3d9d346c0247\" (UID: \"8b0418ff-3181-4315-a3ba-3d9d346c0247\") " Jul 07 14:08:06.313780 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.313758 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-bundle" (OuterVolumeSpecName: "bundle") pod "8b0418ff-3181-4315-a3ba-3d9d346c0247" (UID: "8b0418ff-3181-4315-a3ba-3d9d346c0247"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:06.314133 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.314111 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-bundle" (OuterVolumeSpecName: "bundle") pod "c7f3886e-b1d6-430c-8181-e462db7a1e50" (UID: "c7f3886e-b1d6-430c-8181-e462db7a1e50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:06.315619 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.315594 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0418ff-3181-4315-a3ba-3d9d346c0247-kube-api-access-vp2g4" (OuterVolumeSpecName: "kube-api-access-vp2g4") pod "8b0418ff-3181-4315-a3ba-3d9d346c0247" (UID: "8b0418ff-3181-4315-a3ba-3d9d346c0247"). InnerVolumeSpecName "kube-api-access-vp2g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:06.315954 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.315929 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f3886e-b1d6-430c-8181-e462db7a1e50-kube-api-access-8264h" (OuterVolumeSpecName: "kube-api-access-8264h") pod "c7f3886e-b1d6-430c-8181-e462db7a1e50" (UID: "c7f3886e-b1d6-430c-8181-e462db7a1e50"). InnerVolumeSpecName "kube-api-access-8264h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:06.318656 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.318617 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-util" (OuterVolumeSpecName: "util") pod "c7f3886e-b1d6-430c-8181-e462db7a1e50" (UID: "c7f3886e-b1d6-430c-8181-e462db7a1e50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:06.320647 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.320619 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-util" (OuterVolumeSpecName: "util") pod "8b0418ff-3181-4315-a3ba-3d9d346c0247" (UID: "8b0418ff-3181-4315-a3ba-3d9d346c0247"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:06.414952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.414930 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-util\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:06.414952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.414953 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7f3886e-b1d6-430c-8181-e462db7a1e50-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:06.415079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.414962 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-util\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:06.415079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.414969 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp2g4\" (UniqueName: \"kubernetes.io/projected/8b0418ff-3181-4315-a3ba-3d9d346c0247-kube-api-access-vp2g4\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:06.415079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.414980 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8264h\" (UniqueName: \"kubernetes.io/projected/c7f3886e-b1d6-430c-8181-e462db7a1e50-kube-api-access-8264h\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:06.415079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:06.414987 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b0418ff-3181-4315-a3ba-3d9d346c0247-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:07.055987 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:07.055959 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" Jul 07 14:08:07.055987 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:07.055979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5ptd8" event={"ID":"8b0418ff-3181-4315-a3ba-3d9d346c0247","Type":"ContainerDied","Data":"8acdffb5dc46be003e345cb892e11f89784ea80581df4d274dfd61ee149ff8d5"} Jul 07 14:08:07.056159 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:07.056023 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8acdffb5dc46be003e345cb892e11f89784ea80581df4d274dfd61ee149ff8d5" Jul 07 14:08:07.057912 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:07.057896 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" Jul 07 14:08:07.058022 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:07.057897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm6p92" event={"ID":"c7f3886e-b1d6-430c-8181-e462db7a1e50","Type":"ContainerDied","Data":"aee0464177f46f3c8660d1a12d1d230e8d00adabe61f1189671c6f7aad2dc558"} Jul 07 14:08:07.058022 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:07.058004 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aee0464177f46f3c8660d1a12d1d230e8d00adabe61f1189671c6f7aad2dc558" Jul 07 14:08:14.554724 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.554681 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77"] Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555106 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="extract" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555124 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="extract" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555139 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="extract" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555147 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="extract" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555170 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="util" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555206 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="util" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555221 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="pull" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555229 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="pull" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555237 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="pull" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555243 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="pull" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555253 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="util" Jul 07 14:08:14.555255 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555260 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="util" Jul 07 14:08:14.555816 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555342 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0418ff-3181-4315-a3ba-3d9d346c0247" containerName="extract" Jul 07 14:08:14.555816 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.555354 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f3886e-b1d6-430c-8181-e462db7a1e50" containerName="extract" Jul 07 14:08:14.558281 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.558259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.578062 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.578035 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77"] Jul 07 14:08:14.669749 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.669728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-h8z77\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.669863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.669757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kdt\" (UniqueName: \"kubernetes.io/projected/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-kube-api-access-k9kdt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-h8z77\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.770855 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.770828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-h8z77\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.770941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.770859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kdt\" (UniqueName: \"kubernetes.io/projected/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-kube-api-access-k9kdt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-h8z77\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.771312 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.771295 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-h8z77\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.781410 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.781389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kdt\" (UniqueName: \"kubernetes.io/projected/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-kube-api-access-k9kdt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-h8z77\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.867892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.867842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:14.997400 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:14.997372 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77"] Jul 07 14:08:15.000059 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:08:15.000032 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013a9aee_9ed3_4b40_bc41_d0e3c5a5ed28.slice/crio-5666f30a47772a7882fe14bb9d1fb951dde2f7488e438226333fd44ca4c14c73 WatchSource:0}: Error finding container 5666f30a47772a7882fe14bb9d1fb951dde2f7488e438226333fd44ca4c14c73: Status 404 returned error can't find the container with id 5666f30a47772a7882fe14bb9d1fb951dde2f7488e438226333fd44ca4c14c73 Jul 07 14:08:15.093986 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:15.093958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" event={"ID":"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28","Type":"ContainerStarted","Data":"5666f30a47772a7882fe14bb9d1fb951dde2f7488e438226333fd44ca4c14c73"} Jul 07 14:08:18.109942 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.109907 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" event={"ID":"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28","Type":"ContainerStarted","Data":"6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9"} Jul 07 14:08:18.140634 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.140591 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" podStartSLOduration=2.069281044 podStartE2EDuration="4.140575699s" totalImagesPullingTime="2.071294655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:18.137941967 +0000 UTC m=+385.263835703" watchObservedRunningTime="2026-07-07 14:08:18.140575699 +0000 UTC m=+385.266469409" Jul 07 14:08:18.176077 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.176046 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx"] Jul 07 14:08:18.176263 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.176243 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" podUID="9d2d7967-1e63-4c61-8755-471a2e01ecae" containerName="cert-manager-operator" containerID="cri-o://5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706" gracePeriod=10 Jul 07 14:08:18.451103 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.451077 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:08:18.598336 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.598309 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2d7967-1e63-4c61-8755-471a2e01ecae-tmp\") pod \"9d2d7967-1e63-4c61-8755-471a2e01ecae\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " Jul 07 14:08:18.598464 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.598432 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kng7z\" (UniqueName: \"kubernetes.io/projected/9d2d7967-1e63-4c61-8755-471a2e01ecae-kube-api-access-kng7z\") pod \"9d2d7967-1e63-4c61-8755-471a2e01ecae\" (UID: \"9d2d7967-1e63-4c61-8755-471a2e01ecae\") " Jul 07 14:08:18.598719 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.598699 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2d7967-1e63-4c61-8755-471a2e01ecae-tmp" (OuterVolumeSpecName: "tmp") pod "9d2d7967-1e63-4c61-8755-471a2e01ecae" (UID: "9d2d7967-1e63-4c61-8755-471a2e01ecae"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:18.600528 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.600507 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2d7967-1e63-4c61-8755-471a2e01ecae-kube-api-access-kng7z" (OuterVolumeSpecName: "kube-api-access-kng7z") pod "9d2d7967-1e63-4c61-8755-471a2e01ecae" (UID: "9d2d7967-1e63-4c61-8755-471a2e01ecae"). InnerVolumeSpecName "kube-api-access-kng7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:18.699218 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.699148 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kng7z\" (UniqueName: \"kubernetes.io/projected/9d2d7967-1e63-4c61-8755-471a2e01ecae-kube-api-access-kng7z\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:18.699218 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:18.699167 2580 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2d7967-1e63-4c61-8755-471a2e01ecae-tmp\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:19.115088 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.115052 2580 generic.go:356] "Generic (PLEG): container finished" podID="9d2d7967-1e63-4c61-8755-471a2e01ecae" containerID="5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706" exitCode=0 Jul 07 14:08:19.115581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.115098 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" Jul 07 14:08:19.115581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.115132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" event={"ID":"9d2d7967-1e63-4c61-8755-471a2e01ecae","Type":"ContainerDied","Data":"5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706"} Jul 07 14:08:19.115581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.115192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx" event={"ID":"9d2d7967-1e63-4c61-8755-471a2e01ecae","Type":"ContainerDied","Data":"282ddbe581cb56971a6ba6ef04b7693870429c6b36e090811652957b7c8c0439"} Jul 07 14:08:19.115581 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.115220 2580 scope.go:117] "RemoveContainer" containerID="5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706" Jul 07 14:08:19.123779 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.123763 2580 scope.go:117] "RemoveContainer" containerID="5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706" Jul 07 14:08:19.124026 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:08:19.124004 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706\": container with ID starting with 5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706 not found: ID does not exist" containerID="5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706" Jul 07 14:08:19.124079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.124034 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706"} err="failed to get container status \"5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706\": rpc error: code = NotFound desc = could not find container \"5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706\": container with ID starting with 5cc6b6f3b20852d54ef9b9cca5b59d28dde6da503e2f901e57da0123fb125706 not found: ID does not exist" Jul 07 14:08:19.140898 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.140877 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx"] Jul 07 14:08:19.156984 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.156965 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-6f76f69cbd-8p5lx"] Jul 07 14:08:19.468739 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.468682 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2d7967-1e63-4c61-8755-471a2e01ecae" path="/var/lib/kubelet/pods/9d2d7967-1e63-4c61-8755-471a2e01ecae/volumes" Jul 07 14:08:19.864408 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.864379 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm"] Jul 07 14:08:19.864672 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.864661 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2d7967-1e63-4c61-8755-471a2e01ecae" containerName="cert-manager-operator" Jul 07 14:08:19.864715 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.864673 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2d7967-1e63-4c61-8755-471a2e01ecae" containerName="cert-manager-operator" Jul 07 14:08:19.864748 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.864721 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2d7967-1e63-4c61-8755-471a2e01ecae" containerName="cert-manager-operator" Jul 07 14:08:19.897858 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.897837 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm"] Jul 07 14:08:19.897982 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.897928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:19.901677 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.901647 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-28xdx\"" Jul 07 14:08:19.901677 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.901646 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:08:19.902429 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:19.902416 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:08:20.007019 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.006996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwgw\" (UniqueName: \"kubernetes.io/projected/0c84582a-424b-4604-b45d-e9d3799c8225-kube-api-access-qhwgw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.007112 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.007035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.007153 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.007128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.107692 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.107659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.107779 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.107720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwgw\" (UniqueName: \"kubernetes.io/projected/0c84582a-424b-4604-b45d-e9d3799c8225-kube-api-access-qhwgw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.107779 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.107764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.108075 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.108055 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.108113 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.108071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.118738 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.118693 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwgw\" (UniqueName: \"kubernetes.io/projected/0c84582a-424b-4604-b45d-e9d3799c8225-kube-api-access-qhwgw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.207279 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.207257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:20.354770 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:20.354748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm"] Jul 07 14:08:20.357024 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:08:20.357000 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c84582a_424b_4604_b45d_e9d3799c8225.slice/crio-7ef11cd190fe4c79dd9304b23697a7b58d88b7c2b4fbca5938eb0e64bb287917 WatchSource:0}: Error finding container 7ef11cd190fe4c79dd9304b23697a7b58d88b7c2b4fbca5938eb0e64bb287917: Status 404 returned error can't find the container with id 7ef11cd190fe4c79dd9304b23697a7b58d88b7c2b4fbca5938eb0e64bb287917 Jul 07 14:08:21.126625 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:21.126596 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c84582a-424b-4604-b45d-e9d3799c8225" containerID="158521af4fa037e4b55b02fe8dc20c5adbdc372438a7efc2ae8088424e5cf0da" exitCode=0 Jul 07 14:08:21.126964 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:21.126666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" event={"ID":"0c84582a-424b-4604-b45d-e9d3799c8225","Type":"ContainerDied","Data":"158521af4fa037e4b55b02fe8dc20c5adbdc372438a7efc2ae8088424e5cf0da"} Jul 07 14:08:21.126964 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:21.126726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" event={"ID":"0c84582a-424b-4604-b45d-e9d3799c8225","Type":"ContainerStarted","Data":"7ef11cd190fe4c79dd9304b23697a7b58d88b7c2b4fbca5938eb0e64bb287917"} Jul 07 14:08:23.139584 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:23.139555 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c84582a-424b-4604-b45d-e9d3799c8225" containerID="3ef48fbee028a345369e17b7c30799b58e14f4de833f2a647b3ae9a755387c42" exitCode=0 Jul 07 14:08:23.139879 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:23.139620 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" event={"ID":"0c84582a-424b-4604-b45d-e9d3799c8225","Type":"ContainerDied","Data":"3ef48fbee028a345369e17b7c30799b58e14f4de833f2a647b3ae9a755387c42"} Jul 07 14:08:24.145335 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:24.145302 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c84582a-424b-4604-b45d-e9d3799c8225" containerID="2fac97ca81d1f2e814debc9ddfd0daa1ff4cecfd0f234f29b02a493076569bb7" exitCode=0 Jul 07 14:08:24.145744 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:24.145343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" event={"ID":"0c84582a-424b-4604-b45d-e9d3799c8225","Type":"ContainerDied","Data":"2fac97ca81d1f2e814debc9ddfd0daa1ff4cecfd0f234f29b02a493076569bb7"} Jul 07 14:08:25.279690 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.279668 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:25.448265 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.448205 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-bundle\") pod \"0c84582a-424b-4604-b45d-e9d3799c8225\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " Jul 07 14:08:25.448265 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.448252 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhwgw\" (UniqueName: \"kubernetes.io/projected/0c84582a-424b-4604-b45d-e9d3799c8225-kube-api-access-qhwgw\") pod \"0c84582a-424b-4604-b45d-e9d3799c8225\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " Jul 07 14:08:25.448406 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.448285 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-util\") pod \"0c84582a-424b-4604-b45d-e9d3799c8225\" (UID: \"0c84582a-424b-4604-b45d-e9d3799c8225\") " Jul 07 14:08:25.448983 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.448956 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-bundle" (OuterVolumeSpecName: "bundle") pod "0c84582a-424b-4604-b45d-e9d3799c8225" (UID: "0c84582a-424b-4604-b45d-e9d3799c8225"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:25.450282 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.450257 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c84582a-424b-4604-b45d-e9d3799c8225-kube-api-access-qhwgw" (OuterVolumeSpecName: "kube-api-access-qhwgw") pod "0c84582a-424b-4604-b45d-e9d3799c8225" (UID: "0c84582a-424b-4604-b45d-e9d3799c8225"). InnerVolumeSpecName "kube-api-access-qhwgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:25.453807 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.453769 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-util" (OuterVolumeSpecName: "util") pod "0c84582a-424b-4604-b45d-e9d3799c8225" (UID: "0c84582a-424b-4604-b45d-e9d3799c8225"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:25.549662 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.549636 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:25.549662 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.549660 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhwgw\" (UniqueName: \"kubernetes.io/projected/0c84582a-424b-4604-b45d-e9d3799c8225-kube-api-access-qhwgw\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:25.549793 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:25.549674 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c84582a-424b-4604-b45d-e9d3799c8225-util\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:26.161943 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.161900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" event={"ID":"0c84582a-424b-4604-b45d-e9d3799c8225","Type":"ContainerDied","Data":"7ef11cd190fe4c79dd9304b23697a7b58d88b7c2b4fbca5938eb0e64bb287917"} Jul 07 14:08:26.162128 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.161982 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ef11cd190fe4c79dd9304b23697a7b58d88b7c2b4fbca5938eb0e64bb287917" Jul 07 14:08:26.162128 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.161912 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409rfqm" Jul 07 14:08:26.661610 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661584 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc"] Jul 07 14:08:26.661950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661871 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="extract" Jul 07 14:08:26.661950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661880 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="extract" Jul 07 14:08:26.661950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661891 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="pull" Jul 07 14:08:26.661950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661896 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="pull" Jul 07 14:08:26.661950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661906 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="util" Jul 07 14:08:26.661950 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661912 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="util" Jul 07 14:08:26.662131 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.661957 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c84582a-424b-4604-b45d-e9d3799c8225" containerName="extract" Jul 07 14:08:26.663988 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.663973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.666733 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.666695 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 14:08:26.666838 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.666767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 14:08:26.666838 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.666772 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 14:08:26.667013 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.666981 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 14:08:26.667013 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.666999 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jfxdz\"" Jul 07 14:08:26.675683 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.675663 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc"] Jul 07 14:08:26.757025 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.756997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.757135 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.757040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-cacerts\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.757135 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.757068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.757264 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.757131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-local-certs\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.757264 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.757157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxfjb\" (UniqueName: \"kubernetes.io/projected/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-kube-api-access-qxfjb\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.757264 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.757206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.757264 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.757225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-token\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.857921 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.857893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858036 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.857945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-cacerts\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858036 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.857979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858036 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.858016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-local-certs\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858238 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.858141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxfjb\" (UniqueName: \"kubernetes.io/projected/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-kube-api-access-qxfjb\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858238 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.858206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858346 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.858238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-token\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.858635 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.858608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.860545 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.860516 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-local-certs\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.860657 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.860582 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-cacerts\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.860729 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.860669 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.860729 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.860708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.866568 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.866545 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxfjb\" (UniqueName: \"kubernetes.io/projected/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-kube-api-access-qxfjb\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.866690 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.866567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc6f940a-d9bc-4f87-aded-df7e5c3b7a75-istio-token\") pod \"istiod-openshift-gateway-7574459656-fwxpc\" (UID: \"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:26.972766 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:26.972713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:27.102357 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:27.102331 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc"] Jul 07 14:08:27.104346 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:08:27.104321 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6f940a_d9bc_4f87_aded_df7e5c3b7a75.slice/crio-a677a93e83e3688d4890ab1f7f8aca68a0f080e7602d3b271283627aabe06ea9 WatchSource:0}: Error finding container a677a93e83e3688d4890ab1f7f8aca68a0f080e7602d3b271283627aabe06ea9: Status 404 returned error can't find the container with id a677a93e83e3688d4890ab1f7f8aca68a0f080e7602d3b271283627aabe06ea9 Jul 07 14:08:27.166868 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:27.166840 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" event={"ID":"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75","Type":"ContainerStarted","Data":"a677a93e83e3688d4890ab1f7f8aca68a0f080e7602d3b271283627aabe06ea9"} Jul 07 14:08:30.750408 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:30.750369 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:08:30.750729 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:30.750440 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:08:31.189741 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:31.189710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" event={"ID":"dc6f940a-d9bc-4f87-aded-df7e5c3b7a75","Type":"ContainerStarted","Data":"bc098a6002e38c4b90890f6357e574155dc75d0a6547b1e49eb09c6e467d81c7"} Jul 07 14:08:31.189935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:31.189862 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:31.191493 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:31.191470 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-fwxpc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:08:31.191621 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:31.191513 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" podUID="dc6f940a-d9bc-4f87-aded-df7e5c3b7a75" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:08:31.217400 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:31.217351 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" podStartSLOduration=1.574045861 podStartE2EDuration="5.21733579s" totalImagesPullingTime="3.643289929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:31.217139346 +0000 UTC m=+398.343033057" watchObservedRunningTime="2026-07-07 14:08:31.21733579 +0000 UTC m=+398.343229501" Jul 07 14:08:32.196304 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:32.196274 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fwxpc" Jul 07 14:08:40.730043 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:40.730009 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77"] Jul 07 14:08:40.730496 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:40.730218 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" podUID="013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" containerName="cert-manager-operator" containerID="cri-o://6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9" gracePeriod=10 Jul 07 14:08:40.966323 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:40.966299 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:41.063293 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.063268 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9kdt\" (UniqueName: \"kubernetes.io/projected/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-kube-api-access-k9kdt\") pod \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " Jul 07 14:08:41.063427 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.063345 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-tmp\") pod \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\" (UID: \"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28\") " Jul 07 14:08:41.063728 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.063708 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-tmp" (OuterVolumeSpecName: "tmp") pod "013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" (UID: "013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:08:41.065265 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.065243 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-kube-api-access-k9kdt" (OuterVolumeSpecName: "kube-api-access-k9kdt") pod "013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" (UID: "013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28"). InnerVolumeSpecName "kube-api-access-k9kdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:41.164729 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.164703 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9kdt\" (UniqueName: \"kubernetes.io/projected/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-kube-api-access-k9kdt\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:41.164729 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.164726 2580 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28-tmp\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:08:41.239953 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.239926 2580 generic.go:356] "Generic (PLEG): container finished" podID="013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" containerID="6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9" exitCode=0 Jul 07 14:08:41.240039 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.239967 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" Jul 07 14:08:41.240039 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.240009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" event={"ID":"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28","Type":"ContainerDied","Data":"6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9"} Jul 07 14:08:41.240125 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.240052 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77" event={"ID":"013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28","Type":"ContainerDied","Data":"5666f30a47772a7882fe14bb9d1fb951dde2f7488e438226333fd44ca4c14c73"} Jul 07 14:08:41.240125 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.240072 2580 scope.go:117] "RemoveContainer" containerID="6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9" Jul 07 14:08:41.249100 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.249085 2580 scope.go:117] "RemoveContainer" containerID="6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9" Jul 07 14:08:41.249384 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:08:41.249364 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9\": container with ID starting with 6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9 not found: ID does not exist" containerID="6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9" Jul 07 14:08:41.249450 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.249391 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9"} err="failed to get container status \"6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9\": rpc error: code = NotFound desc = could not find container \"6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9\": container with ID starting with 6ef55f92f786553fc125f6f58a7ce824e70362677f9f801ee2db457fcc9598d9 not found: ID does not exist" Jul 07 14:08:41.270409 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.270383 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77"] Jul 07 14:08:41.280072 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.280044 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-h8z77"] Jul 07 14:08:41.467457 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:08:41.467404 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" path="/var/lib/kubelet/pods/013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28/volumes" Jul 07 14:09:47.096977 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.096945 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f9b9f456-ztftp"] Jul 07 14:09:47.097516 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.097234 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" containerName="cert-manager-operator" Jul 07 14:09:47.097516 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.097246 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" containerName="cert-manager-operator" Jul 07 14:09:47.097516 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.097308 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="013a9aee-9ed3-4b40-bc41-d0e3c5a5ed28" containerName="cert-manager-operator" Jul 07 14:09:47.099863 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.099847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.111050 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.111028 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f9b9f456-ztftp"] Jul 07 14:09:47.204396 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-oauth-config\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.204396 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-oauth-serving-cert\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.204602 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-service-ca\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.204602 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjn6w\" (UniqueName: \"kubernetes.io/projected/e729a5ab-7453-4ae4-aba9-2b5750cd500f-kube-api-access-zjn6w\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.204602 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-config\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.204602 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-serving-cert\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.204756 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.204633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-trusted-ca-bundle\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305146 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-service-ca\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305146 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjn6w\" (UniqueName: \"kubernetes.io/projected/e729a5ab-7453-4ae4-aba9-2b5750cd500f-kube-api-access-zjn6w\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-config\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-serving-cert\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-trusted-ca-bundle\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305297 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-oauth-config\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305495 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-oauth-serving-cert\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305926 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305899 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-service-ca\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.305926 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.305919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-config\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.306065 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.306026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-oauth-serving-cert\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.306065 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.306027 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e729a5ab-7453-4ae4-aba9-2b5750cd500f-trusted-ca-bundle\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.307762 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.307742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-oauth-config\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.307818 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.307777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e729a5ab-7453-4ae4-aba9-2b5750cd500f-console-serving-cert\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.315077 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.315059 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjn6w\" (UniqueName: \"kubernetes.io/projected/e729a5ab-7453-4ae4-aba9-2b5750cd500f-kube-api-access-zjn6w\") pod \"console-76f9b9f456-ztftp\" (UID: \"e729a5ab-7453-4ae4-aba9-2b5750cd500f\") " pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.408759 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.408701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:47.537945 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:47.537911 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f9b9f456-ztftp"] Jul 07 14:09:47.540230 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:09:47.540201 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode729a5ab_7453_4ae4_aba9_2b5750cd500f.slice/crio-eea5051e3c1402fdf3c07672dfdd44be760604bc49b4b1c1a6083b81da08bc51 WatchSource:0}: Error finding container eea5051e3c1402fdf3c07672dfdd44be760604bc49b4b1c1a6083b81da08bc51: Status 404 returned error can't find the container with id eea5051e3c1402fdf3c07672dfdd44be760604bc49b4b1c1a6083b81da08bc51 Jul 07 14:09:48.534712 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:48.534679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f9b9f456-ztftp" event={"ID":"e729a5ab-7453-4ae4-aba9-2b5750cd500f","Type":"ContainerStarted","Data":"16752fbbfc1484e30dbffd2e97b130fa1a2ccdfe5ccb07e1d7f8a8a98da8bd2b"} Jul 07 14:09:48.535079 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:48.534723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f9b9f456-ztftp" event={"ID":"e729a5ab-7453-4ae4-aba9-2b5750cd500f","Type":"ContainerStarted","Data":"eea5051e3c1402fdf3c07672dfdd44be760604bc49b4b1c1a6083b81da08bc51"} Jul 07 14:09:48.552880 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:48.552825 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f9b9f456-ztftp" podStartSLOduration=1.552811894 podStartE2EDuration="1.552811894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:48.550325749 +0000 UTC m=+475.676219461" watchObservedRunningTime="2026-07-07 14:09:48.552811894 +0000 UTC m=+475.678705604" Jul 07 14:09:57.409556 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:57.409523 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:57.410056 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:57.409578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:57.414503 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:57.414482 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:57.576782 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:57.576755 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f9b9f456-ztftp" Jul 07 14:09:57.624059 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:09:57.624030 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6475dc8c85-g4vbz"] Jul 07 14:10:11.806338 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.806288 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vm2cz/must-gather-s79n6"] Jul 07 14:10:11.809692 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.809677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:11.812025 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.812001 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vm2cz\"/\"openshift-service-ca.crt\"" Jul 07 14:10:11.812140 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.812082 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vm2cz\"/\"default-dockercfg-nqjqw\"" Jul 07 14:10:11.812360 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.812342 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vm2cz\"/\"kube-root-ca.crt\"" Jul 07 14:10:11.819806 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.819786 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vm2cz/must-gather-s79n6"] Jul 07 14:10:11.890049 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.890024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8jp\" (UniqueName: \"kubernetes.io/projected/f07279c6-3c03-4b7f-98dd-863153c5df96-kube-api-access-6b8jp\") pod \"must-gather-s79n6\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:11.890147 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.890103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f07279c6-3c03-4b7f-98dd-863153c5df96-must-gather-output\") pod \"must-gather-s79n6\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:11.990585 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.990559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f07279c6-3c03-4b7f-98dd-863153c5df96-must-gather-output\") pod \"must-gather-s79n6\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:11.990722 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.990627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8jp\" (UniqueName: \"kubernetes.io/projected/f07279c6-3c03-4b7f-98dd-863153c5df96-kube-api-access-6b8jp\") pod \"must-gather-s79n6\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:11.990878 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.990856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f07279c6-3c03-4b7f-98dd-863153c5df96-must-gather-output\") pod \"must-gather-s79n6\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:11.998829 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:11.998805 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8jp\" (UniqueName: \"kubernetes.io/projected/f07279c6-3c03-4b7f-98dd-863153c5df96-kube-api-access-6b8jp\") pod \"must-gather-s79n6\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:12.131129 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:12.131076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:12.254985 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:12.254954 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vm2cz/must-gather-s79n6"] Jul 07 14:10:12.257958 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:10:12.257933 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf07279c6_3c03_4b7f_98dd_863153c5df96.slice/crio-eb6235a0ee7d975abddfbbb2ecc4fa2e9c44216dee6ddb876f7a4362a5845189 WatchSource:0}: Error finding container eb6235a0ee7d975abddfbbb2ecc4fa2e9c44216dee6ddb876f7a4362a5845189: Status 404 returned error can't find the container with id eb6235a0ee7d975abddfbbb2ecc4fa2e9c44216dee6ddb876f7a4362a5845189 Jul 07 14:10:12.643313 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:12.643287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vm2cz/must-gather-s79n6" event={"ID":"f07279c6-3c03-4b7f-98dd-863153c5df96","Type":"ContainerStarted","Data":"eb6235a0ee7d975abddfbbb2ecc4fa2e9c44216dee6ddb876f7a4362a5845189"} Jul 07 14:10:19.682542 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:19.682500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vm2cz/must-gather-s79n6" event={"ID":"f07279c6-3c03-4b7f-98dd-863153c5df96","Type":"ContainerStarted","Data":"74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39"} Jul 07 14:10:19.683018 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:19.682557 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vm2cz/must-gather-s79n6" event={"ID":"f07279c6-3c03-4b7f-98dd-863153c5df96","Type":"ContainerStarted","Data":"4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84"} Jul 07 14:10:19.698376 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:19.698334 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vm2cz/must-gather-s79n6" podStartSLOduration=2.140246744 podStartE2EDuration="8.698320001s" totalImagesPullingTime="6.558073257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:19.697222444 +0000 UTC m=+506.823116155" watchObservedRunningTime="2026-07-07 14:10:19.698320001 +0000 UTC m=+506.824213712" Jul 07 14:10:22.644836 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.644770 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6475dc8c85-g4vbz" podUID="4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" containerName="console" containerID="cri-o://db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0" gracePeriod=15 Jul 07 14:10:22.902403 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.902353 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:10:22.988438 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988405 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-oauth-serving-cert\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988438 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988448 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-trusted-ca-bundle\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988678 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988487 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-service-ca\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988678 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988509 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-config\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988678 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988562 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-oauth-config\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988678 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988612 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-serving-cert\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988678 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988636 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgzb9\" (UniqueName: \"kubernetes.io/projected/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-kube-api-access-mgzb9\") pod \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\" (UID: \"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf\") " Jul 07 14:10:22.988935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988764 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:10:22.988935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988880 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-service-ca" (OuterVolumeSpecName: "service-ca") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:10:22.988935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988894 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-config" (OuterVolumeSpecName: "console-config") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:10:22.988935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988888 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-oauth-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:22.988935 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.988901 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:10:22.991373 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.991346 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-kube-api-access-mgzb9" (OuterVolumeSpecName: "kube-api-access-mgzb9") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "kube-api-access-mgzb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:10:22.991725 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.991705 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:10:22.991805 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:22.991736 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" (UID: "4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:10:23.090263 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.090230 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-trusted-ca-bundle\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:23.090263 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.090265 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-service-ca\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:23.090452 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.090280 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:23.090452 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.090293 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-oauth-config\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:23.090452 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.090307 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-console-serving-cert\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:23.090452 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.090320 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgzb9\" (UniqueName: \"kubernetes.io/projected/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf-kube-api-access-mgzb9\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:23.702861 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.702826 2580 generic.go:356] "Generic (PLEG): container finished" podID="4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" containerID="db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0" exitCode=0 Jul 07 14:10:23.703298 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.702887 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475dc8c85-g4vbz" Jul 07 14:10:23.703298 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.702909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475dc8c85-g4vbz" event={"ID":"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf","Type":"ContainerDied","Data":"db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0"} Jul 07 14:10:23.703298 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.702961 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475dc8c85-g4vbz" event={"ID":"4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf","Type":"ContainerDied","Data":"1dbbfea0b16cebd62137bee9e5b8de768d1496b8161a4032bf7380a44dd83587"} Jul 07 14:10:23.703298 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.702981 2580 scope.go:117] "RemoveContainer" containerID="db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0" Jul 07 14:10:23.713006 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.712987 2580 scope.go:117] "RemoveContainer" containerID="db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0" Jul 07 14:10:23.713281 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:23.713261 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0\": container with ID starting with db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0 not found: ID does not exist" containerID="db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0" Jul 07 14:10:23.713370 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.713288 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0"} err="failed to get container status \"db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0\": rpc error: code = NotFound desc = could not find container \"db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0\": container with ID starting with db18657fe547c3d5ae305c6792d05f07df807073bfe8415df6eded1fbf4384b0 not found: ID does not exist" Jul 07 14:10:23.720901 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.720879 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6475dc8c85-g4vbz"] Jul 07 14:10:23.725773 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:23.725753 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6475dc8c85-g4vbz"] Jul 07 14:10:25.469199 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:25.469146 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" path="/var/lib/kubelet/pods/4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf/volumes" Jul 07 14:10:26.907146 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:26.907122 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7574459656-fwxpc_dc6f940a-d9bc-4f87-aded-df7e5c3b7a75/discovery/0.log" Jul 07 14:10:26.959499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:26.959470 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d88db887-vwxxw_a5420a40-5676-43da-818c-9b2f055953f0/router/0.log" Jul 07 14:10:31.744350 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:31.744278 2580 generic.go:356] "Generic (PLEG): container finished" podID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerID="4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84" exitCode=0 Jul 07 14:10:31.744724 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:31.744347 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vm2cz/must-gather-s79n6" event={"ID":"f07279c6-3c03-4b7f-98dd-863153c5df96","Type":"ContainerDied","Data":"4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84"} Jul 07 14:10:31.744724 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:31.744600 2580 scope.go:117] "RemoveContainer" containerID="4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84" Jul 07 14:10:32.362892 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.362863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vm2cz_must-gather-s79n6_f07279c6-3c03-4b7f-98dd-863153c5df96/gather/0.log" Jul 07 14:10:32.913299 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.913268 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tcpvj/must-gather-p9fvh"] Jul 07 14:10:32.913667 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.913595 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" containerName="console" Jul 07 14:10:32.913667 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.913605 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" containerName="console" Jul 07 14:10:32.913667 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.913668 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb2ee32-b57f-4c56-a98d-75ee7f7f2fcf" containerName="console" Jul 07 14:10:32.915773 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.915752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:32.918213 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.918189 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tcpvj\"/\"kube-root-ca.crt\"" Jul 07 14:10:32.918321 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.918287 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tcpvj\"/\"openshift-service-ca.crt\"" Jul 07 14:10:32.919388 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.919372 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tcpvj\"/\"default-dockercfg-vr2d2\"" Jul 07 14:10:32.946626 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.946608 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tcpvj/must-gather-p9fvh"] Jul 07 14:10:32.964922 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.964899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a43e4b65-19ce-4661-b9e3-84c62d9b76bc-must-gather-output\") pod \"must-gather-p9fvh\" (UID: \"a43e4b65-19ce-4661-b9e3-84c62d9b76bc\") " pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:32.965011 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:32.964939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfll5\" (UniqueName: \"kubernetes.io/projected/a43e4b65-19ce-4661-b9e3-84c62d9b76bc-kube-api-access-rfll5\") pod \"must-gather-p9fvh\" (UID: \"a43e4b65-19ce-4661-b9e3-84c62d9b76bc\") " pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:33.066081 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.066056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a43e4b65-19ce-4661-b9e3-84c62d9b76bc-must-gather-output\") pod \"must-gather-p9fvh\" (UID: \"a43e4b65-19ce-4661-b9e3-84c62d9b76bc\") " pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:33.066199 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.066099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfll5\" (UniqueName: \"kubernetes.io/projected/a43e4b65-19ce-4661-b9e3-84c62d9b76bc-kube-api-access-rfll5\") pod \"must-gather-p9fvh\" (UID: \"a43e4b65-19ce-4661-b9e3-84c62d9b76bc\") " pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:33.066443 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.066421 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a43e4b65-19ce-4661-b9e3-84c62d9b76bc-must-gather-output\") pod \"must-gather-p9fvh\" (UID: \"a43e4b65-19ce-4661-b9e3-84c62d9b76bc\") " pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:33.079354 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.079330 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfll5\" (UniqueName: \"kubernetes.io/projected/a43e4b65-19ce-4661-b9e3-84c62d9b76bc-kube-api-access-rfll5\") pod \"must-gather-p9fvh\" (UID: \"a43e4b65-19ce-4661-b9e3-84c62d9b76bc\") " pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:33.225357 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.225292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tcpvj/must-gather-p9fvh" Jul 07 14:10:33.349264 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.349242 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tcpvj/must-gather-p9fvh"] Jul 07 14:10:33.351815 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:10:33.351789 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda43e4b65_19ce_4661_b9e3_84c62d9b76bc.slice/crio-358cd356938b3c4edfe5b07d65ceae273942269af7c77afd737cbdbc167805c6 WatchSource:0}: Error finding container 358cd356938b3c4edfe5b07d65ceae273942269af7c77afd737cbdbc167805c6: Status 404 returned error can't find the container with id 358cd356938b3c4edfe5b07d65ceae273942269af7c77afd737cbdbc167805c6 Jul 07 14:10:33.753974 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:33.753940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcpvj/must-gather-p9fvh" event={"ID":"a43e4b65-19ce-4661-b9e3-84c62d9b76bc","Type":"ContainerStarted","Data":"358cd356938b3c4edfe5b07d65ceae273942269af7c77afd737cbdbc167805c6"} Jul 07 14:10:34.763243 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:34.763201 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcpvj/must-gather-p9fvh" event={"ID":"a43e4b65-19ce-4661-b9e3-84c62d9b76bc","Type":"ContainerStarted","Data":"3bff1dd33701588c132510d35d05c04af5555e3296224da6f0e664bc5fd8c1aa"} Jul 07 14:10:34.763721 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:34.763261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcpvj/must-gather-p9fvh" event={"ID":"a43e4b65-19ce-4661-b9e3-84c62d9b76bc","Type":"ContainerStarted","Data":"11ff32f92d6419819402209ba2d94fd3c6d553e5d231c3f81af637ff1b4958c7"} Jul 07 14:10:34.781035 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:34.780985 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tcpvj/must-gather-p9fvh" podStartSLOduration=1.984467402 podStartE2EDuration="2.780965087s" totalImagesPullingTime="796.497685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:34.779792456 +0000 UTC m=+521.905686170" watchObservedRunningTime="2026-07-07 14:10:34.780965087 +0000 UTC m=+521.906858800" Jul 07 14:10:35.590899 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:35.590872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tj92w_d62cbe35-17db-4389-9b2f-8a2650dba86a/global-pull-secret-syncer/0.log" Jul 07 14:10:35.794937 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:35.794907 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tzl7w_b65beddc-1d50-40e0-a4bc-6330da997c1a/konnectivity-agent/0.log" Jul 07 14:10:35.820973 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:35.820949 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-212.ec2.internal_3b2f4341b6217a0591edf44c68d43070/haproxy/0.log" Jul 07 14:10:37.727483 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:37.727445 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vm2cz/must-gather-s79n6"] Jul 07 14:10:37.727970 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:37.727731 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-vm2cz/must-gather-s79n6" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="copy" containerID="cri-o://74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39" gracePeriod=2 Jul 07 14:10:37.735437 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:37.735407 2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f07279c6-3c03-4b7f-98dd-863153c5df96\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-vm2cz\"/\"must-gather-s79n6\": pods \"must-gather-s79n6\" not found" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:37.736044 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:37.735999 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vm2cz/must-gather-s79n6"] Jul 07 14:10:38.122611 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.122583 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vm2cz_must-gather-s79n6_f07279c6-3c03-4b7f-98dd-863153c5df96/copy/0.log" Jul 07 14:10:38.128261 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.127604 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:38.130113 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:38.130073 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s79n6\" is forbidden: User \"system:node:ip-10-0-129-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vm2cz\": no relationship found between node 'ip-10-0-129-212.ec2.internal' and this object" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:38.213157 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.213115 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f07279c6-3c03-4b7f-98dd-863153c5df96-must-gather-output\") pod \"f07279c6-3c03-4b7f-98dd-863153c5df96\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " Jul 07 14:10:38.213401 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.213196 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b8jp\" (UniqueName: \"kubernetes.io/projected/f07279c6-3c03-4b7f-98dd-863153c5df96-kube-api-access-6b8jp\") pod \"f07279c6-3c03-4b7f-98dd-863153c5df96\" (UID: \"f07279c6-3c03-4b7f-98dd-863153c5df96\") " Jul 07 14:10:38.219952 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.217004 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07279c6-3c03-4b7f-98dd-863153c5df96-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "f07279c6-3c03-4b7f-98dd-863153c5df96" (UID: "f07279c6-3c03-4b7f-98dd-863153c5df96"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:10:38.229192 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.224647 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07279c6-3c03-4b7f-98dd-863153c5df96-kube-api-access-6b8jp" (OuterVolumeSpecName: "kube-api-access-6b8jp") pod "f07279c6-3c03-4b7f-98dd-863153c5df96" (UID: "f07279c6-3c03-4b7f-98dd-863153c5df96"). InnerVolumeSpecName "kube-api-access-6b8jp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:10:38.314671 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.314626 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b8jp\" (UniqueName: \"kubernetes.io/projected/f07279c6-3c03-4b7f-98dd-863153c5df96-kube-api-access-6b8jp\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:38.314671 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.314671 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f07279c6-3c03-4b7f-98dd-863153c5df96-must-gather-output\") on node \"ip-10-0-129-212.ec2.internal\" DevicePath \"\"" Jul 07 14:10:38.792695 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.792663 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vm2cz_must-gather-s79n6_f07279c6-3c03-4b7f-98dd-863153c5df96/copy/0.log" Jul 07 14:10:38.793277 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.793097 2580 generic.go:356] "Generic (PLEG): container finished" podID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerID="74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39" exitCode=143 Jul 07 14:10:38.793277 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.793200 2580 scope.go:117] "RemoveContainer" containerID="74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39" Jul 07 14:10:38.793395 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.793355 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:38.816117 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:38.805207 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s79n6\" is forbidden: User \"system:node:ip-10-0-129-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vm2cz\": no relationship found between node 'ip-10-0-129-212.ec2.internal' and this object" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:38.831642 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:38.831608 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s79n6\" is forbidden: User \"system:node:ip-10-0-129-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vm2cz\": no relationship found between node 'ip-10-0-129-212.ec2.internal' and this object" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" pod="openshift-must-gather-vm2cz/must-gather-s79n6" Jul 07 14:10:38.836591 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.836525 2580 scope.go:117] "RemoveContainer" containerID="4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84" Jul 07 14:10:38.869657 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.869589 2580 scope.go:117] "RemoveContainer" containerID="74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39" Jul 07 14:10:38.870193 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:38.870151 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39\": container with ID starting with 74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39 not found: ID does not exist" containerID="74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39" Jul 07 14:10:38.870422 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.870330 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39"} err="failed to get container status \"74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39\": rpc error: code = NotFound desc = could not find container \"74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39\": container with ID starting with 74af85b1e10283cbb54c255932a0839555e1304f420b9d66c82e70ad9d653e39 not found: ID does not exist" Jul 07 14:10:38.870422 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.870372 2580 scope.go:117] "RemoveContainer" containerID="4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84" Jul 07 14:10:38.870886 ip-10-0-129-212 kubenswrapper[2580]: E0707 14:10:38.870845 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84\": container with ID starting with 4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84 not found: ID does not exist" containerID="4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84" Jul 07 14:10:38.871041 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:38.870869 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84"} err="failed to get container status \"4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84\": rpc error: code = NotFound desc = could not find container \"4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84\": container with ID starting with 4130db109c6070e4e8a5df48b7e9fc2e28b249bc97974f2b72672bc4acc08a84 not found: ID does not exist" Jul 07 14:10:39.472152 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:39.471641 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" path="/var/lib/kubelet/pods/f07279c6-3c03-4b7f-98dd-863153c5df96/volumes" Jul 07 14:10:40.559296 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:40.559269 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-nvfvk_6b443c08-82cc-4620-b690-c1e4e922c2ff/monitoring-plugin/0.log" Jul 07 14:10:40.711896 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:40.711863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czbhc_30533477-f233-468b-a885-bc67162bb7b5/node-exporter/0.log" Jul 07 14:10:40.750499 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:40.750455 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czbhc_30533477-f233-468b-a885-bc67162bb7b5/kube-rbac-proxy/0.log" Jul 07 14:10:40.781228 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:40.781196 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czbhc_30533477-f233-468b-a885-bc67162bb7b5/init-textfile/0.log" Jul 07 14:10:41.345324 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.345290 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-r8mz8_e685b6a0-0551-4f4f-9470-613241f3676d/prometheus-operator/0.log" Jul 07 14:10:41.375549 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.375514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-r8mz8_e685b6a0-0551-4f4f-9470-613241f3676d/kube-rbac-proxy/0.log" Jul 07 14:10:41.608435 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.608358 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b87bdc769-zddvr_2416e5e8-64a5-4b24-9388-bc9590b00f01/thanos-query/0.log" Jul 07 14:10:41.635386 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.635356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b87bdc769-zddvr_2416e5e8-64a5-4b24-9388-bc9590b00f01/kube-rbac-proxy-web/0.log" Jul 07 14:10:41.663639 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.663603 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b87bdc769-zddvr_2416e5e8-64a5-4b24-9388-bc9590b00f01/kube-rbac-proxy/0.log" Jul 07 14:10:41.689618 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.689587 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b87bdc769-zddvr_2416e5e8-64a5-4b24-9388-bc9590b00f01/prom-label-proxy/0.log" Jul 07 14:10:41.718113 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.718088 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b87bdc769-zddvr_2416e5e8-64a5-4b24-9388-bc9590b00f01/kube-rbac-proxy-rules/0.log" Jul 07 14:10:41.747750 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:41.747718 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b87bdc769-zddvr_2416e5e8-64a5-4b24-9388-bc9590b00f01/kube-rbac-proxy-metrics/0.log" Jul 07 14:10:43.442918 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.442887 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp"] Jul 07 14:10:43.444279 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.444257 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="gather" Jul 07 14:10:43.444436 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.444423 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="gather" Jul 07 14:10:43.444541 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.444531 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="copy" Jul 07 14:10:43.444629 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.444618 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="copy" Jul 07 14:10:43.444787 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.444773 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="gather" Jul 07 14:10:43.444875 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.444865 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f07279c6-3c03-4b7f-98dd-863153c5df96" containerName="copy" Jul 07 14:10:43.449237 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.449219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.460202 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.459032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp"] Jul 07 14:10:43.568006 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.567970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-sys\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.568006 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.568009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-podres\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.568237 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.568047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfsl\" (UniqueName: \"kubernetes.io/projected/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-kube-api-access-6wfsl\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.568237 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.568167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-proc\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.568305 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.568266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-lib-modules\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669150 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-proc\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669150 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-lib-modules\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669150 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-sys\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669543 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-podres\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669543 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669256 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-proc\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669543 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfsl\" (UniqueName: \"kubernetes.io/projected/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-kube-api-access-6wfsl\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669543 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-sys\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669543 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669340 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-lib-modules\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.669543 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.669360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-podres\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.678511 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.678487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfsl\" (UniqueName: \"kubernetes.io/projected/d8cd902a-1998-4c4c-80ab-1b16aa9918ff-kube-api-access-6wfsl\") pod \"perf-node-gather-daemonset-wfpjp\" (UID: \"d8cd902a-1998-4c4c-80ab-1b16aa9918ff\") " pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.749282 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.749259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76f9b9f456-ztftp_e729a5ab-7453-4ae4-aba9-2b5750cd500f/console/0.log" Jul 07 14:10:43.765480 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.765459 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:43.928837 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:43.928815 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp"] Jul 07 14:10:43.932218 ip-10-0-129-212 kubenswrapper[2580]: W0707 14:10:43.932165 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd8cd902a_1998_4c4c_80ab_1b16aa9918ff.slice/crio-556b81eccc4012f3802460fe7a44ced42be21a7c5653d5c8ffb7d19d7aa561fd WatchSource:0}: Error finding container 556b81eccc4012f3802460fe7a44ced42be21a7c5653d5c8ffb7d19d7aa561fd: Status 404 returned error can't find the container with id 556b81eccc4012f3802460fe7a44ced42be21a7c5653d5c8ffb7d19d7aa561fd Jul 07 14:10:44.416158 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:44.416066 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-2wtcw_22244b0c-dc71-4f82-86bc-fc4e674d83a9/volume-data-source-validator/0.log" Jul 07 14:10:44.840854 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:44.840812 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" event={"ID":"d8cd902a-1998-4c4c-80ab-1b16aa9918ff","Type":"ContainerStarted","Data":"27a431cc7e03d66e8ebbe8addaba357bf362507e087dcb79d5d030c78a03d956"} Jul 07 14:10:44.841360 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:44.840884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" event={"ID":"d8cd902a-1998-4c4c-80ab-1b16aa9918ff","Type":"ContainerStarted","Data":"556b81eccc4012f3802460fe7a44ced42be21a7c5653d5c8ffb7d19d7aa561fd"} Jul 07 14:10:44.841625 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:44.841599 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:44.860774 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:44.860717 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" podStartSLOduration=1.860688922 podStartE2EDuration="1.860688922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:44.859864543 +0000 UTC m=+531.985758252" watchObservedRunningTime="2026-07-07 14:10:44.860688922 +0000 UTC m=+531.986582633" Jul 07 14:10:45.402074 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:45.402052 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lj9gs_136ff185-8b6d-4058-b9f6-a07fb7df1d26/dns/0.log" Jul 07 14:10:45.429129 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:45.429105 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lj9gs_136ff185-8b6d-4058-b9f6-a07fb7df1d26/kube-rbac-proxy/0.log" Jul 07 14:10:45.513729 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:45.513704 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8x5pt_d6e577ee-2831-4750-8392-dac793958894/dns-node-resolver/0.log" Jul 07 14:10:46.053973 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:46.053932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-779bcb7c54-mv568_d1380a05-fe60-4e60-a936-3ae3fe16f31e/registry/0.log" Jul 07 14:10:46.079866 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:46.079843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6pcrj_10aaf244-e17c-4006-90c5-c5d5171f193f/node-ca/0.log" Jul 07 14:10:47.007214 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:47.007163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7574459656-fwxpc_dc6f940a-d9bc-4f87-aded-df7e5c3b7a75/discovery/0.log" Jul 07 14:10:47.081466 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:47.081433 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d88db887-vwxxw_a5420a40-5676-43da-818c-9b2f055953f0/router/0.log" Jul 07 14:10:47.597369 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:47.597337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24nbv_0852b7a6-02c8-49e7-bf17-1b25bf759660/serve-healthcheck-canary/0.log" Jul 07 14:10:48.120717 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:48.120673 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-68hdm_30d35c21-6a80-4386-87aa-f77458df215a/insights-operator/1.log" Jul 07 14:10:48.121367 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:48.121337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-68hdm_30d35c21-6a80-4386-87aa-f77458df215a/insights-operator/0.log" Jul 07 14:10:48.147659 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:48.147630 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5njgv_4de2b4fc-82b0-4f52-98bd-50680361104b/kube-rbac-proxy/0.log" Jul 07 14:10:48.173684 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:48.173658 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5njgv_4de2b4fc-82b0-4f52-98bd-50680361104b/exporter/0.log" Jul 07 14:10:48.203688 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:48.203668 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5njgv_4de2b4fc-82b0-4f52-98bd-50680361104b/extractor/0.log" Jul 07 14:10:49.846674 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:49.846649 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7574459656-fwxpc_dc6f940a-d9bc-4f87-aded-df7e5c3b7a75/discovery/0.log" Jul 07 14:10:49.881754 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:49.881723 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d88db887-vwxxw_a5420a40-5676-43da-818c-9b2f055953f0/router/0.log" Jul 07 14:10:50.703644 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:50.703617 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7574459656-fwxpc_dc6f940a-d9bc-4f87-aded-df7e5c3b7a75/discovery/0.log" Jul 07 14:10:50.740290 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:50.740248 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d88db887-vwxxw_a5420a40-5676-43da-818c-9b2f055953f0/router/0.log" Jul 07 14:10:51.865097 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:51.865074 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tcpvj/perf-node-gather-daemonset-wfpjp" Jul 07 14:10:55.922721 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:55.922656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/kube-multus-additional-cni-plugins/0.log" Jul 07 14:10:55.951941 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:55.951914 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/egress-router-binary-copy/0.log" Jul 07 14:10:55.978321 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:55.978298 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/cni-plugins/0.log" Jul 07 14:10:56.018531 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.018508 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/bond-cni-plugin/0.log" Jul 07 14:10:56.080843 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.080823 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/routeoverride-cni/0.log" Jul 07 14:10:56.104602 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.104583 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/whereabouts-cni-bincopy/0.log" Jul 07 14:10:56.128400 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.128383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjsmd_0ab42e35-51b1-4ace-9b99-270d31d26195/whereabouts-cni/0.log" Jul 07 14:10:56.198104 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.198055 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xllfc_2e985d53-5969-42b4-b460-749971a3ade0/kube-multus/0.log" Jul 07 14:10:56.276037 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.276006 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-htjnk_28b1a700-8b23-43eb-8081-15b34ce694e4/network-metrics-daemon/0.log" Jul 07 14:10:56.297642 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:56.297623 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-htjnk_28b1a700-8b23-43eb-8081-15b34ce694e4/kube-rbac-proxy/0.log" Jul 07 14:10:57.164955 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.164909 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-controller/0.log" Jul 07 14:10:57.185444 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.185420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/1.log" Jul 07 14:10:57.185570 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.185451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovn-acl-logging/0.log" Jul 07 14:10:57.205404 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.205381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/kube-rbac-proxy-node/0.log" Jul 07 14:10:57.232497 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.232469 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 14:10:57.255402 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.255378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/northd/0.log" Jul 07 14:10:57.281293 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.281276 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/nbdb/0.log" Jul 07 14:10:57.306102 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.306083 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/sbdb/0.log" Jul 07 14:10:57.354428 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:57.354399 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78b2b_12d8b273-027b-4225-9ef9-2534db843654/ovnkube-controller/0.log" Jul 07 14:10:58.849830 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:58.849805 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-5lvxk_2affa900-c1c6-4e93-a868-387e404a81c3/check-endpoints/0.log" Jul 07 14:10:58.901108 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:58.901083 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9x827_219fad73-e0b3-4a16-a4a5-9983e7d3b5ce/network-check-target-container/0.log" Jul 07 14:10:59.860586 ip-10-0-129-212 kubenswrapper[2580]: I0707 14:10:59.860561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tprc2_e6bcaa39-3502-443a-992b-5f4175862660/iptables-alerter/0.log"