Jun 08 19:29:09.192786 ip-10-0-129-91 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 19:29:09.192795 ip-10-0-129-91 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 19:29:09.192802 ip-10-0-129-91 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 19:29:09.193013 ip-10-0-129-91 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 19:29:19.205041 ip-10-0-129-91 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 19:29:19.205054 ip-10-0-129-91 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5b31228e5fcf4793a983929584133fa5 -- Jun 08 19:31:46.490372 ip-10-0-129-91 systemd[1]: Starting Kubernetes Kubelet... Jun 08 19:31:46.902574 ip-10-0-129-91 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:31:46.902574 ip-10-0-129-91 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 19:31:46.902574 ip-10-0-129-91 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:31:46.902574 ip-10-0-129-91 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 19:31:46.903180 ip-10-0-129-91 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:31:46.903604 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.903532 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 19:31:46.909888 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909859 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:31:46.909888 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909880 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:31:46.909888 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909885 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:31:46.909888 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909889 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:31:46.909888 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909894 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909898 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909903 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909907 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909911 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909915 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909919 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909923 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909927 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909931 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909936 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909940 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909946 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909952 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909957 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909962 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909966 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909970 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909988 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909993 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:31:46.910199 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.909997 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910002 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910006 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910009 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910013 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910019 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910024 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910029 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910033 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910037 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910042 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910047 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910051 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910055 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910060 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910065 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910069 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910073 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910078 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:31:46.911036 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910082 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910088 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910092 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910096 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910101 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910105 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910109 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910113 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910118 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910122 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910126 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910130 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910137 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910142 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910148 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910152 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910157 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910161 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910165 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:31:46.911848 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910171 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910175 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910179 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910183 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910188 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910192 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910196 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910200 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910205 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910209 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910213 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910218 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910222 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910226 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910231 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910235 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910239 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910243 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910248 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910252 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:31:46.912692 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910256 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910261 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910265 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910269 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910273 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910278 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910282 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910287 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910291 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910295 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910299 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910303 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910307 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910311 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910315 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910320 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.910324 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911483 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911493 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911498 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:31:46.913569 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911503 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911508 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911512 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911516 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911522 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911530 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911536 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911541 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911546 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911551 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911556 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911561 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911565 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911569 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911575 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911579 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911583 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911587 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911592 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:31:46.914511 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911596 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911600 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911606 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911610 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911614 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911621 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911626 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911631 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911635 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911640 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911644 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911649 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911653 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911659 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911663 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911668 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911672 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911676 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911680 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911684 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:31:46.915064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911688 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911693 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911697 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911701 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911706 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911710 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911714 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911718 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911723 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911727 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911732 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911736 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911741 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911745 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911750 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911754 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911758 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911763 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911768 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911772 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:31:46.915631 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911777 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911781 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911785 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911789 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911794 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911798 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911802 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911807 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911811 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911815 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911819 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911823 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911827 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911831 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911835 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911840 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911844 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911848 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911851 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:31:46.916365 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911855 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911859 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911864 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911868 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911872 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911876 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911881 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911885 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911889 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911894 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911899 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911903 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911907 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911911 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911915 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911919 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911923 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.911928 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912554 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912563 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:31:46.916832 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912568 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912572 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912577 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912582 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912587 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912591 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912595 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912599 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912604 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912608 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912612 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912616 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912620 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912626 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912631 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912636 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912640 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912645 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912649 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:31:46.917437 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912655 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912661 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912666 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912671 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912675 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912679 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912683 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912687 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912691 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912695 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912703 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912706 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912711 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912715 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912719 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912724 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912730 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912736 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912741 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912746 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:31:46.917895 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912751 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912756 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912761 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912765 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912770 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912774 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912779 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912783 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912789 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912793 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912798 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912801 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912805 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912809 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912814 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912818 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912822 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912826 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912831 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912835 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:31:46.918412 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912839 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912843 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912849 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912853 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912857 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912862 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912866 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912870 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912874 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912878 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912883 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912887 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912890 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912895 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912899 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912903 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912910 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912914 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912919 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:31:46.918904 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912923 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912927 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912936 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912942 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912947 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912952 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912956 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912960 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912964 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912969 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.912996 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913002 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913006 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913011 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913015 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913021 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913025 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913029 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.913033 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913131 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 19:31:46.919385 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913142 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913155 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913162 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913168 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913173 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913179 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913185 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913190 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913195 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913200 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913205 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913211 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913216 2561 flags.go:64] FLAG: --cgroup-root="" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913220 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913225 2561 flags.go:64] FLAG: --client-ca-file="" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913231 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913236 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913242 2561 flags.go:64] FLAG: --cluster-domain="" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913247 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913252 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913258 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913263 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913274 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 19:31:46.919938 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913279 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913284 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913289 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913294 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913301 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913306 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913310 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913315 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913321 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913326 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913333 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913337 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913342 2561 flags.go:64] FLAG: --enable-server="true" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913347 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913354 2561 flags.go:64] FLAG: --event-burst="100" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913359 2561 flags.go:64] FLAG: --event-qps="50" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913364 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913368 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913373 2561 flags.go:64] FLAG: --eviction-hard="" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913379 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913384 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913388 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913393 2561 flags.go:64] FLAG: --eviction-soft="" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913398 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913402 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 19:31:46.920553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913408 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913413 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913418 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913423 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913427 2561 flags.go:64] FLAG: --feature-gates="" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913433 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913438 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913443 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913447 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913452 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913457 2561 flags.go:64] FLAG: --help="false" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913464 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-91.ec2.internal" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913469 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913473 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913478 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913483 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913489 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913495 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913500 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913504 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913509 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913514 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913519 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913523 2561 flags.go:64] FLAG: --kube-reserved="" Jun 08 19:31:46.921196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913528 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913532 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913537 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913542 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913547 2561 flags.go:64] FLAG: --lock-file="" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913551 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913556 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913560 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913568 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913574 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913578 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913583 2561 flags.go:64] FLAG: --logging-format="text" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913587 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913592 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913597 2561 flags.go:64] FLAG: --manifest-url="" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913601 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913608 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913613 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913620 2561 flags.go:64] FLAG: --max-pods="110" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913626 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913631 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913635 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913640 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913645 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913649 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 19:31:46.921771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913657 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913667 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913672 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913677 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913682 2561 flags.go:64] FLAG: --pod-cidr="" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913686 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913695 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913700 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913705 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913710 2561 flags.go:64] FLAG: --port="10250" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913714 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913719 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05035609376f20dcc" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913724 2561 flags.go:64] FLAG: --qos-reserved="" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913729 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913734 2561 flags.go:64] FLAG: --register-node="true" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913738 2561 flags.go:64] FLAG: --register-with-taints="" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913744 2561 flags.go:64] FLAG: --registry-burst="10" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913749 2561 flags.go:64] FLAG: --registry-qps="5" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913753 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913758 2561 flags.go:64] FLAG: --reserved-memory="" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913765 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913769 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913774 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913779 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913784 2561 flags.go:64] FLAG: --runonce="false" Jun 08 19:31:46.922399 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913789 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913794 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913800 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913804 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913809 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913814 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913819 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913825 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913830 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913834 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913839 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913843 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913848 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913853 2561 flags.go:64] FLAG: --system-cgroups="" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913857 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913866 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913870 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913875 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913881 2561 flags.go:64] FLAG: --tls-min-version="" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913885 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913889 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913894 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913899 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913904 2561 flags.go:64] FLAG: --v="2" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913910 2561 flags.go:64] FLAG: --version="false" Jun 08 19:31:46.923034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913916 2561 flags.go:64] FLAG: --vmodule="" Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913922 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.913928 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914123 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914130 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914135 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914140 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914144 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914149 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914155 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914159 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914164 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914168 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914172 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914180 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914184 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914189 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914193 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914197 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:31:46.923677 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914202 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914206 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914210 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914215 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914218 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914223 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914227 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914232 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914236 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914242 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914248 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914253 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914257 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914261 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914266 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914270 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914275 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914279 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914284 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914288 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:31:46.924170 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914292 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914296 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914305 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914311 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914316 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914322 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914327 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914337 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914341 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914346 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914350 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914354 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914359 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914363 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914368 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914373 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914377 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914381 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914385 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:31:46.924669 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914389 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914394 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914398 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914403 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914407 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914411 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914416 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914420 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914425 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914430 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914434 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914439 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914443 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914447 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914451 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914457 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914462 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914466 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914470 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914474 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:31:46.925152 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914480 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914484 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914488 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914493 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914497 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914501 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914505 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914510 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914513 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914519 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914524 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914529 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914534 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914538 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914543 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914547 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914552 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914556 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914560 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914564 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:31:46.925727 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914568 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914573 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914577 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.914582 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.915226 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.921454 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.921469 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.921487 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.921493 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921545 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921550 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921554 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921556 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921559 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921562 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:31:46.926290 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921564 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921569 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921572 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921575 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921578 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921580 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921583 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921586 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921588 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921591 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921594 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921597 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921600 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921602 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921605 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921607 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921610 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921613 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921615 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921618 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:31:46.926679 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921620 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921623 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921626 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921630 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921632 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921635 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921638 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921641 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921643 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921646 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921649 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921651 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921654 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921656 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921659 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921661 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921664 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921666 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921669 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:31:46.927235 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921671 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921674 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921676 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921679 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921681 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921684 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921687 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921689 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921691 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921694 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921697 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921699 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921702 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921704 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921707 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921709 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921713 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921716 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921718 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921721 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:31:46.927709 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921724 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921727 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921731 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921735 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921738 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921741 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921744 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921747 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921750 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921753 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921756 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921758 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921761 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921763 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921766 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921768 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921771 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921774 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921777 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:31:46.928216 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921779 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921782 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921785 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921788 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921790 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921793 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921796 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921798 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921801 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921804 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921807 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921810 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921813 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921816 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:31:46.928680 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921818 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.921823 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921929 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921934 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921937 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921939 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921942 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921944 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921947 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921950 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921952 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921957 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921960 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921963 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921966 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:31:46.929043 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921969 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921972 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921990 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921993 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921997 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.921999 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922002 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922004 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922007 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922010 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922013 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922016 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922018 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922021 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922024 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922027 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922030 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922033 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922035 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:31:46.929415 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922038 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922040 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922043 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922045 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922049 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922052 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922055 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922057 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922060 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922062 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922065 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922068 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922070 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922073 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922075 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922078 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922080 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922083 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922086 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:31:46.929864 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922088 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922091 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922093 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922096 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922098 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922101 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922103 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922106 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922108 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922111 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922114 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922116 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922119 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922121 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922124 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922126 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922129 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922131 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922134 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922136 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:31:46.930341 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922139 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922141 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922143 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922146 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922149 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922151 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922153 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922156 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922159 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922161 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922164 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922167 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922170 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922172 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922175 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922177 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922180 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922182 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922185 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922187 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:31:46.930829 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922190 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922193 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922195 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922199 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922201 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922205 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922209 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:46.922211 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.922216 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.922310 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.924658 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.926027 2561 server.go:1019] "Starting client certificate rotation" Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.926129 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:31:46.931348 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.926158 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:31:46.931662 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.928450 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:31:46.932536 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.932456 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:31:46.941444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.941427 2561 log.go:25] "Validated CRI v1 runtime API" Jun 08 19:31:46.943744 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.943730 2561 log.go:25] "Validated CRI v1 image API" Jun 08 19:31:46.944526 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.944510 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 19:31:46.946568 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.946542 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a9fd47d9-4dbd-40c5-80b9-edf2b8e1115f:/dev/nvme0n1p3 aaf8a2e0-f839-4b39-ba40-e375ae740f01:/dev/nvme0n1p4] Jun 08 19:31:46.946640 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.946567 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 19:31:46.951732 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.951622 2561 manager.go:216] Machine: {Timestamp:2026-06-08 19:31:46.950071895 +0000 UTC m=+0.337393529 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103573 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec225876c55858f2774b41d81b2e8128 SystemUUID:ec225876-c558-58f2-774b-41d81b2e8128 BootID:5b31228e-5fcf-4793-a983-929584133fa5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:07:09:6d:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:07:09:6d:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:9f:c9:42:fd:86 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 19:31:46.951732 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.951725 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 19:31:46.951850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.951817 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 19:31:46.955283 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.955259 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 19:31:46.955476 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.955286 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 19:31:46.956056 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.956044 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 19:31:46.956119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.956062 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 19:31:46.956119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.956072 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:31:46.956799 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.956785 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:31:46.956799 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.956794 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:31:46.957760 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.957748 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 19:31:46.960539 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960525 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:31:46.960679 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960668 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 19:31:46.960734 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960705 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 08 19:31:46.960734 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960719 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 19:31:46.960822 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960738 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 19:31:46.960822 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960751 2561 kubelet.go:398] "Adding apiserver pod source" Jun 08 19:31:46.960822 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.960763 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 19:31:46.961124 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.961109 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:31:46.961212 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.961131 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:31:46.963112 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.963097 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 19:31:46.964191 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.964179 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 19:31:46.964233 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.964208 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 19:31:46.965401 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965391 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965407 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965413 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965418 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965427 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965433 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965441 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 19:31:46.965444 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965447 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 19:31:46.965619 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965453 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 19:31:46.965619 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965459 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 19:31:46.965619 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965468 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 19:31:46.965619 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.965474 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 19:31:46.966350 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.966339 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 19:31:46.966350 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.966350 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 19:31:46.969215 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.969202 2561 server.go:1268] "Started kubelet" Jun 08 19:31:46.972460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.969311 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 19:31:46.973075 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.969295 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 19:31:46.973173 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.973083 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 19:31:46.973210 ip-10-0-129-91 systemd[1]: Started Kubernetes Kubelet. Jun 08 19:31:46.975439 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.974924 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 19:31:46.975660 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.975640 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 08 19:31:46.975660 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.975647 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 19:31:46.976807 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.976772 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 19:31:46.977082 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.976788 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 19:31:46.980088 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.978215 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-91.ec2.internal.18b731f53aa83fa0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-91.ec2.internal,UID:ip-10-0-129-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-91.ec2.internal,},FirstTimestamp:2026-06-08 19:31:46.96917392 +0000 UTC m=+0.356495554,LastTimestamp:2026-06-08 19:31:46.96917392 +0000 UTC m=+0.356495554,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-91.ec2.internal,}" Jun 08 19:31:46.981428 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.981409 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 19:31:46.981499 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.981473 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 19:31:46.981499 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.981477 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 19:31:46.981603 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.981531 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:46.982144 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982123 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 19:31:46.982144 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982144 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 19:31:46.982274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982173 2561 factory.go:55] Registering systemd factory Jun 08 19:31:46.982274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982187 2561 factory.go:223] Registration of the systemd container factory successfully Jun 08 19:31:46.982274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982243 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 08 19:31:46.982274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982251 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 08 19:31:46.982447 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982292 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 19:31:46.982447 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982412 2561 factory.go:153] Registering CRI-O factory Jun 08 19:31:46.982447 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982424 2561 factory.go:223] Registration of the crio container factory successfully Jun 08 19:31:46.982572 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982472 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 19:31:46.982572 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982498 2561 factory.go:103] Registering Raw factory Jun 08 19:31:46.982572 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.982513 2561 manager.go:1196] Started watching for new ooms in manager Jun 08 19:31:46.983306 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.983294 2561 manager.go:349] Starting recovery of all containers Jun 08 19:31:46.984691 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.984667 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 19:31:46.984786 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:46.984765 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 19:31:46.993358 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.993344 2561 manager.go:354] Recovery completed Jun 08 19:31:46.997453 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.997441 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:46.999439 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999422 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:46.999519 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999449 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:46.999519 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999458 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:46.999890 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999868 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 19:31:46.999890 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999880 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 19:31:47.000025 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999898 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:31:47.000025 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:46.999914 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:47.000558 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.000522 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:47.000558 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.000555 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:47.000681 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.000570 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:47.001119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.001081 2561 policy_none.go:49] "None policy: Start" Jun 08 19:31:47.001119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.001094 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 19:31:47.001119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.001119 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 19:31:47.001714 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.001636 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-91.ec2.internal.18b731f53c760558 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-91.ec2.internal,UID:ip-10-0-129-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-91.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-91.ec2.internal,},FirstTimestamp:2026-06-08 19:31:46.999436632 +0000 UTC m=+0.386758268,LastTimestamp:2026-06-08 19:31:46.999436632 +0000 UTC m=+0.386758268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-91.ec2.internal,}" Jun 08 19:31:47.002262 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.002247 2561 policy_none.go:47] "Start" Jun 08 19:31:47.012754 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.012610 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-91.ec2.internal.18b731f53c7646cf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-91.ec2.internal,UID:ip-10-0-129-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-91.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-91.ec2.internal,},FirstTimestamp:2026-06-08 19:31:46.999453391 +0000 UTC m=+0.386775023,LastTimestamp:2026-06-08 19:31:46.999453391 +0000 UTC m=+0.386775023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-91.ec2.internal,}" Jun 08 19:31:47.018146 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.018125 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rp9w4" Jun 08 19:31:47.025194 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.025134 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-91.ec2.internal.18b731f53c766a38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-91.ec2.internal,UID:ip-10-0-129-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-91.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-91.ec2.internal,},FirstTimestamp:2026-06-08 19:31:46.999462456 +0000 UTC m=+0.386784090,LastTimestamp:2026-06-08 19:31:46.999462456 +0000 UTC m=+0.386784090,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-91.ec2.internal,}" Jun 08 19:31:47.028054 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.028036 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rp9w4" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038326 2561 manager.go:337] "Starting Device Plugin manager" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.038356 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038368 2561 server.go:87] "Starting device plugin registration server" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038556 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038568 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038665 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038744 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.038775 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.039158 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.039201 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.048342 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.049463 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.049508 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.049532 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.049601 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 19:31:47.052748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.051921 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:31:47.139023 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.139006 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:47.139874 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.139848 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:47.139874 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.139876 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:47.140009 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.139888 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:47.140009 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.139910 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.150070 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.150051 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.150116 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.150073 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-91.ec2.internal\": node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.150156 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.150136 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal"] Jun 08 19:31:47.150191 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.150185 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:47.150927 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.150915 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:47.150990 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.150941 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:47.150990 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.150950 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:47.152024 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152012 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:47.152141 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152125 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.152181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152156 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:47.152690 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152646 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:47.152690 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152654 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:47.152788 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152693 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:47.152788 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152704 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:47.152788 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152673 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:47.152788 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.152738 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:47.153694 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.153681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.153746 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.153703 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:47.155307 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.155290 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:47.155378 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.155316 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:47.155378 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.155329 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:47.177518 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.177502 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-91.ec2.internal\" not found" node="ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.178774 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.178759 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.181728 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.181713 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-91.ec2.internal\" not found" node="ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.183828 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.183813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cfac6ea5db18e3e6a382d21ddf68e901-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal\" (UID: \"cfac6ea5db18e3e6a382d21ddf68e901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.183898 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.183837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfac6ea5db18e3e6a382d21ddf68e901-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal\" (UID: \"cfac6ea5db18e3e6a382d21ddf68e901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.183898 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.183856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e9d0e36d2dcf7f73f9867c67d996aba-config\") pod \"kube-apiserver-proxy-ip-10-0-129-91.ec2.internal\" (UID: \"9e9d0e36d2dcf7f73f9867c67d996aba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.279661 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.279640 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.283962 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.283945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cfac6ea5db18e3e6a382d21ddf68e901-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal\" (UID: \"cfac6ea5db18e3e6a382d21ddf68e901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.284054 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.283990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfac6ea5db18e3e6a382d21ddf68e901-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal\" (UID: \"cfac6ea5db18e3e6a382d21ddf68e901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.284054 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.284020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e9d0e36d2dcf7f73f9867c67d996aba-config\") pod \"kube-apiserver-proxy-ip-10-0-129-91.ec2.internal\" (UID: \"9e9d0e36d2dcf7f73f9867c67d996aba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.284054 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.284044 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cfac6ea5db18e3e6a382d21ddf68e901-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal\" (UID: \"cfac6ea5db18e3e6a382d21ddf68e901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.284168 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.284057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfac6ea5db18e3e6a382d21ddf68e901-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal\" (UID: \"cfac6ea5db18e3e6a382d21ddf68e901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.284168 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.284072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e9d0e36d2dcf7f73f9867c67d996aba-config\") pod \"kube-apiserver-proxy-ip-10-0-129-91.ec2.internal\" (UID: \"9e9d0e36d2dcf7f73f9867c67d996aba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.380572 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.380543 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.481298 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.481248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.481370 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.481253 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.485857 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.485830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" Jun 08 19:31:47.581887 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.581850 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.682303 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.682259 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.782754 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.782681 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.855570 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.855547 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:31:47.883665 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.883643 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:47.926080 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.925938 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 19:31:47.926674 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.926176 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:31:47.926674 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:47.926205 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:31:47.984049 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:47.984020 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:48.007885 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:48.007855 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9d0e36d2dcf7f73f9867c67d996aba.slice/crio-4a0c087f35a0a187c2c6dc154753fffa4153029a65c1bc8fa9775452b3f7cb61 WatchSource:0}: Error finding container 4a0c087f35a0a187c2c6dc154753fffa4153029a65c1bc8fa9775452b3f7cb61: Status 404 returned error can't find the container with id 4a0c087f35a0a187c2c6dc154753fffa4153029a65c1bc8fa9775452b3f7cb61 Jun 08 19:31:48.008421 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:48.008402 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfac6ea5db18e3e6a382d21ddf68e901.slice/crio-827f41a9e2265938a3c43440a9447f4db7fd3b1752f6e172d10442bfe68ccfba WatchSource:0}: Error finding container 827f41a9e2265938a3c43440a9447f4db7fd3b1752f6e172d10442bfe68ccfba: Status 404 returned error can't find the container with id 827f41a9e2265938a3c43440a9447f4db7fd3b1752f6e172d10442bfe68ccfba Jun 08 19:31:48.012680 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.012661 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:31:48.030043 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.030015 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 19:26:47 +0000 UTC" deadline="2028-01-12 00:53:43.071648741 +0000 UTC" Jun 08 19:31:48.030043 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.030043 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13973h21m55.041609077s" Jun 08 19:31:48.052201 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.052118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" event={"ID":"cfac6ea5db18e3e6a382d21ddf68e901","Type":"ContainerStarted","Data":"827f41a9e2265938a3c43440a9447f4db7fd3b1752f6e172d10442bfe68ccfba"} Jun 08 19:31:48.053111 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.053090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" event={"ID":"9e9d0e36d2dcf7f73f9867c67d996aba","Type":"ContainerStarted","Data":"4a0c087f35a0a187c2c6dc154753fffa4153029a65c1bc8fa9775452b3f7cb61"} Jun 08 19:31:48.084383 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:48.084364 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:48.120657 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.120640 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:31:48.121497 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.121483 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:31:48.121555 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.121509 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:31:48.121555 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.121519 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:31:48.185231 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:48.185210 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-91.ec2.internal\" not found" Jun 08 19:31:48.212494 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.211265 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:31:48.282588 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.282572 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" Jun 08 19:31:48.293708 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.293692 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:31:48.294610 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.294599 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" Jun 08 19:31:48.307097 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.307050 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:31:48.442610 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.442579 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:31:48.842924 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.842719 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:31:48.962091 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.962052 2561 apiserver.go:52] "Watching apiserver" Jun 08 19:31:48.983272 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.983239 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 19:31:48.990040 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.990019 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 19:31:48.990409 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.990384 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-g7t5v","kube-system/global-pull-secret-syncer-f542t","kube-system/konnectivity-agent-kkjhz","kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sf7zn","openshift-image-registry/node-ca-kwg2l","openshift-network-diagnostics/network-check-target-6klsd","openshift-network-operator/iptables-alerter-dgbsg","openshift-ovn-kubernetes/ovnkube-node-6gcht","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59","openshift-dns/node-resolver-stmv4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal","openshift-multus/multus-6rjf7","openshift-multus/multus-additional-cni-plugins-h2kbq"] Jun 08 19:31:48.991828 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.991806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:48.992890 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.992873 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6rjf7" Jun 08 19:31:48.993853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.993832 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:48.995016 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.994991 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:48.996274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.996256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:48.997279 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.997256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:48.998623 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.998598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:48.999765 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.999741 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-km5wz\"" Jun 08 19:31:49.000215 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.999869 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-75wn9\"" Jun 08 19:31:49.000215 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:48.999947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:49.000215 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.000044 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:31:49.000215 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.000145 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 19:31:49.001242 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.001225 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.001339 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.001288 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:31:49.002290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.002273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.002397 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.002340 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:31:49.003437 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.003419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.004562 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.004545 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.008325 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.008244 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.008895 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.008874 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 19:31:49.009201 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.009074 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 19:31:49.011113 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.011026 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 19:31:49.011253 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.011101 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.011253 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.011217 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.012189 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012166 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.012279 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012200 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.012279 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012240 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 19:31:49.012390 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012303 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 19:31:49.012390 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012353 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 19:31:49.012595 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012581 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.012653 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 19:31:49.012708 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 19:31:49.012708 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012697 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.012803 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.012803 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012800 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.012891 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.012868 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 19:31:49.013603 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 19:31:49.013691 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013652 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.013806 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013786 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n6rsq\"" Jun 08 19:31:49.013866 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013847 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gqqvg\"" Jun 08 19:31:49.013915 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013876 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h7cg4\"" Jun 08 19:31:49.013915 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013891 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8h6hd\"" Jun 08 19:31:49.013915 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013906 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v7kkc\"" Jun 08 19:31:49.014084 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.013922 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.014084 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014054 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.014084 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014078 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 19:31:49.014227 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014188 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-25lnl\"" Jun 08 19:31:49.014429 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014411 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fskr\"" Jun 08 19:31:49.014511 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014433 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 19:31:49.014511 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014437 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 19:31:49.014511 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.014461 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 19:31:49.030594 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.030573 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:31:49.038134 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.038113 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vkhl6" Jun 08 19:31:49.054196 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.054173 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vkhl6" Jun 08 19:31:49.083841 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.083812 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 19:31:49.094254 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-node-log\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.094254 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-socket-dir-parent\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094254 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-hostroot\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-socket-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e6a7f61-2455-4de7-9822-37583e5eea2e-agent-certs\") pod \"konnectivity-agent-kkjhz\" (UID: \"3e6a7f61-2455-4de7-9822-37583e5eea2e\") " pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovnkube-script-lib\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-kubelet\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-etc-kubernetes\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e319a45-1505-40c4-a7d4-7cc613cb071d-host\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-system-cni-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094488 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-os-release\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-k8s-cni-cncf-io\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-cnibin\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2b89959-3a79-45b5-831c-f9d0e78f7455-host-slash\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5zdk\" (UniqueName: \"kubernetes.io/projected/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-kube-api-access-x5zdk\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-env-overrides\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6681202-33cf-4225-9a56-29295bd09923-multus-daemon-config\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysconfig\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.094836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-var-lib-kubelet\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-systemd-units\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxtj4\" (UniqueName: \"kubernetes.io/projected/4364d99c-f48c-4a28-b1c2-1b4997131e66-kube-api-access-xxtj4\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqp5v\" (UniqueName: \"kubernetes.io/projected/356c8b38-b4b5-44b0-aee6-e438f71a4f36-kube-api-access-qqp5v\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.094967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hm79\" (UniqueName: \"kubernetes.io/projected/f2b89959-3a79-45b5-831c-f9d0e78f7455-kube-api-access-2hm79\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k67w5\" (UniqueName: \"kubernetes.io/projected/8465fff2-4eda-4119-b49d-080b64a95f2e-kube-api-access-k67w5\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-tuned\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysctl-conf\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-sys\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e319a45-1505-40c4-a7d4-7cc613cb071d-serviceca\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-kubelet\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.095315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-ovn\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-899z9\" (UniqueName: \"kubernetes.io/projected/e815a195-bf1a-4736-ac52-3c5eaae249ae-kube-api-access-899z9\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-cnibin\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6681202-33cf-4225-9a56-29295bd09923-cni-binary-copy\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-systemd\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-run-netns\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysctl-d\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-registration-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-os-release\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a7766f7-2067-440e-88ac-7bc3a55c395e-kubelet-config\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-run\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-cni-bin\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-cni-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-netns\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.095853 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095750 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-modprobe-d\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-system-cni-dir\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-cni-netd\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.095877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-device-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-lib-modules\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-var-lib-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-etc-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-conf-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-log-socket\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e6a7f61-2455-4de7-9822-37583e5eea2e-konnectivity-ca\") pod \"konnectivity-agent-kkjhz\" (UID: \"3e6a7f61-2455-4de7-9822-37583e5eea2e\") " pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096778 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/096e07ba-fccc-4742-82a5-5f23c35c7a1f-hosts-file\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/096e07ba-fccc-4742-82a5-5f23c35c7a1f-tmp-dir\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jkg\" (UniqueName: \"kubernetes.io/projected/096e07ba-fccc-4742-82a5-5f23c35c7a1f-kube-api-access-n8jkg\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-sys-fs\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-host\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s26nv\" (UniqueName: \"kubernetes.io/projected/5e319a45-1505-40c4-a7d4-7cc613cb071d-kube-api-access-s26nv\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-slash\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.096969 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-systemd\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.096999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovnkube-config\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovn-node-metrics-cert\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-cni-bin\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-cni-multus\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-multus-certs\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4k6\" (UniqueName: \"kubernetes.io/projected/e6681202-33cf-4225-9a56-29295bd09923-kube-api-access-qj4k6\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a7766f7-2067-440e-88ac-7bc3a55c395e-dbus\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2b89959-3a79-45b5-831c-f9d0e78f7455-iptables-alerter-script\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-kubernetes\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.097484 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.097281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-tmp\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.197583 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysconfig\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-var-lib-kubelet\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-systemd-units\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxtj4\" (UniqueName: \"kubernetes.io/projected/4364d99c-f48c-4a28-b1c2-1b4997131e66-kube-api-access-xxtj4\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysconfig\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqp5v\" (UniqueName: \"kubernetes.io/projected/356c8b38-b4b5-44b0-aee6-e438f71a4f36-kube-api-access-qqp5v\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-var-lib-kubelet\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-systemd-units\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.197749 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hm79\" (UniqueName: \"kubernetes.io/projected/f2b89959-3a79-45b5-831c-f9d0e78f7455-kube-api-access-2hm79\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k67w5\" (UniqueName: \"kubernetes.io/projected/8465fff2-4eda-4119-b49d-080b64a95f2e-kube-api-access-k67w5\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-tuned\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysctl-conf\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.197999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-sys\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e319a45-1505-40c4-a7d4-7cc613cb071d-serviceca\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-kubelet\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-sys\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysctl-conf\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-kubelet\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.198217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198233 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-ovn\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-899z9\" (UniqueName: \"kubernetes.io/projected/e815a195-bf1a-4736-ac52-3c5eaae249ae-kube-api-access-899z9\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-cnibin\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6681202-33cf-4225-9a56-29295bd09923-cni-binary-copy\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198329 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-systemd\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-cnibin\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-run-netns\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.198424 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-systemd\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e319a45-1505-40c4-a7d4-7cc613cb071d-serviceca\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198510 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-ovn\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.198520 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:49.698467704 +0000 UTC m=+3.085789342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-run-netns\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysctl-d\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.198813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-registration-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-os-release\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a7766f7-2067-440e-88ac-7bc3a55c395e-kubelet-config\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-registration-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-run\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198795 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-os-release\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-sysctl-d\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-cni-bin\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-cni-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-run\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-cni-bin\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a7766f7-2067-440e-88ac-7bc3a55c395e-kubelet-config\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-netns\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198915 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6681202-33cf-4225-9a56-29295bd09923-cni-binary-copy\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-modprobe-d\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-netns\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.199622 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-system-cni-dir\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.198995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-cni-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-cni-netd\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-cni-netd\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199018 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-system-cni-dir\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-modprobe-d\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-device-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-device-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.199128 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.199179 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:31:49.699164953 +0000 UTC m=+3.086486573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-lib-modules\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-lib-modules\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-var-lib-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-etc-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.200460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-var-lib-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-conf-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-log-socket\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e6a7f61-2455-4de7-9822-37583e5eea2e-konnectivity-ca\") pod \"konnectivity-agent-kkjhz\" (UID: \"3e6a7f61-2455-4de7-9822-37583e5eea2e\") " pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-etc-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/096e07ba-fccc-4742-82a5-5f23c35c7a1f-hosts-file\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-log-socket\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199325 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-conf-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/096e07ba-fccc-4742-82a5-5f23c35c7a1f-hosts-file\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/096e07ba-fccc-4742-82a5-5f23c35c7a1f-tmp-dir\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jkg\" (UniqueName: \"kubernetes.io/projected/096e07ba-fccc-4742-82a5-5f23c35c7a1f-kube-api-access-n8jkg\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-sys-fs\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-host\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s26nv\" (UniqueName: \"kubernetes.io/projected/5e319a45-1505-40c4-a7d4-7cc613cb071d-kube-api-access-s26nv\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-slash\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-openvswitch\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.201257 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-systemd\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-slash\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-run-systemd\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199645 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-sys-fs\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-host\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovnkube-config\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovn-node-metrics-cert\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199773 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-cni-bin\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/096e07ba-fccc-4742-82a5-5f23c35c7a1f-tmp-dir\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e6a7f61-2455-4de7-9822-37583e5eea2e-konnectivity-ca\") pod \"konnectivity-agent-kkjhz\" (UID: \"3e6a7f61-2455-4de7-9822-37583e5eea2e\") " pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-cni-bin\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-cni-multus\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-multus-certs\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4k6\" (UniqueName: \"kubernetes.io/projected/e6681202-33cf-4225-9a56-29295bd09923-kube-api-access-qj4k6\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.199987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a7766f7-2067-440e-88ac-7bc3a55c395e-dbus\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200020 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-cni-multus\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2b89959-3a79-45b5-831c-f9d0e78f7455-iptables-alerter-script\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-kubernetes\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-multus-certs\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-tmp\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-node-log\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-socket-dir-parent\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-hostroot\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a7766f7-2067-440e-88ac-7bc3a55c395e-dbus\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-socket-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e6a7f61-2455-4de7-9822-37583e5eea2e-agent-certs\") pod \"konnectivity-agent-kkjhz\" (UID: \"3e6a7f61-2455-4de7-9822-37583e5eea2e\") " pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovnkube-script-lib\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-multus-socket-dir-parent\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-kubelet\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e815a195-bf1a-4736-ac52-3c5eaae249ae-node-log\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-etc-kubernetes\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.202993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e319a45-1505-40c4-a7d4-7cc613cb071d-host\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-hostroot\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-system-cni-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovnkube-config\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-os-release\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-k8s-cni-cncf-io\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-kubernetes\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-cnibin\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2b89959-3a79-45b5-831c-f9d0e78f7455-iptables-alerter-script\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2b89959-3a79-45b5-831c-f9d0e78f7455-host-slash\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200551 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8465fff2-4eda-4119-b49d-080b64a95f2e-socket-dir\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5zdk\" (UniqueName: \"kubernetes.io/projected/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-kube-api-access-x5zdk\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-env-overrides\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200592 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-run-k8s-cni-cncf-io\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6681202-33cf-4225-9a56-29295bd09923-multus-daemon-config\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e319a45-1505-40c4-a7d4-7cc613cb071d-host\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.203868 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-system-cni-dir\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200744 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-os-release\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4364d99c-f48c-4a28-b1c2-1b4997131e66-cnibin\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.200889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-host-var-lib-kubelet\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201131 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6681202-33cf-4225-9a56-29295bd09923-multus-daemon-config\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4364d99c-f48c-4a28-b1c2-1b4997131e66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-env-overrides\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2b89959-3a79-45b5-831c-f9d0e78f7455-host-slash\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovnkube-script-lib\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.201537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6681202-33cf-4225-9a56-29295bd09923-etc-kubernetes\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.202532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e815a195-bf1a-4736-ac52-3c5eaae249ae-ovn-node-metrics-cert\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.202727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-etc-tuned\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.203107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-tmp\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.204704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.204129 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e6a7f61-2455-4de7-9822-37583e5eea2e-agent-certs\") pod \"konnectivity-agent-kkjhz\" (UID: \"3e6a7f61-2455-4de7-9822-37583e5eea2e\") " pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.209380 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.209235 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:31:49.209380 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.209256 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:31:49.209380 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.209268 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:49.209380 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.209319 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:49.709304121 +0000 UTC m=+3.096625743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:49.211892 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.211026 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqp5v\" (UniqueName: \"kubernetes.io/projected/356c8b38-b4b5-44b0-aee6-e438f71a4f36-kube-api-access-qqp5v\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.211892 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.211318 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hm79\" (UniqueName: \"kubernetes.io/projected/f2b89959-3a79-45b5-831c-f9d0e78f7455-kube-api-access-2hm79\") pod \"iptables-alerter-dgbsg\" (UID: \"f2b89959-3a79-45b5-831c-f9d0e78f7455\") " pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.211892 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.211512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jkg\" (UniqueName: \"kubernetes.io/projected/096e07ba-fccc-4742-82a5-5f23c35c7a1f-kube-api-access-n8jkg\") pod \"node-resolver-stmv4\" (UID: \"096e07ba-fccc-4742-82a5-5f23c35c7a1f\") " pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.212434 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.212410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k67w5\" (UniqueName: \"kubernetes.io/projected/8465fff2-4eda-4119-b49d-080b64a95f2e-kube-api-access-k67w5\") pod \"aws-ebs-csi-driver-node-nhq59\" (UID: \"8465fff2-4eda-4119-b49d-080b64a95f2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.213254 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.213233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4k6\" (UniqueName: \"kubernetes.io/projected/e6681202-33cf-4225-9a56-29295bd09923-kube-api-access-qj4k6\") pod \"multus-6rjf7\" (UID: \"e6681202-33cf-4225-9a56-29295bd09923\") " pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.213611 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.213593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxtj4\" (UniqueName: \"kubernetes.io/projected/4364d99c-f48c-4a28-b1c2-1b4997131e66-kube-api-access-xxtj4\") pod \"multus-additional-cni-plugins-h2kbq\" (UID: \"4364d99c-f48c-4a28-b1c2-1b4997131e66\") " pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.214019 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.213998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5zdk\" (UniqueName: \"kubernetes.io/projected/da6ba5fc-ecb8-4c53-b432-8f0ab9e05591-kube-api-access-x5zdk\") pod \"tuned-sf7zn\" (UID: \"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591\") " pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.214589 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.214569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s26nv\" (UniqueName: \"kubernetes.io/projected/5e319a45-1505-40c4-a7d4-7cc613cb071d-kube-api-access-s26nv\") pod \"node-ca-kwg2l\" (UID: \"5e319a45-1505-40c4-a7d4-7cc613cb071d\") " pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.215289 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.215263 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-899z9\" (UniqueName: \"kubernetes.io/projected/e815a195-bf1a-4736-ac52-3c5eaae249ae-kube-api-access-899z9\") pod \"ovnkube-node-6gcht\" (UID: \"e815a195-bf1a-4736-ac52-3c5eaae249ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.302640 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.302611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" Jun 08 19:31:49.312326 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.312301 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6rjf7" Jun 08 19:31:49.319790 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.319772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:31:49.325281 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.325263 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" Jun 08 19:31:49.331741 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.331726 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" Jun 08 19:31:49.338310 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.338293 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kwg2l" Jun 08 19:31:49.346097 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.346038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:31:49.350537 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.350515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stmv4" Jun 08 19:31:49.356992 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.356964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dgbsg" Jun 08 19:31:49.704722 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.704634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:49.704722 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.704685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:49.704932 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.704800 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:49.704932 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.704822 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:49.704932 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.704889 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:50.704865505 +0000 UTC m=+4.092187135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:49.704932 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.704917 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:31:50.70490394 +0000 UTC m=+4.092225561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:49.805373 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:49.805347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:49.805492 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.805475 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:31:49.805530 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.805496 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:31:49.805530 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.805506 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:49.805594 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:49.805555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:50.805541962 +0000 UTC m=+4.192863582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:49.820384 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.820359 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6ba5fc_ecb8_4c53_b432_8f0ab9e05591.slice/crio-cf9c2ef38673a3bc9ae8a5a447cff39bbc04313c5cde1dce55eefdda751980f4 WatchSource:0}: Error finding container cf9c2ef38673a3bc9ae8a5a447cff39bbc04313c5cde1dce55eefdda751980f4: Status 404 returned error can't find the container with id cf9c2ef38673a3bc9ae8a5a447cff39bbc04313c5cde1dce55eefdda751980f4 Jun 08 19:31:49.821650 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.821623 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e319a45_1505_40c4_a7d4_7cc613cb071d.slice/crio-36b83921540db465e5013328934e04214f763512533d2a171d30550acedbce5c WatchSource:0}: Error finding container 36b83921540db465e5013328934e04214f763512533d2a171d30550acedbce5c: Status 404 returned error can't find the container with id 36b83921540db465e5013328934e04214f763512533d2a171d30550acedbce5c Jun 08 19:31:49.825687 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.825668 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode815a195_bf1a_4736_ac52_3c5eaae249ae.slice/crio-f4b5be2eff4adc11d1978b1bf91bcd031ccb798f35be041a9cf82507ba1f8799 WatchSource:0}: Error finding container f4b5be2eff4adc11d1978b1bf91bcd031ccb798f35be041a9cf82507ba1f8799: Status 404 returned error can't find the container with id f4b5be2eff4adc11d1978b1bf91bcd031ccb798f35be041a9cf82507ba1f8799 Jun 08 19:31:49.827486 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.827467 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6a7f61_2455_4de7_9822_37583e5eea2e.slice/crio-43a0bff3175d73ee6a1f4450ba2a629f83bef30f7a4c4b53da65ad2e321f49ba WatchSource:0}: Error finding container 43a0bff3175d73ee6a1f4450ba2a629f83bef30f7a4c4b53da65ad2e321f49ba: Status 404 returned error can't find the container with id 43a0bff3175d73ee6a1f4450ba2a629f83bef30f7a4c4b53da65ad2e321f49ba Jun 08 19:31:49.828248 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.828228 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096e07ba_fccc_4742_82a5_5f23c35c7a1f.slice/crio-d42245e527fed6a19225ad7f068459e98fc882683f3ec1228ec8dfcd56750e13 WatchSource:0}: Error finding container d42245e527fed6a19225ad7f068459e98fc882683f3ec1228ec8dfcd56750e13: Status 404 returned error can't find the container with id d42245e527fed6a19225ad7f068459e98fc882683f3ec1228ec8dfcd56750e13 Jun 08 19:31:49.830064 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.830043 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6681202_33cf_4225_9a56_29295bd09923.slice/crio-7c8a4960675de24881e1412edc83c0a8fc4f0b3cac9a745706ddd1be810a5659 WatchSource:0}: Error finding container 7c8a4960675de24881e1412edc83c0a8fc4f0b3cac9a745706ddd1be810a5659: Status 404 returned error can't find the container with id 7c8a4960675de24881e1412edc83c0a8fc4f0b3cac9a745706ddd1be810a5659 Jun 08 19:31:49.831356 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.831302 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b89959_3a79_45b5_831c_f9d0e78f7455.slice/crio-2e4f0df8ed7fbe0a0f6ace9c632c1315b0dac396a84575e008e048955e9f8037 WatchSource:0}: Error finding container 2e4f0df8ed7fbe0a0f6ace9c632c1315b0dac396a84575e008e048955e9f8037: Status 404 returned error can't find the container with id 2e4f0df8ed7fbe0a0f6ace9c632c1315b0dac396a84575e008e048955e9f8037 Jun 08 19:31:49.832670 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.832634 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8465fff2_4eda_4119_b49d_080b64a95f2e.slice/crio-61200f2afcdf3233d7fbba83309d0b3f2c8d2e87d2fbc9ce92a960a427e013be WatchSource:0}: Error finding container 61200f2afcdf3233d7fbba83309d0b3f2c8d2e87d2fbc9ce92a960a427e013be: Status 404 returned error can't find the container with id 61200f2afcdf3233d7fbba83309d0b3f2c8d2e87d2fbc9ce92a960a427e013be Jun 08 19:31:49.834038 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:31:49.833833 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4364d99c_f48c_4a28_b1c2_1b4997131e66.slice/crio-9617cde611773a8f2f625658cb60e5208d4438ce94ea421f4a669131fbbd5323 WatchSource:0}: Error finding container 9617cde611773a8f2f625658cb60e5208d4438ce94ea421f4a669131fbbd5323: Status 404 returned error can't find the container with id 9617cde611773a8f2f625658cb60e5208d4438ce94ea421f4a669131fbbd5323 Jun 08 19:31:50.056294 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.056251 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:26:49 +0000 UTC" deadline="2027-12-12 05:49:50.810781422 +0000 UTC" Jun 08 19:31:50.056574 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.056296 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13234h18m0.754489139s" Jun 08 19:31:50.057779 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.057758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kwg2l" event={"ID":"5e319a45-1505-40c4-a7d4-7cc613cb071d","Type":"ContainerStarted","Data":"36b83921540db465e5013328934e04214f763512533d2a171d30550acedbce5c"} Jun 08 19:31:50.058915 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.058882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" event={"ID":"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591","Type":"ContainerStarted","Data":"cf9c2ef38673a3bc9ae8a5a447cff39bbc04313c5cde1dce55eefdda751980f4"} Jun 08 19:31:50.060645 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.060625 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" event={"ID":"9e9d0e36d2dcf7f73f9867c67d996aba","Type":"ContainerStarted","Data":"cc64216262505a5e59293551e1b3f704cf0b114fd08d07de2549f054613e9a69"} Jun 08 19:31:50.061746 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.061726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerStarted","Data":"9617cde611773a8f2f625658cb60e5208d4438ce94ea421f4a669131fbbd5323"} Jun 08 19:31:50.062684 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.062665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stmv4" event={"ID":"096e07ba-fccc-4742-82a5-5f23c35c7a1f","Type":"ContainerStarted","Data":"d42245e527fed6a19225ad7f068459e98fc882683f3ec1228ec8dfcd56750e13"} Jun 08 19:31:50.063694 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.063672 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkjhz" event={"ID":"3e6a7f61-2455-4de7-9822-37583e5eea2e","Type":"ContainerStarted","Data":"43a0bff3175d73ee6a1f4450ba2a629f83bef30f7a4c4b53da65ad2e321f49ba"} Jun 08 19:31:50.064841 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.064818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"f4b5be2eff4adc11d1978b1bf91bcd031ccb798f35be041a9cf82507ba1f8799"} Jun 08 19:31:50.065899 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.065877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" event={"ID":"8465fff2-4eda-4119-b49d-080b64a95f2e","Type":"ContainerStarted","Data":"61200f2afcdf3233d7fbba83309d0b3f2c8d2e87d2fbc9ce92a960a427e013be"} Jun 08 19:31:50.066905 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.066887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dgbsg" event={"ID":"f2b89959-3a79-45b5-831c-f9d0e78f7455","Type":"ContainerStarted","Data":"2e4f0df8ed7fbe0a0f6ace9c632c1315b0dac396a84575e008e048955e9f8037"} Jun 08 19:31:50.067854 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.067833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6rjf7" event={"ID":"e6681202-33cf-4225-9a56-29295bd09923","Type":"ContainerStarted","Data":"7c8a4960675de24881e1412edc83c0a8fc4f0b3cac9a745706ddd1be810a5659"} Jun 08 19:31:50.076663 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.076621 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-91.ec2.internal" podStartSLOduration=2.076600084 podStartE2EDuration="2.076600084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:50.076246149 +0000 UTC m=+3.463567790" watchObservedRunningTime="2026-06-08 19:31:50.076600084 +0000 UTC m=+3.463921726" Jun 08 19:31:50.235560 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.235529 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:31:50.712533 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.712496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:50.712731 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.712563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:50.712802 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.712747 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:50.712857 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.712811 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:31:52.712792613 +0000 UTC m=+6.100114257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:50.713603 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.713255 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:50.713603 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.713309 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:52.713293652 +0000 UTC m=+6.100615278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:50.813850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:50.813814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:50.814390 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.814363 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:31:50.814468 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.814400 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:31:50.814468 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.814413 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:50.814582 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:50.814483 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:52.814458188 +0000 UTC m=+6.201779822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:51.052466 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.052383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:51.052615 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:51.052526 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:31:51.052674 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.052621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:51.052723 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:51.052703 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:31:51.052818 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.052772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:51.052875 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:51.052856 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:31:51.057153 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.057123 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:26:49 +0000 UTC" deadline="2027-11-28 02:01:56.727206738 +0000 UTC" Jun 08 19:31:51.057153 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.057154 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12894h30m5.670057463s" Jun 08 19:31:51.094056 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.093753 2561 generic.go:356] "Generic (PLEG): container finished" podID="cfac6ea5db18e3e6a382d21ddf68e901" containerID="ce82c767d935596cb78f56a6386d1b17b6431e6e526d732ebd8d73b7c39da50c" exitCode=0 Jun 08 19:31:51.094056 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:51.093852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" event={"ID":"cfac6ea5db18e3e6a382d21ddf68e901","Type":"ContainerDied","Data":"ce82c767d935596cb78f56a6386d1b17b6431e6e526d732ebd8d73b7c39da50c"} Jun 08 19:31:52.115123 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:52.115082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" event={"ID":"cfac6ea5db18e3e6a382d21ddf68e901","Type":"ContainerStarted","Data":"7447b37d4b5a8a233c61dcd420784ba835fb6b201aaaf7ec548983023b0dd601"} Jun 08 19:31:52.727403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:52.727343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:52.727579 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:52.727444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:52.727579 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.727574 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:52.727703 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.727636 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:56.727615973 +0000 UTC m=+10.114937617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:52.728122 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.728099 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:52.728201 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.728156 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:31:56.728138613 +0000 UTC m=+10.115460247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:52.828353 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:52.828297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:52.828529 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.828468 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:31:52.828529 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.828501 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:31:52.828529 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.828515 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:52.828688 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:52.828575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:31:56.828555728 +0000 UTC m=+10.215877362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:53.049987 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:53.049902 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:53.050134 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:53.050070 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:31:53.050134 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:53.049910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:53.050134 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:53.050105 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:53.050302 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:53.050252 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:31:53.050392 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:53.050361 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:31:55.050567 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:55.050087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:55.050567 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:55.050209 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:31:55.050567 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:55.050337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:55.050567 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:55.050455 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:31:55.050567 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:55.050515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:55.051363 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:55.050599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:31:56.759202 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:56.759166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:56.759652 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.759348 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:56.759652 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.759428 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:04.759408485 +0000 UTC m=+18.146730111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:31:56.759954 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:56.759801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:56.759954 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.759923 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:56.760140 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.760003 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:04.759972417 +0000 UTC m=+18.147294036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:31:56.860714 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:56.860683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:56.860911 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.860890 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:31:56.861023 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.860921 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:31:56.861023 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.860933 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:56.861023 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:56.860997 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:04.860966924 +0000 UTC m=+18.248288548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:31:57.051216 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:57.050732 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:57.051216 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:57.050858 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:57.051216 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:57.050852 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:31:57.051216 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:57.050945 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:31:57.051216 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:57.051063 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:57.051216 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:57.051138 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:31:59.050138 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:59.050106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:31:59.050138 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:59.050144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:31:59.050700 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:59.050233 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:31:59.050700 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:59.050660 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:31:59.050798 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:31:59.050710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:31:59.050798 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:31:59.050779 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:01.050094 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:01.050065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:01.050630 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:01.050106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:01.050630 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:01.050064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:01.050630 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:01.050197 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:01.050630 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:01.050305 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:01.050630 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:01.050408 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:03.050704 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:03.050667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:03.051269 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:03.050680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:03.051269 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:03.050798 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:03.051269 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:03.050899 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:03.051269 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:03.050945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:03.051269 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:03.051018 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:04.139516 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.139278 2561 generic.go:356] "Generic (PLEG): container finished" podID="4364d99c-f48c-4a28-b1c2-1b4997131e66" containerID="80af8d28f151d8dc61dd48636583328ba7820863c15ef57849c1d5d8a0224a86" exitCode=0 Jun 08 19:32:04.140349 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.139363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerDied","Data":"80af8d28f151d8dc61dd48636583328ba7820863c15ef57849c1d5d8a0224a86"} Jun 08 19:32:04.141412 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.141387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stmv4" event={"ID":"096e07ba-fccc-4742-82a5-5f23c35c7a1f","Type":"ContainerStarted","Data":"7b10ed23dece2800f636dfd1d0a499d706d39889b47ec63820d8925337594a30"} Jun 08 19:32:04.143061 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.143038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkjhz" event={"ID":"3e6a7f61-2455-4de7-9822-37583e5eea2e","Type":"ContainerStarted","Data":"e554f9809a54e17db183e17e3a7f9c5aaf8c6b0cbd1db7a24e376066bd4fcfad"} Jun 08 19:32:04.144636 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.144612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" event={"ID":"8465fff2-4eda-4119-b49d-080b64a95f2e","Type":"ContainerStarted","Data":"24f30b5fd321097a405008d0762d42413c1611bb22ac7cd81861803cd0d898fb"} Jun 08 19:32:04.146341 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.146127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6rjf7" event={"ID":"e6681202-33cf-4225-9a56-29295bd09923","Type":"ContainerStarted","Data":"0d55e7ef67ad543402edfff7e92c84b3a7131f1578360e06ca075bed1cf8d26c"} Jun 08 19:32:04.147648 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.147621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kwg2l" event={"ID":"5e319a45-1505-40c4-a7d4-7cc613cb071d","Type":"ContainerStarted","Data":"3f67b83673c4590c800b29ec46ac04d498f19c7c999211009431b5edd8e3ecb7"} Jun 08 19:32:04.149273 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.149251 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" event={"ID":"da6ba5fc-ecb8-4c53-b432-8f0ab9e05591","Type":"ContainerStarted","Data":"28259a763ad0ddbf7fe2dd5f152e19cd4318fb1b9f6a90762e7d9f8256cf28eb"} Jun 08 19:32:04.186417 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.186349 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-91.ec2.internal" podStartSLOduration=16.186328406 podStartE2EDuration="16.186328406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:31:52.13538189 +0000 UTC m=+5.522703533" watchObservedRunningTime="2026-06-08 19:32:04.186328406 +0000 UTC m=+17.573650049" Jun 08 19:32:04.242498 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.242403 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-stmv4" podStartSLOduration=3.574265481 podStartE2EDuration="17.242382167s" totalImagesPullingTime="13.668116686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:04.211387961 +0000 UTC m=+17.598709603" watchObservedRunningTime="2026-06-08 19:32:04.242382167 +0000 UTC m=+17.629703811" Jun 08 19:32:04.242682 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.242548 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6rjf7" podStartSLOduration=3.520362769 podStartE2EDuration="17.242541133s" totalImagesPullingTime="13.722178364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:04.242254837 +0000 UTC m=+17.629576480" watchObservedRunningTime="2026-06-08 19:32:04.242541133 +0000 UTC m=+17.629862776" Jun 08 19:32:04.318197 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.318144 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kkjhz" podStartSLOduration=3.686700964 podStartE2EDuration="17.318118617s" totalImagesPullingTime="13.631417653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:04.278863152 +0000 UTC m=+17.666184786" watchObservedRunningTime="2026-06-08 19:32:04.318118617 +0000 UTC m=+17.705440258" Jun 08 19:32:04.318393 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.318267 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sf7zn" podStartSLOduration=3.621244373 podStartE2EDuration="17.318258807s" totalImagesPullingTime="13.697014434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:04.317931606 +0000 UTC m=+17.705253259" watchObservedRunningTime="2026-06-08 19:32:04.318258807 +0000 UTC m=+17.705580449" Jun 08 19:32:04.349290 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.349244 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kwg2l" podStartSLOduration=3.675415828 podStartE2EDuration="17.349229038s" totalImagesPullingTime="13.67381321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:04.349155767 +0000 UTC m=+17.736477413" watchObservedRunningTime="2026-06-08 19:32:04.349229038 +0000 UTC m=+17.736550680" Jun 08 19:32:04.574707 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.574683 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 19:32:04.827872 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.827834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:04.828095 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.827895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:04.828095 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.828014 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:32:04.828095 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.828084 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:20.828066536 +0000 UTC m=+34.215388174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:32:04.828253 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.828024 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:32:04.828253 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.828161 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:20.828140712 +0000 UTC m=+34.215462335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:32:04.897311 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.897273 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:32:04.928670 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:04.928632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:04.928865 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.928830 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:32:04.928865 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.928860 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:32:04.929037 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.928875 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:32:04.929037 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:04.928934 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:20.928915946 +0000 UTC m=+34.316237589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:32:05.048464 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.048309 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T19:32:04.574703886Z","UUID":"c144e9e8-91d1-4155-a540-a49f76d7d181","Handler":null,"Name":"","Endpoint":""} Jun 08 19:32:05.050398 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.049929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:05.050398 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:05.050071 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:05.050597 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.050482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:05.050654 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:05.050617 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:05.050808 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.050773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:05.050938 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:05.050881 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:05.052110 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.052092 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 19:32:05.052197 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.052133 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 19:32:05.154668 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.154545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" event={"ID":"8465fff2-4eda-4119-b49d-080b64a95f2e","Type":"ContainerStarted","Data":"460e13eca37ea93ac14c40d428a5b9b55b468a5c5d33734b7dbfe36dd802c043"} Jun 08 19:32:05.156815 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.156363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dgbsg" event={"ID":"f2b89959-3a79-45b5-831c-f9d0e78f7455","Type":"ContainerStarted","Data":"1b47c1190db2821db10af9965065ded290f423fe55586ad1d875943c3d2f7631"} Jun 08 19:32:05.177331 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.177271 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dgbsg" podStartSLOduration=4.549934666 podStartE2EDuration="18.177251856s" totalImagesPullingTime="13.62731719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:05.177190289 +0000 UTC m=+18.564511932" watchObservedRunningTime="2026-06-08 19:32:05.177251856 +0000 UTC m=+18.564573499" Jun 08 19:32:05.542869 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.542832 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:32:05.543475 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:05.543452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:32:06.161886 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:06.161845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" event={"ID":"8465fff2-4eda-4119-b49d-080b64a95f2e","Type":"ContainerStarted","Data":"92cf2ed7e80806e7fbd875e84110792135ec994a3751a0a022fb55a6859e8151"} Jun 08 19:32:06.162771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:06.162741 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kkjhz" Jun 08 19:32:06.188597 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:06.188541 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhq59" podStartSLOduration=3.811054353 podStartE2EDuration="19.188520068s" totalImagesPullingTime="15.377465715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:06.188453334 +0000 UTC m=+19.575774987" watchObservedRunningTime="2026-06-08 19:32:06.188520068 +0000 UTC m=+19.575841711" Jun 08 19:32:07.050892 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:07.050862 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:07.051116 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:07.050968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:07.051116 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:07.051019 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:07.051116 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:07.051061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:07.051116 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:07.051062 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:07.051305 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:07.051147 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:09.054454 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:09.054424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:09.054454 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:09.054454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:09.055040 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:09.054424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:09.055040 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:09.054559 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:09.055040 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:09.054677 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:09.055040 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:09.054796 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:11.050030 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:11.049996 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:11.050586 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:11.049998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:11.050586 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:11.050129 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:11.050586 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:11.050003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:11.050586 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:11.050251 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:11.050586 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:11.050298 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:13.050882 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.050715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:13.051612 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.050710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:13.051612 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:13.050965 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:13.051612 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.050716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:13.051612 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:13.051036 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:13.051612 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:13.051117 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:13.176726 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.176691 2561 generic.go:356] "Generic (PLEG): container finished" podID="4364d99c-f48c-4a28-b1c2-1b4997131e66" containerID="75ee8befca741427d4835772f65dd2e475ba4749a46afa18e75572626555cb17" exitCode=0 Jun 08 19:32:13.176902 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.176778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerDied","Data":"75ee8befca741427d4835772f65dd2e475ba4749a46afa18e75572626555cb17"} Jun 08 19:32:13.179725 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.179705 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:32:13.180097 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180079 2561 generic.go:356] "Generic (PLEG): container finished" podID="e815a195-bf1a-4736-ac52-3c5eaae249ae" containerID="725f6b4aaa627f46cd688b1518b6565c39dbcc8de3940149a7fb5d0ced390ce2" exitCode=1 Jun 08 19:32:13.180175 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"60edcd3665b3302bfd82615c1e121d307253052c73856bfa592052dcd4307116"} Jun 08 19:32:13.180175 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180168 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"0edc476fc20b8b943070374350d7fa2099e08a4dbd70d808115f095d36bd3caa"} Jun 08 19:32:13.180249 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180198 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"04b3cbacca308d8a0d496a5662b365799159e56dabd46073a31e30e4e215fb85"} Jun 08 19:32:13.180249 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"c9127295b11ec9ca6946b3d6cd9f1eb6be00e449cca1591fdcc7146a58f0bc10"} Jun 08 19:32:13.180313 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerDied","Data":"725f6b4aaa627f46cd688b1518b6565c39dbcc8de3940149a7fb5d0ced390ce2"} Jun 08 19:32:13.180313 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:13.180280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"b6b3cbea9980e8ffcd084c2fa1499e2e7e2c63ce479da0f22d2cb5ff5fd5ff01"} Jun 08 19:32:15.050521 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.050485 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:15.050521 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.050499 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:15.050521 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.050507 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:15.051047 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:15.050580 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:15.051047 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:15.050669 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:15.051047 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:15.050716 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:15.185786 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.185710 2561 generic.go:356] "Generic (PLEG): container finished" podID="4364d99c-f48c-4a28-b1c2-1b4997131e66" containerID="0f99fc3ad31750e3cdffcface7e50f7d4aabc4871575cae71569d4d5ef09ada8" exitCode=0 Jun 08 19:32:15.185923 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.185798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerDied","Data":"0f99fc3ad31750e3cdffcface7e50f7d4aabc4871575cae71569d4d5ef09ada8"} Jun 08 19:32:15.188903 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.188885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:32:15.191904 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:15.191875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"1ea239a856aabc56e679887b940116eeaf03e426c1611f9c89aadad454234d7e"} Jun 08 19:32:17.051121 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.050953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:17.051425 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.051012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:17.051425 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:17.051179 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:17.051425 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.051045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:17.051425 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:17.051273 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:17.051425 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:17.051403 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:17.198624 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.198592 2561 generic.go:356] "Generic (PLEG): container finished" podID="4364d99c-f48c-4a28-b1c2-1b4997131e66" containerID="8ad9f1c518756f592249b42b5b8b736f3e0736c758e1e4460266cd9d23b9530c" exitCode=0 Jun 08 19:32:17.198742 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.198682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerDied","Data":"8ad9f1c518756f592249b42b5b8b736f3e0736c758e1e4460266cd9d23b9530c"} Jun 08 19:32:17.202009 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.201992 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:32:17.202362 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.202343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"3dd4d6aeb10659630aee7ed349eea29823449a7a378c78637b11701db51cffbb"} Jun 08 19:32:17.202663 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.202641 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:32:17.202833 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.202705 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:32:17.202833 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.202753 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:32:17.202833 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.202809 2561 scope.go:117] "RemoveContainer" containerID="725f6b4aaa627f46cd688b1518b6565c39dbcc8de3940149a7fb5d0ced390ce2" Jun 08 19:32:17.219311 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.219287 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:32:17.219905 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:17.219886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:32:18.209103 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:18.209075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:32:18.209612 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:18.209500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" event={"ID":"e815a195-bf1a-4736-ac52-3c5eaae249ae","Type":"ContainerStarted","Data":"0ce4760ff8f1729cef7f0d43b90d0d9d02ae703e74b95098a04f0d75753ea105"} Jun 08 19:32:18.238935 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:18.238892 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" podStartSLOduration=8.738988479 podStartE2EDuration="31.238878085s" totalImagesPullingTime="22.499889606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:18.237223915 +0000 UTC m=+31.624545559" watchObservedRunningTime="2026-06-08 19:32:18.238878085 +0000 UTC m=+31.626199727" Jun 08 19:32:19.050951 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.050715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:19.051121 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:19.051074 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:19.051121 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.050741 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:19.051235 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:19.051183 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:19.051235 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.050739 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:19.051333 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:19.051264 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:19.374480 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.374441 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7t5v"] Jun 08 19:32:19.374894 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.374627 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:19.374894 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:19.374742 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:19.378129 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.377865 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f542t"] Jun 08 19:32:19.378129 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.377968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:19.378129 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:19.378091 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:19.378782 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.378742 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6klsd"] Jun 08 19:32:19.378889 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:19.378833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:19.378991 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:19.378950 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:20.853329 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:20.853297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:20.853778 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:20.853378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:20.853778 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.853459 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:32:20.853778 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.853503 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:32:20.853778 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.853536 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:52.853515762 +0000 UTC m=+66.240837385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:32:20.853778 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.853558 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret podName:9a7766f7-2067-440e-88ac-7bc3a55c395e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:52.853547832 +0000 UTC m=+66.240869454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret") pod "global-pull-secret-syncer-f542t" (UID: "9a7766f7-2067-440e-88ac-7bc3a55c395e") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:32:20.954283 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:20.954249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:20.954426 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.954402 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:32:20.954426 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.954420 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:32:20.954534 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.954431 2561 projected.go:196] Error preparing data for projected volume kube-api-access-hms7j for pod openshift-network-diagnostics/network-check-target-6klsd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:32:20.954534 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:20.954492 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j podName:e7ca8091-0b56-44ac-a17c-e0f694210e2e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:52.954477661 +0000 UTC m=+66.341799281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hms7j" (UniqueName: "kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j") pod "network-check-target-6klsd" (UID: "e7ca8091-0b56-44ac-a17c-e0f694210e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:32:21.050766 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:21.050552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:21.050766 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:21.050557 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:21.050766 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:21.050694 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:21.051142 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:21.050805 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:21.051142 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:21.050566 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:21.051142 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:21.050908 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:22.221785 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:22.221753 2561 generic.go:356] "Generic (PLEG): container finished" podID="4364d99c-f48c-4a28-b1c2-1b4997131e66" containerID="8b83c4e389a7aacdc1f48a4ca75b1b1eaf802ad857a4839a047d2746bd2dd6d3" exitCode=0 Jun 08 19:32:22.222506 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:22.221800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerDied","Data":"8b83c4e389a7aacdc1f48a4ca75b1b1eaf802ad857a4839a047d2746bd2dd6d3"} Jun 08 19:32:23.050627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:23.050594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:23.050627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:23.050610 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:23.050858 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:23.050685 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:23.050858 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:23.050760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:23.050858 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:23.050788 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:23.051035 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:23.050877 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:23.226825 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:23.226796 2561 generic.go:356] "Generic (PLEG): container finished" podID="4364d99c-f48c-4a28-b1c2-1b4997131e66" containerID="7f0f425839d741e41663c95fc358e1b6372d0311cf5c5d44eda3cfc189f05ea1" exitCode=0 Jun 08 19:32:23.227185 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:23.226830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerDied","Data":"7f0f425839d741e41663c95fc358e1b6372d0311cf5c5d44eda3cfc189f05ea1"} Jun 08 19:32:24.232439 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:24.232254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" event={"ID":"4364d99c-f48c-4a28-b1c2-1b4997131e66","Type":"ContainerStarted","Data":"5705446534cfc7e90d74a4750e3cf0721ea12c6f074ff6f72dfd3fa8713133dd"} Jun 08 19:32:24.271845 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:24.271801 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h2kbq" podStartSLOduration=8.916080201 podStartE2EDuration="37.271787132s" totalImagesPullingTime="28.355706931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:24.266580861 +0000 UTC m=+37.653902503" watchObservedRunningTime="2026-06-08 19:32:24.271787132 +0000 UTC m=+37.659108773" Jun 08 19:32:25.050477 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.050445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:25.050588 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.050445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:25.050588 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.050573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6klsd" podUID="e7ca8091-0b56-44ac-a17c-e0f694210e2e" Jun 08 19:32:25.050693 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.050461 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:25.050693 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.050630 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:32:25.050795 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.050723 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f542t" podUID="9a7766f7-2067-440e-88ac-7bc3a55c395e" Jun 08 19:32:25.468073 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.468050 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-91.ec2.internal" event="NodeReady" Jun 08 19:32:25.468360 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.468140 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 19:32:25.504050 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.504027 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs"] Jun 08 19:32:25.506504 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.506489 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:25.507577 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.507559 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65b6b49b68-7gdkl"] Jun 08 19:32:25.508993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.508960 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 19:32:25.509133 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.509113 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 19:32:25.509381 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.509366 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.509454 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.509417 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jsvg2\"" Jun 08 19:32:25.511824 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.511808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4np7h\"" Jun 08 19:32:25.511914 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.511869 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 19:32:25.511914 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.511892 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 19:32:25.512160 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.512147 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 19:32:25.517537 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.517518 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 19:32:25.517910 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.517893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs"] Jun 08 19:32:25.526927 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.526909 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-td2cl"] Jun 08 19:32:25.528447 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.528429 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qz768"] Jun 08 19:32:25.528551 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.528519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.530375 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.530354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65b6b49b68-7gdkl"] Jun 08 19:32:25.530507 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.530410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.531518 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.531502 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 19:32:25.531609 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.531521 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 19:32:25.531609 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.531593 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5rqbk\"" Jun 08 19:32:25.531711 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.531626 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 19:32:25.532679 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.532643 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 19:32:25.532679 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.532660 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c99cx\"" Jun 08 19:32:25.532789 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.532698 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 19:32:25.539352 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.539332 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-td2cl"] Jun 08 19:32:25.542572 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.542554 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz768"] Jun 08 19:32:25.690371 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.690371 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb9cf\" (UniqueName: \"kubernetes.io/projected/0eaac090-60d0-4498-a991-7ab711ca39d0-kube-api-access-vb9cf\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.690561 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-ca-trust-extracted\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690561 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-image-registry-private-configuration\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690561 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-certificates\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690561 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnhp6\" (UniqueName: \"kubernetes.io/projected/bf113bd6-2ab0-4adf-8ac6-9f0f71805db8-kube-api-access-gnhp6\") pod \"ingress-canary-td2cl\" (UID: \"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8\") " pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.690561 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-trusted-ca\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0eaac090-60d0-4498-a991-7ab711ca39d0-config-volume\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf113bd6-2ab0-4adf-8ac6-9f0f71805db8-cert\") pod \"ingress-canary-td2cl\" (UID: \"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8\") " pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-bound-sa-token\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jzb\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-kube-api-access-r5jzb\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:25.690739 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-installation-pull-secrets\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.690971 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eaac090-60d0-4498-a991-7ab711ca39d0-tmp-dir\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.690971 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.690801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c636ac1e-112f-4528-8d12-714641b72e8e-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:25.791662 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.791662 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb9cf\" (UniqueName: \"kubernetes.io/projected/0eaac090-60d0-4498-a991-7ab711ca39d0-kube-api-access-vb9cf\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.791662 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-ca-trust-extracted\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-image-registry-private-configuration\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-certificates\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnhp6\" (UniqueName: \"kubernetes.io/projected/bf113bd6-2ab0-4adf-8ac6-9f0f71805db8-kube-api-access-gnhp6\") pod \"ingress-canary-td2cl\" (UID: \"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8\") " pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.791740 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-trusted-ca\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.791804 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:26.291786552 +0000 UTC m=+39.679108179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:25.791850 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0eaac090-60d0-4498-a991-7ab711ca39d0-config-volume\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf113bd6-2ab0-4adf-8ac6-9f0f71805db8-cert\") pod \"ingress-canary-td2cl\" (UID: \"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8\") " pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-bound-sa-token\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jzb\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-kube-api-access-r5jzb\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.791971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-installation-pull-secrets\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eaac090-60d0-4498-a991-7ab711ca39d0-tmp-dir\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792043 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-ca-trust-extracted\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c636ac1e-112f-4528-8d12-714641b72e8e-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.792140 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.792164 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.792179 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:25.792207 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.792190 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:26.292172207 +0000 UTC m=+39.679493828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:25.792735 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:25.792221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:26.292206859 +0000 UTC m=+39.679528480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:25.792735 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792395 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-certificates\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.792735 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0eaac090-60d0-4498-a991-7ab711ca39d0-config-volume\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.792826 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792735 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eaac090-60d0-4498-a991-7ab711ca39d0-tmp-dir\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.792826 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.792738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c636ac1e-112f-4528-8d12-714641b72e8e-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:25.793808 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.793787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-trusted-ca\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.796105 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.796078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-installation-pull-secrets\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.796105 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.796093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf113bd6-2ab0-4adf-8ac6-9f0f71805db8-cert\") pod \"ingress-canary-td2cl\" (UID: \"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8\") " pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.796205 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.796190 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-image-registry-private-configuration\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.800245 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.800223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb9cf\" (UniqueName: \"kubernetes.io/projected/0eaac090-60d0-4498-a991-7ab711ca39d0-kube-api-access-vb9cf\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:25.800697 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.800670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnhp6\" (UniqueName: \"kubernetes.io/projected/bf113bd6-2ab0-4adf-8ac6-9f0f71805db8-kube-api-access-gnhp6\") pod \"ingress-canary-td2cl\" (UID: \"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8\") " pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.800860 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.800833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-bound-sa-token\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.801021 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.801000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jzb\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-kube-api-access-r5jzb\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:25.838485 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.838467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-td2cl" Jun 08 19:32:25.967214 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:25.967183 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-td2cl"] Jun 08 19:32:25.970590 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:32:25.970560 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf113bd6_2ab0_4adf_8ac6_9f0f71805db8.slice/crio-b448f582f60fcf5444f163c0e691ff2b0ba4a906871ae265a4a66510826f2516 WatchSource:0}: Error finding container b448f582f60fcf5444f163c0e691ff2b0ba4a906871ae265a4a66510826f2516: Status 404 returned error can't find the container with id b448f582f60fcf5444f163c0e691ff2b0ba4a906871ae265a4a66510826f2516 Jun 08 19:32:26.237235 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:26.237209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-td2cl" event={"ID":"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8","Type":"ContainerStarted","Data":"b448f582f60fcf5444f163c0e691ff2b0ba4a906871ae265a4a66510826f2516"} Jun 08 19:32:26.295963 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:26.295939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:26.296067 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:26.296002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:26.296067 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:26.296036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:26.296133 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296094 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:26.296133 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296114 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:26.296133 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296124 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:26.296220 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296137 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:26.296220 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296169 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:27.296147373 +0000 UTC m=+40.683469013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:26.296220 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296187 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:27.296177738 +0000 UTC m=+40.683499358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:26.296220 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:26.296197 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:27.296192579 +0000 UTC m=+40.683514199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:27.051130 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.051096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:27.051733 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.051180 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:27.051733 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.051217 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:27.054446 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.054425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4gvvs\"" Jun 08 19:32:27.054446 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.054435 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:32:27.055327 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.055305 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:32:27.055327 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.055319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng5m4\"" Jun 08 19:32:27.055521 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.055367 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:32:27.055521 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.055305 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:32:27.305151 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.305083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:27.305151 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.305133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:27.305161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305226 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305261 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305293 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:29.305274874 +0000 UTC m=+42.692596499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305296 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305311 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:27.305323 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305326 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:29.305304223 +0000 UTC m=+42.692625850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:27.305822 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:27.305355 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:29.305343394 +0000 UTC m=+42.692665014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:29.246334 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:29.246298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-td2cl" event={"ID":"bf113bd6-2ab0-4adf-8ac6-9f0f71805db8","Type":"ContainerStarted","Data":"d2c1d0e5d5912606ab4547e57c199c2c2c7052a79372cb8b2086263fa99c9067"} Jun 08 19:32:29.262832 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:29.262763 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-td2cl" podStartSLOduration=1.886938288 podStartE2EDuration="4.262743758s" totalImagesPullingTime="2.37580547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:29.262344269 +0000 UTC m=+42.649665914" watchObservedRunningTime="2026-06-08 19:32:29.262743758 +0000 UTC m=+42.650065400" Jun 08 19:32:29.321539 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:29.321514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:29.321659 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:29.321553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:29.321659 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:29.321599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:29.321747 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321658 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:29.321747 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321679 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:29.321747 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321692 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:29.321747 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321733 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:29.321747 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321741 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:33.321722827 +0000 UTC m=+46.709044467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:29.321912 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:33.321750592 +0000 UTC m=+46.709072212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:29.321912 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:29.321776 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:33.321766598 +0000 UTC m=+46.709088220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:33.349434 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:33.349379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:33.349467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:33.349507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349560 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349617 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349638 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:41.349618301 +0000 UTC m=+54.736939936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349665 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:41.349652281 +0000 UTC m=+54.736973904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349621 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349678 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:33.350173 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:33.349719 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:41.349708664 +0000 UTC m=+54.737030307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:41.404402 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:41.404372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:41.404429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:41.404460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404535 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404597 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:57.404581649 +0000 UTC m=+70.791903273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404612 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404541 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404630 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404668 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:32:57.404655799 +0000 UTC m=+70.791977435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:41.404920 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:41.404685 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:32:57.404680183 +0000 UTC m=+70.792001802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:48.914987 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.914937 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx"] Jun 08 19:32:48.961180 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.961152 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx"] Jun 08 19:32:48.961332 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.961249 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:48.964874 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.964851 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 19:32:48.965050 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.964889 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 19:32:48.965050 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.964938 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 19:32:48.965237 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.965222 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 19:32:48.965741 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.965727 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 19:32:48.965859 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.965842 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 19:32:48.965898 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:48.965857 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 19:32:49.062163 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.062140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-hub\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.062274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.062170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.062274 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.062210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.062343 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.062275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-ca\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.062343 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.062308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.062343 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.062325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spwp5\" (UniqueName: \"kubernetes.io/projected/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-kube-api-access-spwp5\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.162674 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.162648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-hub\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.162796 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.162686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.162796 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.162736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.162796 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.162780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-ca\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.162955 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.162819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.162955 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.162846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spwp5\" (UniqueName: \"kubernetes.io/projected/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-kube-api-access-spwp5\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.163502 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.163479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.166130 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.166086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-ca\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.166205 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.166165 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.166273 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.166258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-hub\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.166425 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.166407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.171843 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.171822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spwp5\" (UniqueName: \"kubernetes.io/projected/b8f55494-22d1-4a05-9eb4-9e1beb538cb9-kube-api-access-spwp5\") pod \"cluster-proxy-proxy-agent-58c47764-nqbrx\" (UID: \"b8f55494-22d1-4a05-9eb4-9e1beb538cb9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.228700 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.228680 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gcht" Jun 08 19:32:49.277778 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.277751 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:32:49.422262 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:32:49.422220 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8f55494_22d1_4a05_9eb4_9e1beb538cb9.slice/crio-4f928338872ba3f9702b5ece59b3a9c5c9b2ae06ba313ab62534d6ddbc22654c WatchSource:0}: Error finding container 4f928338872ba3f9702b5ece59b3a9c5c9b2ae06ba313ab62534d6ddbc22654c: Status 404 returned error can't find the container with id 4f928338872ba3f9702b5ece59b3a9c5c9b2ae06ba313ab62534d6ddbc22654c Jun 08 19:32:49.422738 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:49.422712 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx"] Jun 08 19:32:50.300790 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:50.300755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" event={"ID":"b8f55494-22d1-4a05-9eb4-9e1beb538cb9","Type":"ContainerStarted","Data":"4f928338872ba3f9702b5ece59b3a9c5c9b2ae06ba313ab62534d6ddbc22654c"} Jun 08 19:32:52.894567 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.894527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:32:52.894995 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.894648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:52.898936 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.898910 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:32:52.898936 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.898934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:32:52.905744 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:52.905724 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:32:52.905847 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:52.905801 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:56.905780871 +0000 UTC m=+130.293102491 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : secret "metrics-daemon-secret" not found Jun 08 19:32:52.908064 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.908045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7766f7-2067-440e-88ac-7bc3a55c395e-original-pull-secret\") pod \"global-pull-secret-syncer-f542t\" (UID: \"9a7766f7-2067-440e-88ac-7bc3a55c395e\") " pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:52.995877 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.995839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:52.999059 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:52.999036 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:32:53.009458 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.009436 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:32:53.020374 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.020286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hms7j\" (UniqueName: \"kubernetes.io/projected/e7ca8091-0b56-44ac-a17c-e0f694210e2e-kube-api-access-hms7j\") pod \"network-check-target-6klsd\" (UID: \"e7ca8091-0b56-44ac-a17c-e0f694210e2e\") " pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:53.164434 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.164399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f542t" Jun 08 19:32:53.176328 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.176275 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4gvvs\"" Jun 08 19:32:53.183047 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.183023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:53.312188 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.312160 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f542t"] Jun 08 19:32:53.315113 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:32:53.315086 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7766f7_2067_440e_88ac_7bc3a55c395e.slice/crio-90f4b12f9f579bde31ee474fc02cd8672eaee834ce293f65545e393be3a11051 WatchSource:0}: Error finding container 90f4b12f9f579bde31ee474fc02cd8672eaee834ce293f65545e393be3a11051: Status 404 returned error can't find the container with id 90f4b12f9f579bde31ee474fc02cd8672eaee834ce293f65545e393be3a11051 Jun 08 19:32:53.343946 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:53.343786 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6klsd"] Jun 08 19:32:53.348530 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:32:53.348503 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ca8091_0b56_44ac_a17c_e0f694210e2e.slice/crio-68d5b1e8b462ca0f2c02b0f421a10758e0de82f1c5f68ff1d3b5ae5c0a9cf60a WatchSource:0}: Error finding container 68d5b1e8b462ca0f2c02b0f421a10758e0de82f1c5f68ff1d3b5ae5c0a9cf60a: Status 404 returned error can't find the container with id 68d5b1e8b462ca0f2c02b0f421a10758e0de82f1c5f68ff1d3b5ae5c0a9cf60a Jun 08 19:32:54.313516 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:54.313478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f542t" event={"ID":"9a7766f7-2067-440e-88ac-7bc3a55c395e","Type":"ContainerStarted","Data":"90f4b12f9f579bde31ee474fc02cd8672eaee834ce293f65545e393be3a11051"} Jun 08 19:32:54.314843 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:54.314807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6klsd" event={"ID":"e7ca8091-0b56-44ac-a17c-e0f694210e2e","Type":"ContainerStarted","Data":"68d5b1e8b462ca0f2c02b0f421a10758e0de82f1c5f68ff1d3b5ae5c0a9cf60a"} Jun 08 19:32:55.323077 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:55.323040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" event={"ID":"b8f55494-22d1-4a05-9eb4-9e1beb538cb9","Type":"ContainerStarted","Data":"4f825ded748997c331b29eb6823637aa4e72634c173979c574d29811425e5536"} Jun 08 19:32:55.323529 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:55.323089 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" event={"ID":"b8f55494-22d1-4a05-9eb4-9e1beb538cb9","Type":"ContainerStarted","Data":"a8013032ea1ebe9a9600e819f7e7ea53c1d678ccc0a3c97546b89bc9a0d3e8cd"} Jun 08 19:32:55.323529 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:55.323107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" event={"ID":"b8f55494-22d1-4a05-9eb4-9e1beb538cb9","Type":"ContainerStarted","Data":"593d4d66bf8c92698e369845a61a4b681eabd371af73f82abb6374811088c4a3"} Jun 08 19:32:55.419730 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:55.419666 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" podStartSLOduration=2.119617036 podStartE2EDuration="7.419645905s" totalImagesPullingTime="5.300028869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:55.418653449 +0000 UTC m=+68.805975093" watchObservedRunningTime="2026-06-08 19:32:55.419645905 +0000 UTC m=+68.806967548" Jun 08 19:32:57.435531 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:57.435491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:57.435550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:57.435619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435686 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435705 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435717 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435732 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435766 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:29.435744492 +0000 UTC m=+102.823066113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435783 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:33:29.435776197 +0000 UTC m=+102.823097816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:32:57.435951 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:32:57.435794 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:29.435788405 +0000 UTC m=+102.823110025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:32:59.339325 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:59.339282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6klsd" event={"ID":"e7ca8091-0b56-44ac-a17c-e0f694210e2e","Type":"ContainerStarted","Data":"587670af51cfbbdf56c31bf2148555f074a6c92e498d81c66292389fe198a910"} Jun 08 19:32:59.339752 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:59.339603 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:32:59.343252 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:59.343224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f542t" event={"ID":"9a7766f7-2067-440e-88ac-7bc3a55c395e","Type":"ContainerStarted","Data":"f11e6eea1c9b6c0a89042b843fee1e175cbb87a769527a0442c77ad90d4f784d"} Jun 08 19:32:59.371895 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:59.371853 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6klsd" podStartSLOduration=66.555790386 podStartE2EDuration="1m12.371839248s" totalImagesPullingTime="5.816048862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:59.371480543 +0000 UTC m=+72.758802197" watchObservedRunningTime="2026-06-08 19:32:59.371839248 +0000 UTC m=+72.759160920" Jun 08 19:32:59.397877 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:32:59.397836 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f542t" podStartSLOduration=66.544359134 podStartE2EDuration="1m12.397823135s" totalImagesPullingTime="5.853464001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:32:59.397190552 +0000 UTC m=+72.784512195" watchObservedRunningTime="2026-06-08 19:32:59.397823135 +0000 UTC m=+72.785144778" Jun 08 19:33:29.463365 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:33:29.463331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:33:29.463374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:33:29.463398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463476 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463487 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463490 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463536 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:34:33.463522243 +0000 UTC m=+166.850843863 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463540 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463551 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:33.463544528 +0000 UTC m=+166.850866147 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:33:29.463776 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:29.463575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:33.463558918 +0000 UTC m=+166.850880537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:33:30.349747 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:33:30.349716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6klsd" Jun 08 19:33:56.948233 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:33:56.948194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:33:56.948727 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:56.948359 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:33:56.948727 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:33:56.948443 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:35:58.948424134 +0000 UTC m=+252.335745753 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : secret "metrics-daemon-secret" not found Jun 08 19:34:28.518095 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:28.518051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" podUID="c636ac1e-112f-4528-8d12-714641b72e8e" Jun 08 19:34:28.523189 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:28.523163 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" Jun 08 19:34:28.544330 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:28.544309 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qz768" podUID="0eaac090-60d0-4498-a991-7ab711ca39d0" Jun 08 19:34:28.597738 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:28.597716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:34:28.597844 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:28.597734 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:34:28.597844 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:28.597716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz768" Jun 08 19:34:30.076934 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:30.076851 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:34:33.497254 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:33.497207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:33.497267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:33.497339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497377 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497398 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65b6b49b68-7gdkl: secret "image-registry-tls" not found Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497425 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497426 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497491 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls podName:0eaac090-60d0-4498-a991-7ab711ca39d0 nodeName:}" failed. No retries permitted until 2026-06-08 19:36:35.497472771 +0000 UTC m=+288.884794392 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls") pod "dns-default-qz768" (UID: "0eaac090-60d0-4498-a991-7ab711ca39d0") : secret "dns-default-metrics-tls" not found Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497508 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert podName:c636ac1e-112f-4528-8d12-714641b72e8e nodeName:}" failed. No retries permitted until 2026-06-08 19:36:35.497499438 +0000 UTC m=+288.884821064 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-h7vbs" (UID: "c636ac1e-112f-4528-8d12-714641b72e8e") : secret "networking-console-plugin-cert" not found Jun 08 19:34:33.497648 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:34:33.497523 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls podName:ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22 nodeName:}" failed. No retries permitted until 2026-06-08 19:36:35.497516027 +0000 UTC m=+288.884837647 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls") pod "image-registry-65b6b49b68-7gdkl" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22") : secret "image-registry-tls" not found Jun 08 19:34:45.050223 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:34:45.050186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:35:58.974362 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:35:58.974328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:35:58.974793 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:35:58.974465 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:35:58.974793 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:35:58.974530 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs podName:356c8b38-b4b5-44b0-aee6-e438f71a4f36 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:00.974514762 +0000 UTC m=+374.361836382 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs") pod "network-metrics-daemon-g7t5v" (UID: "356c8b38-b4b5-44b0-aee6-e438f71a4f36") : secret "metrics-daemon-secret" not found Jun 08 19:36:08.492678 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:08.492650 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stmv4_096e07ba-fccc-4742-82a5-5f23c35c7a1f/dns-node-resolver/0.log" Jun 08 19:36:09.292995 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:09.292959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kwg2l_5e319a45-1505-40c4-a7d4-7cc613cb071d/node-ca/0.log" Jun 08 19:36:10.093123 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:10.093097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-td2cl_bf113bd6-2ab0-4adf-8ac6-9f0f71805db8/serve-healthcheck-canary/0.log" Jun 08 19:36:28.204713 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.204681 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kk2cs"] Jun 08 19:36:28.206788 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.206770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.215712 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.215696 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 19:36:28.217099 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.217072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dqnnn\"" Jun 08 19:36:28.217099 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.217078 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 19:36:28.217253 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.217079 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 19:36:28.217253 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.217132 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 19:36:28.235525 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.235503 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kk2cs"] Jun 08 19:36:28.273806 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.273784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e5b38d8-db4f-42db-b9dc-ae54243472a5-crio-socket\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.273916 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.273854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e5b38d8-db4f-42db-b9dc-ae54243472a5-data-volume\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.273916 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.273889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzlwf\" (UniqueName: \"kubernetes.io/projected/2e5b38d8-db4f-42db-b9dc-ae54243472a5-kube-api-access-zzlwf\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.274014 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.273939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e5b38d8-db4f-42db-b9dc-ae54243472a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.274014 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.273969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e5b38d8-db4f-42db-b9dc-ae54243472a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.374871 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.374844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e5b38d8-db4f-42db-b9dc-ae54243472a5-data-volume\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.374972 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.374874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzlwf\" (UniqueName: \"kubernetes.io/projected/2e5b38d8-db4f-42db-b9dc-ae54243472a5-kube-api-access-zzlwf\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.374972 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.374914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e5b38d8-db4f-42db-b9dc-ae54243472a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.374972 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.374964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e5b38d8-db4f-42db-b9dc-ae54243472a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.375127 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.375045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e5b38d8-db4f-42db-b9dc-ae54243472a5-crio-socket\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.375179 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.375138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e5b38d8-db4f-42db-b9dc-ae54243472a5-crio-socket\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.375235 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.375223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e5b38d8-db4f-42db-b9dc-ae54243472a5-data-volume\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.375579 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.375557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e5b38d8-db4f-42db-b9dc-ae54243472a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.377133 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.377116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e5b38d8-db4f-42db-b9dc-ae54243472a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.383068 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.383049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzlwf\" (UniqueName: \"kubernetes.io/projected/2e5b38d8-db4f-42db-b9dc-ae54243472a5-kube-api-access-zzlwf\") pod \"insights-runtime-extractor-kk2cs\" (UID: \"2e5b38d8-db4f-42db-b9dc-ae54243472a5\") " pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.515179 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.515125 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kk2cs" Jun 08 19:36:28.636229 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.636193 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kk2cs"] Jun 08 19:36:28.638950 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:28.638919 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5b38d8_db4f_42db_b9dc_ae54243472a5.slice/crio-8eb8ba3653e6f64ee9d03f7e739a8bb0ae6dbf8bda34740dbb3f581ea1fb158a WatchSource:0}: Error finding container 8eb8ba3653e6f64ee9d03f7e739a8bb0ae6dbf8bda34740dbb3f581ea1fb158a: Status 404 returned error can't find the container with id 8eb8ba3653e6f64ee9d03f7e739a8bb0ae6dbf8bda34740dbb3f581ea1fb158a Jun 08 19:36:28.917472 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.917434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk2cs" event={"ID":"2e5b38d8-db4f-42db-b9dc-ae54243472a5","Type":"ContainerStarted","Data":"87cc65086a1a8608df5720c78214b6838705398f15ede50453e3bac1e21bd718"} Jun 08 19:36:28.917623 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:28.917518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk2cs" event={"ID":"2e5b38d8-db4f-42db-b9dc-ae54243472a5","Type":"ContainerStarted","Data":"8eb8ba3653e6f64ee9d03f7e739a8bb0ae6dbf8bda34740dbb3f581ea1fb158a"} Jun 08 19:36:29.921778 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:29.921742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk2cs" event={"ID":"2e5b38d8-db4f-42db-b9dc-ae54243472a5","Type":"ContainerStarted","Data":"321073a083fab6c21a169063e6958d698d7985516ae6e08f7ae937dd92899404"} Jun 08 19:36:30.926605 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:30.926575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kk2cs" event={"ID":"2e5b38d8-db4f-42db-b9dc-ae54243472a5","Type":"ContainerStarted","Data":"d7efd6d488c72a2ac8ea244977f99890c253f423484d6974c77656c0ef08fad4"} Jun 08 19:36:30.948577 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:30.948537 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kk2cs" podStartSLOduration=0.912016469 podStartE2EDuration="2.948524135s" totalImagesPullingTime="2.036507666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:36:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:30.947331447 +0000 UTC m=+284.334653089" watchObservedRunningTime="2026-06-08 19:36:30.948524135 +0000 UTC m=+284.335845776" Jun 08 19:36:31.599100 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:31.599053 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qz768" podUID="0eaac090-60d0-4498-a991-7ab711ca39d0" Jun 08 19:36:31.599100 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:31.599060 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" podUID="c636ac1e-112f-4528-8d12-714641b72e8e" Jun 08 19:36:31.599281 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:31.599120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" Jun 08 19:36:31.929627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:31.929600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:36:31.929627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:31.929615 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz768" Jun 08 19:36:31.929627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:31.929621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:36:35.527208 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.527172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:36:35.527614 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.527221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:36:35.527614 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.527246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:36:35.529721 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.529697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0eaac090-60d0-4498-a991-7ab711ca39d0-metrics-tls\") pod \"dns-default-qz768\" (UID: \"0eaac090-60d0-4498-a991-7ab711ca39d0\") " pod="openshift-dns/dns-default-qz768" Jun 08 19:36:35.529891 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.529867 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c636ac1e-112f-4528-8d12-714641b72e8e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-h7vbs\" (UID: \"c636ac1e-112f-4528-8d12-714641b72e8e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:36:35.529954 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.529870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"image-registry-65b6b49b68-7gdkl\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:36:35.536448 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.536423 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c99cx\"" Jun 08 19:36:35.536674 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.536656 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jsvg2\"" Jun 08 19:36:35.536792 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.536766 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4np7h\"" Jun 08 19:36:35.541293 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.541274 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:36:35.541406 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.541373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz768" Jun 08 19:36:35.541460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.541400 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" Jun 08 19:36:35.685601 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.685414 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz768"] Jun 08 19:36:35.688317 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:35.688293 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eaac090_60d0_4498_a991_7ab711ca39d0.slice/crio-e6e4c42b54ebfe1bf799c5617b9b4a68cd91a46d95b5cf9f54b43c1369c52c60 WatchSource:0}: Error finding container e6e4c42b54ebfe1bf799c5617b9b4a68cd91a46d95b5cf9f54b43c1369c52c60: Status 404 returned error can't find the container with id e6e4c42b54ebfe1bf799c5617b9b4a68cd91a46d95b5cf9f54b43c1369c52c60 Jun 08 19:36:35.704158 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.704127 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65b6b49b68-7gdkl"] Jun 08 19:36:35.707922 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:35.707902 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff707946_cc4f_4a64_a7e2_cc0a5ddd8a22.slice/crio-925f82a59f080536ea73b10d2e430da3c7f56f2c6c59a575c0684e1a08085f14 WatchSource:0}: Error finding container 925f82a59f080536ea73b10d2e430da3c7f56f2c6c59a575c0684e1a08085f14: Status 404 returned error can't find the container with id 925f82a59f080536ea73b10d2e430da3c7f56f2c6c59a575c0684e1a08085f14 Jun 08 19:36:35.718377 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.718348 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs"] Jun 08 19:36:35.721450 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:35.721427 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc636ac1e_112f_4528_8d12_714641b72e8e.slice/crio-8e92bceeb4ea94dd85514434b1842409a02afe1793e4bac2765819022f6f6547 WatchSource:0}: Error finding container 8e92bceeb4ea94dd85514434b1842409a02afe1793e4bac2765819022f6f6547: Status 404 returned error can't find the container with id 8e92bceeb4ea94dd85514434b1842409a02afe1793e4bac2765819022f6f6547 Jun 08 19:36:35.943025 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.942973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz768" event={"ID":"0eaac090-60d0-4498-a991-7ab711ca39d0","Type":"ContainerStarted","Data":"e6e4c42b54ebfe1bf799c5617b9b4a68cd91a46d95b5cf9f54b43c1369c52c60"} Jun 08 19:36:35.944015 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.943989 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" event={"ID":"c636ac1e-112f-4528-8d12-714641b72e8e","Type":"ContainerStarted","Data":"8e92bceeb4ea94dd85514434b1842409a02afe1793e4bac2765819022f6f6547"} Jun 08 19:36:35.945286 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.945265 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" event={"ID":"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22","Type":"ContainerStarted","Data":"073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a"} Jun 08 19:36:35.945362 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.945301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" event={"ID":"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22","Type":"ContainerStarted","Data":"925f82a59f080536ea73b10d2e430da3c7f56f2c6c59a575c0684e1a08085f14"} Jun 08 19:36:35.945415 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.945405 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:36:35.966373 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:35.966329 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" podStartSLOduration=288.966316565 podStartE2EDuration="4m48.966316565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:35.965193766 +0000 UTC m=+289.352515407" watchObservedRunningTime="2026-06-08 19:36:35.966316565 +0000 UTC m=+289.353638185" Jun 08 19:36:37.953892 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:37.953855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz768" event={"ID":"0eaac090-60d0-4498-a991-7ab711ca39d0","Type":"ContainerStarted","Data":"988f9af696e23743d3425ec7e8426e5d65cc7fe2342fab5970d893e5c208cb33"} Jun 08 19:36:37.954297 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:37.953913 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz768" event={"ID":"0eaac090-60d0-4498-a991-7ab711ca39d0","Type":"ContainerStarted","Data":"b01265ddd06783985dbcbaa8de77a68a53a76a06246947b58a73375f9dbdcb5a"} Jun 08 19:36:37.954297 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:37.953948 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qz768" Jun 08 19:36:37.955337 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:37.955316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" event={"ID":"c636ac1e-112f-4528-8d12-714641b72e8e","Type":"ContainerStarted","Data":"cabdb0d20917a1595902b829acb67f7cf889b8ead5033a0c32ba86d7ab08c542"} Jun 08 19:36:37.975817 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:37.975777 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qz768" podStartSLOduration=251.160529766 podStartE2EDuration="4m12.975762596s" totalImagesPullingTime="1.81523283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:37.975632805 +0000 UTC m=+291.362954448" watchObservedRunningTime="2026-06-08 19:36:37.975762596 +0000 UTC m=+291.363084215" Jun 08 19:36:37.998058 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:37.998022 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-h7vbs" podStartSLOduration=279.730226036 podStartE2EDuration="4m40.998009127s" totalImagesPullingTime="1.267783091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:37.9974579 +0000 UTC m=+291.384779542" watchObservedRunningTime="2026-06-08 19:36:37.998009127 +0000 UTC m=+291.385330769" Jun 08 19:36:42.217998 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.217944 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6"] Jun 08 19:36:42.223039 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.223017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.227146 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 19:36:42.227286 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227178 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c5gxr\"" Jun 08 19:36:42.227286 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227192 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 19:36:42.227485 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227464 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 19:36:42.227568 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227545 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 19:36:42.227681 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227666 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 19:36:42.227963 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.227948 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 19:36:42.236412 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.236389 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bvstr"] Jun 08 19:36:42.239650 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.239633 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.242230 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.242210 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6"] Jun 08 19:36:42.242905 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:42.242867 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-129-91.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-91.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jun 08 19:36:42.243061 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.243043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 19:36:42.243726 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.243701 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kw2kh\"" Jun 08 19:36:42.244119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.244100 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 19:36:42.368236 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc369df4-8167-49af-9761-25ebdca7cdab-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.368316 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-tls\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368316 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.368394 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.368394 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8f6\" (UniqueName: \"kubernetes.io/projected/fc369df4-8167-49af-9761-25ebdca7cdab-kube-api-access-bf8f6\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.368394 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368394 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc369df4-8167-49af-9761-25ebdca7cdab-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.368517 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-metrics-client-ca\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368517 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz6dz\" (UniqueName: \"kubernetes.io/projected/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-kube-api-access-bz6dz\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368517 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-wtmp\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368517 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.368517 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368656 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-root\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368656 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-textfile\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.368656 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.368576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-sys\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-wtmp\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469771 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.469865 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469865 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-root\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469865 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-root\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469998 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-textfile\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469998 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469912 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-wtmp\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469998 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-sys\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469998 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-sys\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.469998 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.469965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc369df4-8167-49af-9761-25ebdca7cdab-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-tls\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8f6\" (UniqueName: \"kubernetes.io/projected/fc369df4-8167-49af-9761-25ebdca7cdab-kube-api-access-bf8f6\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:42.470163 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-textfile\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.470256 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:42.470235 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-tls podName:fc369df4-8167-49af-9761-25ebdca7cdab nodeName:}" failed. No retries permitted until 2026-06-08 19:36:42.970217064 +0000 UTC m=+296.357538690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-2wxl6" (UID: "fc369df4-8167-49af-9761-25ebdca7cdab") : secret "kube-state-metrics-tls" not found Jun 08 19:36:42.470687 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc369df4-8167-49af-9761-25ebdca7cdab-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.470687 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-metrics-client-ca\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.470687 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz6dz\" (UniqueName: \"kubernetes.io/projected/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-kube-api-access-bz6dz\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.470687 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470515 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc369df4-8167-49af-9761-25ebdca7cdab-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.470886 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470780 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.470944 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.471005 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.470948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-metrics-client-ca\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.471371 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.471349 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc369df4-8167-49af-9761-25ebdca7cdab-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.472436 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.472402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-tls\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.472589 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.472571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.492766 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.492733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz6dz\" (UniqueName: \"kubernetes.io/projected/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-kube-api-access-bz6dz\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:42.493643 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.493623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8f6\" (UniqueName: \"kubernetes.io/projected/fc369df4-8167-49af-9761-25ebdca7cdab-kube-api-access-bf8f6\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.973049 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.973012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:42.975486 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:42.975464 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc369df4-8167-49af-9761-25ebdca7cdab-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2wxl6\" (UID: \"fc369df4-8167-49af-9761-25ebdca7cdab\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:43.131784 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.131755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" Jun 08 19:36:43.196563 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.196528 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 19:36:43.203672 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.203648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21445503-ea05-4f34-a8df-8ce0bcb8e5dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvstr\" (UID: \"21445503-ea05-4f34-a8df-8ce0bcb8e5dc\") " pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:43.265141 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.265078 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6"] Jun 08 19:36:43.267825 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:43.267803 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc369df4_8167_49af_9761_25ebdca7cdab.slice/crio-24cf64b9dcedd7c81a70d3bd53f9ef85b53503eaaa370f88a8fcaca541056d6c WatchSource:0}: Error finding container 24cf64b9dcedd7c81a70d3bd53f9ef85b53503eaaa370f88a8fcaca541056d6c: Status 404 returned error can't find the container with id 24cf64b9dcedd7c81a70d3bd53f9ef85b53503eaaa370f88a8fcaca541056d6c Jun 08 19:36:43.270888 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.270870 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:36:43.275822 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.275806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.278724 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.278697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 19:36:43.278804 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.278736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 19:36:43.278804 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.278763 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 19:36:43.279042 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279025 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 19:36:43.279149 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 19:36:43.279149 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279079 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 19:36:43.279149 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 19:36:43.279315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279081 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 19:36:43.279315 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279158 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 19:36:43.279467 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.279448 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s9lxs\"" Jun 08 19:36:43.291075 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.291057 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:36:43.376570 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376664 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-web-config\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376664 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376664 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376664 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq4xp\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-kube-api-access-kq4xp\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376889 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376889 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376889 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376889 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-config-out\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.376889 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-config-volume\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.377098 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.377098 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.377098 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.376969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.448702 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.448681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvstr" Jun 08 19:36:43.458348 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:43.458325 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21445503_ea05_4f34_a8df_8ce0bcb8e5dc.slice/crio-b6dc7588c9ed23c55418190c4e853d1653e69b618debdec5c9796e30ee3ecc91 WatchSource:0}: Error finding container b6dc7588c9ed23c55418190c4e853d1653e69b618debdec5c9796e30ee3ecc91: Status 404 returned error can't find the container with id b6dc7588c9ed23c55418190c4e853d1653e69b618debdec5c9796e30ee3ecc91 Jun 08 19:36:43.477901 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.477883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-config-volume\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478005 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.477918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478005 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.477941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478005 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.477966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478160 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478160 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-web-config\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq4xp\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-kube-api-access-kq4xp\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:43.478252 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478287 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478318 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:43.478314 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls podName:37a7abd4-6475-42b8-b481-088b654eedc6 nodeName:}" failed. No retries permitted until 2026-06-08 19:36:43.978295579 +0000 UTC m=+297.365617215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6") : secret "alertmanager-main-tls" not found Jun 08 19:36:43.478836 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478908 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.478961 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.478907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-config-out\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.479505 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.479468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.479867 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.479817 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.481048 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.480994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-config-volume\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.481134 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.481099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.481553 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.481530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.481698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.481633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.481937 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.481840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.482098 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.482077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-web-config\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.482226 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.482203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-config-out\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.482532 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.482509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.485712 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.485688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq4xp\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-kube-api-access-kq4xp\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.982571 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.982155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:43.982571 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.982355 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" event={"ID":"fc369df4-8167-49af-9761-25ebdca7cdab","Type":"ContainerStarted","Data":"24cf64b9dcedd7c81a70d3bd53f9ef85b53503eaaa370f88a8fcaca541056d6c"} Jun 08 19:36:43.984401 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.984349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvstr" event={"ID":"21445503-ea05-4f34-a8df-8ce0bcb8e5dc","Type":"ContainerStarted","Data":"b6dc7588c9ed23c55418190c4e853d1653e69b618debdec5c9796e30ee3ecc91"} Jun 08 19:36:43.985409 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:43.985385 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:44.184600 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.184551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:36:44.908878 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.908825 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:36:44.910796 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:44.910766 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a7abd4_6475_42b8_b481_088b654eedc6.slice/crio-addb3eaa2d51258734d4b7bb2b656ff825a800ed836924cb1331aca15e60931b WatchSource:0}: Error finding container addb3eaa2d51258734d4b7bb2b656ff825a800ed836924cb1331aca15e60931b: Status 404 returned error can't find the container with id addb3eaa2d51258734d4b7bb2b656ff825a800ed836924cb1331aca15e60931b Jun 08 19:36:44.990775 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.990699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" event={"ID":"fc369df4-8167-49af-9761-25ebdca7cdab","Type":"ContainerStarted","Data":"5e329d8215f1dafda990aff19f6dcb73603599770d61b1168bf3b1234f6cba57"} Jun 08 19:36:44.990775 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.990767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" event={"ID":"fc369df4-8167-49af-9761-25ebdca7cdab","Type":"ContainerStarted","Data":"84ee53f6935413cf97c26ffd53841501fef37ba1f9bd96b993ce89be17398214"} Jun 08 19:36:44.990993 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.990796 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" event={"ID":"fc369df4-8167-49af-9761-25ebdca7cdab","Type":"ContainerStarted","Data":"db83988a0518ffae953675b785e819412e0858d6066625f9c3ee86497464051a"} Jun 08 19:36:44.992117 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.992095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"addb3eaa2d51258734d4b7bb2b656ff825a800ed836924cb1331aca15e60931b"} Jun 08 19:36:44.993897 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.993871 2561 generic.go:356] "Generic (PLEG): container finished" podID="21445503-ea05-4f34-a8df-8ce0bcb8e5dc" containerID="e0329e510a4a7d5a3e7ec094b177ed108a46cb46b5ddfef02a82d789ba7cf85f" exitCode=0 Jun 08 19:36:44.994005 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:44.993945 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvstr" event={"ID":"21445503-ea05-4f34-a8df-8ce0bcb8e5dc","Type":"ContainerDied","Data":"e0329e510a4a7d5a3e7ec094b177ed108a46cb46b5ddfef02a82d789ba7cf85f"} Jun 08 19:36:45.013478 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:45.013412 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2wxl6" podStartSLOduration=1.587657028 podStartE2EDuration="3.01339541s" totalImagesPullingTime="1.425738382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:45.012289016 +0000 UTC m=+298.399610659" watchObservedRunningTime="2026-06-08 19:36:45.01339541 +0000 UTC m=+298.400717056" Jun 08 19:36:45.998571 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:45.998546 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65" exitCode=0 Jun 08 19:36:45.998903 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:45.998617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65"} Jun 08 19:36:46.000579 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.000559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvstr" event={"ID":"21445503-ea05-4f34-a8df-8ce0bcb8e5dc","Type":"ContainerStarted","Data":"3819f847f6baf4190e611d331c93e18ebcca04246e2d10ba23d366f5a9a571be"} Jun 08 19:36:46.000645 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.000601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvstr" event={"ID":"21445503-ea05-4f34-a8df-8ce0bcb8e5dc","Type":"ContainerStarted","Data":"02bdc58dc6d365a2c88c7932a348d2fe9a358bdead2ccbec6e7183ea3ebc0ce9"} Jun 08 19:36:46.060780 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.060742 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bvstr" podStartSLOduration=2.752911797 podStartE2EDuration="4.060725395s" totalImagesPullingTime="1.234245795s" totalInitContainerRuntime="73.567803ms" isStatefulPod=true podCreationTimestamp="2026-06-08 19:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:46.059845055 +0000 UTC m=+299.447166689" watchObservedRunningTime="2026-06-08 19:36:46.060725395 +0000 UTC m=+299.448047082" Jun 08 19:36:46.949877 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.949844 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-52h7w"] Jun 08 19:36:46.952848 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.952830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:46.955389 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.955368 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-czmbg\"" Jun 08 19:36:46.955498 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.955404 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 19:36:46.963773 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:46.963746 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-52h7w"] Jun 08 19:36:47.014232 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.014211 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:36:47.015692 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.015673 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:36:47.018062 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.018044 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 19:36:47.105947 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.105918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff045944-5e3b-4bce-af07-66c1d875cc80-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.125394 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.106040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trbnx\" (UniqueName: \"kubernetes.io/projected/ff045944-5e3b-4bce-af07-66c1d875cc80-kube-api-access-trbnx\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.207255 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.207204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trbnx\" (UniqueName: \"kubernetes.io/projected/ff045944-5e3b-4bce-af07-66c1d875cc80-kube-api-access-trbnx\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.207255 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.207264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff045944-5e3b-4bce-af07-66c1d875cc80-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.212918 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.212898 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 19:36:47.217430 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:47.217407 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 19:36:47.217512 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:47.217466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff045944-5e3b-4bce-af07-66c1d875cc80-monitoring-plugin-cert podName:ff045944-5e3b-4bce-af07-66c1d875cc80 nodeName:}" failed. No retries permitted until 2026-06-08 19:36:47.717447928 +0000 UTC m=+301.104769561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ff045944-5e3b-4bce-af07-66c1d875cc80-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-52h7w" (UID: "ff045944-5e3b-4bce-af07-66c1d875cc80") : secret "monitoring-plugin-cert" not found Jun 08 19:36:47.227338 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.227316 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trbnx\" (UniqueName: \"kubernetes.io/projected/ff045944-5e3b-4bce-af07-66c1d875cc80-kube-api-access-trbnx\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.815443 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.815416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff045944-5e3b-4bce-af07-66c1d875cc80-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.817497 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.817477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff045944-5e3b-4bce-af07-66c1d875cc80-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-52h7w\" (UID: \"ff045944-5e3b-4bce-af07-66c1d875cc80\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.863525 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.863502 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-czmbg\"" Jun 08 19:36:47.872050 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.872001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:47.966412 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:47.966382 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qz768" Jun 08 19:36:48.010491 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.010461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b"} Jun 08 19:36:48.010627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.010521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201"} Jun 08 19:36:48.010627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.010547 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32"} Jun 08 19:36:48.010627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.010572 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9"} Jun 08 19:36:48.010627 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.010596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634"} Jun 08 19:36:48.010819 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.010776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-52h7w"] Jun 08 19:36:48.013523 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:36:48.013504 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff045944_5e3b_4bce_af07_66c1d875cc80.slice/crio-0dd9264cb4d7c088629e1d713378f2b89e010c0f377627bd7bf7874628ebc904 WatchSource:0}: Error finding container 0dd9264cb4d7c088629e1d713378f2b89e010c0f377627bd7bf7874628ebc904: Status 404 returned error can't find the container with id 0dd9264cb4d7c088629e1d713378f2b89e010c0f377627bd7bf7874628ebc904 Jun 08 19:36:48.015734 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:48.015717 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:36:48.050678 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:36:48.050649 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g7t5v" podUID="356c8b38-b4b5-44b0-aee6-e438f71a4f36" Jun 08 19:36:49.018363 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:49.018282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerStarted","Data":"9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149"} Jun 08 19:36:49.019606 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:49.019580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" event={"ID":"ff045944-5e3b-4bce-af07-66c1d875cc80","Type":"ContainerStarted","Data":"0dd9264cb4d7c088629e1d713378f2b89e010c0f377627bd7bf7874628ebc904"} Jun 08 19:36:49.048909 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:49.048865 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.616252964 podStartE2EDuration="6.048850898s" totalImagesPullingTime="3.413888373s" totalInitContainerRuntime="18.709561ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:36:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:49.046694829 +0000 UTC m=+302.434016482" watchObservedRunningTime="2026-06-08 19:36:49.048850898 +0000 UTC m=+302.436172594" Jun 08 19:36:49.279006 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:49.278907 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" podUID="b8f55494-22d1-4a05-9eb4-9e1beb538cb9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 19:36:50.024910 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.024866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" event={"ID":"ff045944-5e3b-4bce-af07-66c1d875cc80","Type":"ContainerStarted","Data":"e5d22d4025016d3ac3c72bdac5e3e78f3121dada6e67126ee2eae75a07821ae0"} Jun 08 19:36:50.025416 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.025394 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:50.029675 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.029655 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" Jun 08 19:36:50.041817 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.041771 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-52h7w" podStartSLOduration=2.246716634 podStartE2EDuration="4.041756704s" totalImagesPullingTime="1.79504007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:36:50.041144877 +0000 UTC m=+303.428466521" watchObservedRunningTime="2026-06-08 19:36:50.041756704 +0000 UTC m=+303.429078346" Jun 08 19:36:50.763127 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.763095 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65b6b49b68-7gdkl"] Jun 08 19:36:50.767672 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.767645 2561 patch_prober.go:28] interesting pod/image-registry-65b6b49b68-7gdkl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:36:50.767804 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:50.767689 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:36:59.279193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:36:59.279151 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" podUID="b8f55494-22d1-4a05-9eb4-9e1beb538cb9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 19:37:00.050144 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:00.050108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:37:00.767899 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:00.767873 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:37:09.278837 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:09.278788 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" podUID="b8f55494-22d1-4a05-9eb4-9e1beb538cb9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 19:37:09.279362 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:09.278871 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" Jun 08 19:37:09.279420 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:09.279387 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4f825ded748997c331b29eb6823637aa4e72634c173979c574d29811425e5536"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 19:37:09.279460 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:09.279446 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" podUID="b8f55494-22d1-4a05-9eb4-9e1beb538cb9" containerName="service-proxy" containerID="cri-o://4f825ded748997c331b29eb6823637aa4e72634c173979c574d29811425e5536" gracePeriod=30 Jun 08 19:37:10.095961 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:10.095926 2561 generic.go:356] "Generic (PLEG): container finished" podID="b8f55494-22d1-4a05-9eb4-9e1beb538cb9" containerID="4f825ded748997c331b29eb6823637aa4e72634c173979c574d29811425e5536" exitCode=2 Jun 08 19:37:10.096172 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:10.096009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" event={"ID":"b8f55494-22d1-4a05-9eb4-9e1beb538cb9","Type":"ContainerDied","Data":"4f825ded748997c331b29eb6823637aa4e72634c173979c574d29811425e5536"} Jun 08 19:37:10.096172 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:10.096062 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58c47764-nqbrx" event={"ID":"b8f55494-22d1-4a05-9eb4-9e1beb538cb9","Type":"ContainerStarted","Data":"3060c4a40c0b8509e010d6d7167ec8421418b0e93eca5e9f7b90665659d56bd9"} Jun 08 19:37:15.782881 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:15.782835 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" containerName="registry" containerID="cri-o://073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a" gracePeriod=30 Jun 08 19:37:16.022318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.022297 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:37:16.115034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115011 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-installation-pull-secrets\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115154 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115050 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-ca-trust-extracted\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115154 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115077 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-image-registry-private-configuration\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115154 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115115 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-trusted-ca\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115154 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115140 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jzb\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-kube-api-access-r5jzb\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115361 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115158 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-bound-sa-token\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115361 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115177 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-certificates\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115361 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115201 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") pod \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\" (UID: \"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22\") " Jun 08 19:37:16.115598 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.115566 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:37:16.116060 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.116008 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:37:16.117839 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117754 2561 generic.go:356] "Generic (PLEG): container finished" podID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" containerID="073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a" exitCode=0 Jun 08 19:37:16.117839 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117801 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:37:16.117839 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" event={"ID":"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22","Type":"ContainerDied","Data":"073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a"} Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117867 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" event={"ID":"ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22","Type":"ContainerDied","Data":"925f82a59f080536ea73b10d2e430da3c7f56f2c6c59a575c0684e1a08085f14"} Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117882 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65b6b49b68-7gdkl" Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117898 2561 scope.go:117] "RemoveContainer" containerID="073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a" Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.117957 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.118095 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-kube-api-access-r5jzb" (OuterVolumeSpecName: "kube-api-access-r5jzb") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "kube-api-access-r5jzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.118127 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:37:16.118181 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.118143 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:37:16.127230 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.127205 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" (UID: "ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:37:16.134019 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.134003 2561 scope.go:117] "RemoveContainer" containerID="073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a" Jun 08 19:37:16.134287 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:37:16.134266 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a\": container with ID starting with 073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a not found: ID does not exist" containerID="073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a" Jun 08 19:37:16.134336 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.134295 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a"} err="failed to get container status \"073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a\": rpc error: code = NotFound desc = could not find container \"073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a\": container with ID starting with 073e8962d3f5342ea0e0dfd773df2361944eeaabbdd4f1d600d6b514f2ffa82a not found: ID does not exist" Jun 08 19:37:16.215710 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215678 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-installation-pull-secrets\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215710 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215712 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-ca-trust-extracted\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215834 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215729 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-image-registry-private-configuration\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215834 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215738 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-trusted-ca\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215834 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215746 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5jzb\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-kube-api-access-r5jzb\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215834 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215755 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-bound-sa-token\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215834 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215763 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-certificates\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.215834 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.215771 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22-registry-tls\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:37:16.439918 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.439888 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65b6b49b68-7gdkl"] Jun 08 19:37:16.443687 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:16.443661 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65b6b49b68-7gdkl"] Jun 08 19:37:17.054897 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:37:17.054872 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" path="/var/lib/kubelet/pods/ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22/volumes" Jun 08 19:38:01.023035 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:01.022971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:38:01.025673 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:01.025640 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/356c8b38-b4b5-44b0-aee6-e438f71a4f36-metrics-certs\") pod \"network-metrics-daemon-g7t5v\" (UID: \"356c8b38-b4b5-44b0-aee6-e438f71a4f36\") " pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:38:01.254245 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:01.254209 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng5m4\"" Jun 08 19:38:01.261436 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:01.261407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7t5v" Jun 08 19:38:01.391449 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:01.391410 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7t5v"] Jun 08 19:38:01.394796 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:38:01.394769 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356c8b38_b4b5_44b0_aee6_e438f71a4f36.slice/crio-139d314b62c2e6856ab197de67215d337512435678f97498dc719990eaab4a37 WatchSource:0}: Error finding container 139d314b62c2e6856ab197de67215d337512435678f97498dc719990eaab4a37: Status 404 returned error can't find the container with id 139d314b62c2e6856ab197de67215d337512435678f97498dc719990eaab4a37 Jun 08 19:38:02.283127 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.283093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7t5v" event={"ID":"356c8b38-b4b5-44b0-aee6-e438f71a4f36","Type":"ContainerStarted","Data":"139d314b62c2e6856ab197de67215d337512435678f97498dc719990eaab4a37"} Jun 08 19:38:02.609609 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.605346 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:02.610318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.610083 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="alertmanager" containerID="cri-o://daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634" gracePeriod=120 Jun 08 19:38:02.610318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.610134 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-metric" containerID="cri-o://5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b" gracePeriod=120 Jun 08 19:38:02.610318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.610191 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy" containerID="cri-o://d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201" gracePeriod=120 Jun 08 19:38:02.610318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.610186 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="config-reloader" containerID="cri-o://3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9" gracePeriod=120 Jun 08 19:38:02.610318 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.610148 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-web" containerID="cri-o://5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32" gracePeriod=120 Jun 08 19:38:02.610933 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:02.610840 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="prom-label-proxy" containerID="cri-o://9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149" gracePeriod=120 Jun 08 19:38:03.290263 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290236 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149" exitCode=0 Jun 08 19:38:03.290263 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290259 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b" exitCode=0 Jun 08 19:38:03.290263 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290267 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201" exitCode=0 Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290274 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9" exitCode=0 Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290281 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634" exitCode=0 Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149"} Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290384 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b"} Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290426 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201"} Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9"} Jun 08 19:38:03.290676 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.290502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634"} Jun 08 19:38:03.292307 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.292279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7t5v" event={"ID":"356c8b38-b4b5-44b0-aee6-e438f71a4f36","Type":"ContainerStarted","Data":"fb0557b7719e42c069835bd07fb48be0a393864c5888fc4da5e84616fa0643a1"} Jun 08 19:38:03.292432 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.292329 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7t5v" event={"ID":"356c8b38-b4b5-44b0-aee6-e438f71a4f36","Type":"ContainerStarted","Data":"f37eb49e14214c859e1764b70df39b37a07e636097a44c6997abb30a3b647e3e"} Jun 08 19:38:03.309645 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.309599 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g7t5v" podStartSLOduration=375.264425947 podStartE2EDuration="6m16.309583022s" totalImagesPullingTime="1.045157075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:03.308126394 +0000 UTC m=+376.695448036" watchObservedRunningTime="2026-06-08 19:38:03.309583022 +0000 UTC m=+376.696904749" Jun 08 19:38:03.864524 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.864497 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:03.945525 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945460 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-metrics-client-ca\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945525 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945506 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945545 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945568 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945595 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945625 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-web-config\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945647 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-trusted-ca-bundle\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.945698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945682 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-tls-assets\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.946007 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945705 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-config-volume\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.946007 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945743 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-config-out\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.946007 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945808 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq4xp\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-kube-api-access-kq4xp\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.946007 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945836 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-main-db\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.946007 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945834 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:38:03.946007 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.945864 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-cluster-tls-config\") pod \"37a7abd4-6475-42b8-b481-088b654eedc6\" (UID: \"37a7abd4-6475-42b8-b481-088b654eedc6\") " Jun 08 19:38:03.946297 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.946055 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-metrics-client-ca\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:03.946297 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.946263 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:38:03.946878 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.946829 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:38:03.948526 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.948489 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:03.948786 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.948756 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:03.949173 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.949143 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-kube-api-access-kq4xp" (OuterVolumeSpecName: "kube-api-access-kq4xp") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "kube-api-access-kq4xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:38:03.949350 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.949316 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-config-volume" (OuterVolumeSpecName: "config-volume") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:03.949434 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.949379 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:03.949615 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.949591 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:03.949814 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.949796 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-config-out" (OuterVolumeSpecName: "config-out") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:38:03.950486 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.950463 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:38:03.952293 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.952264 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:03.957828 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:03.957799 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-web-config" (OuterVolumeSpecName: "web-config") pod "37a7abd4-6475-42b8-b481-088b654eedc6" (UID: "37a7abd4-6475-42b8-b481-088b654eedc6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:04.046297 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046274 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq4xp\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-kube-api-access-kq4xp\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046297 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046293 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-main-db\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046303 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-cluster-tls-config\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046312 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046321 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-main-tls\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046331 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046340 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046348 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-web-config\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046356 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a7abd4-6475-42b8-b481-088b654eedc6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046364 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a7abd4-6475-42b8-b481-088b654eedc6-tls-assets\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046372 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37a7abd4-6475-42b8-b481-088b654eedc6-config-volume\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.046403 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.046379 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a7abd4-6475-42b8-b481-088b654eedc6-config-out\") on node \"ip-10-0-129-91.ec2.internal\" DevicePath \"\"" Jun 08 19:38:04.298829 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.298768 2561 generic.go:356] "Generic (PLEG): container finished" podID="37a7abd4-6475-42b8-b481-088b654eedc6" containerID="5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32" exitCode=0 Jun 08 19:38:04.299191 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.298859 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.299191 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.298857 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32"} Jun 08 19:38:04.299191 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.298970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37a7abd4-6475-42b8-b481-088b654eedc6","Type":"ContainerDied","Data":"addb3eaa2d51258734d4b7bb2b656ff825a800ed836924cb1331aca15e60931b"} Jun 08 19:38:04.299191 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.299051 2561 scope.go:117] "RemoveContainer" containerID="9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149" Jun 08 19:38:04.306885 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.306867 2561 scope.go:117] "RemoveContainer" containerID="5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b" Jun 08 19:38:04.313611 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.313596 2561 scope.go:117] "RemoveContainer" containerID="d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201" Jun 08 19:38:04.320232 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.320216 2561 scope.go:117] "RemoveContainer" containerID="5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32" Jun 08 19:38:04.321731 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.321542 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:04.326434 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.326407 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:04.327723 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.327708 2561 scope.go:117] "RemoveContainer" containerID="3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9" Jun 08 19:38:04.334349 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.334331 2561 scope.go:117] "RemoveContainer" containerID="daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634" Jun 08 19:38:04.340791 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.340775 2561 scope.go:117] "RemoveContainer" containerID="10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65" Jun 08 19:38:04.347381 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.347360 2561 scope.go:117] "RemoveContainer" containerID="9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149" Jun 08 19:38:04.347639 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.347614 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149\": container with ID starting with 9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149 not found: ID does not exist" containerID="9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149" Jun 08 19:38:04.347696 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.347646 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149"} err="failed to get container status \"9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149\": rpc error: code = NotFound desc = could not find container \"9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149\": container with ID starting with 9e82ef20e442a236abaf6ee8b116f5bfcedf48e583e3c6797d20fd0f831eb149 not found: ID does not exist" Jun 08 19:38:04.347696 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.347665 2561 scope.go:117] "RemoveContainer" containerID="5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b" Jun 08 19:38:04.347861 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.347845 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b\": container with ID starting with 5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b not found: ID does not exist" containerID="5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b" Jun 08 19:38:04.347897 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.347868 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b"} err="failed to get container status \"5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b\": rpc error: code = NotFound desc = could not find container \"5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b\": container with ID starting with 5d99ee2610ccd5c961c82d5d8a4328092185918c56881cef5627659c6881266b not found: ID does not exist" Jun 08 19:38:04.347897 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.347882 2561 scope.go:117] "RemoveContainer" containerID="d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201" Jun 08 19:38:04.348148 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.348133 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201\": container with ID starting with d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201 not found: ID does not exist" containerID="d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201" Jun 08 19:38:04.348198 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348153 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201"} err="failed to get container status \"d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201\": rpc error: code = NotFound desc = could not find container \"d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201\": container with ID starting with d2108440a4177aaf69e54c701614dad28bb777bc1a0b4c76bd3d3275009d9201 not found: ID does not exist" Jun 08 19:38:04.348198 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348167 2561 scope.go:117] "RemoveContainer" containerID="5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32" Jun 08 19:38:04.348429 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.348401 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32\": container with ID starting with 5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32 not found: ID does not exist" containerID="5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32" Jun 08 19:38:04.348429 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348425 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32"} err="failed to get container status \"5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32\": rpc error: code = NotFound desc = could not find container \"5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32\": container with ID starting with 5485251b5a245cbf44f4560588858fe3777f593b6ba599b312ad7a9f4d768e32 not found: ID does not exist" Jun 08 19:38:04.348585 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348440 2561 scope.go:117] "RemoveContainer" containerID="3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9" Jun 08 19:38:04.348679 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.348662 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9\": container with ID starting with 3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9 not found: ID does not exist" containerID="3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9" Jun 08 19:38:04.348718 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348683 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9"} err="failed to get container status \"3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9\": rpc error: code = NotFound desc = could not find container \"3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9\": container with ID starting with 3ff75802614cb1b5acb8f454d721dd9829acd7ab6ea2783bd17c95ac37ee97f9 not found: ID does not exist" Jun 08 19:38:04.348718 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348694 2561 scope.go:117] "RemoveContainer" containerID="daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634" Jun 08 19:38:04.348881 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.348866 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634\": container with ID starting with daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634 not found: ID does not exist" containerID="daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634" Jun 08 19:38:04.348922 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348883 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634"} err="failed to get container status \"daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634\": rpc error: code = NotFound desc = could not find container \"daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634\": container with ID starting with daacee21fdffcd225febcdb5fe4a100b1132db821366d2e351754ac862f8f634 not found: ID does not exist" Jun 08 19:38:04.348922 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.348896 2561 scope.go:117] "RemoveContainer" containerID="10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65" Jun 08 19:38:04.349115 ip-10-0-129-91 kubenswrapper[2561]: E0608 19:38:04.349101 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65\": container with ID starting with 10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65 not found: ID does not exist" containerID="10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65" Jun 08 19:38:04.349153 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.349118 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65"} err="failed to get container status \"10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65\": rpc error: code = NotFound desc = could not find container \"10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65\": container with ID starting with 10b578be310233fe1f51ba2d7121990a27cab71796389ef176e6939af858ae65 not found: ID does not exist" Jun 08 19:38:04.356388 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356370 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:04.356589 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356578 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356590 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356603 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="config-reloader" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356610 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="config-reloader" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356616 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-web" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356621 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-web" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356630 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-metric" Jun 08 19:38:04.356641 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356635 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-metric" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356647 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="init-config-reloader" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356652 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="init-config-reloader" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356657 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" containerName="registry" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356662 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" containerName="registry" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356668 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="alertmanager" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356673 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="alertmanager" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356678 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="prom-label-proxy" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356683 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="prom-label-proxy" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356718 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="config-reloader" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356724 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="prom-label-proxy" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356730 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356735 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-metric" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356742 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="alertmanager" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356747 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" containerName="kube-rbac-proxy-web" Jun 08 19:38:04.356838 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.356752 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff707946-cc4f-4a64-a7e2-cc0a5ddd8a22" containerName="registry" Jun 08 19:38:04.361550 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.361536 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.364011 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.363969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 19:38:04.364148 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.363969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 19:38:04.364148 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364088 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 19:38:04.364441 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364178 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 19:38:04.364441 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364302 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s9lxs\"" Jun 08 19:38:04.364441 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364310 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 19:38:04.364441 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364311 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 19:38:04.364441 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364335 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 19:38:04.364441 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.364369 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 19:38:04.369208 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.369191 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 19:38:04.377189 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.377170 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:04.448251 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b40458b-dfa2-46fc-a738-3d4417154d11-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448344 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448344 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qs7w\" (UniqueName: \"kubernetes.io/projected/9b40458b-dfa2-46fc-a738-3d4417154d11-kube-api-access-6qs7w\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448344 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-web-config\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448455 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b40458b-dfa2-46fc-a738-3d4417154d11-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448455 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b40458b-dfa2-46fc-a738-3d4417154d11-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448455 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448828 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.448903 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.452588 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.448951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.452588 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.449013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b40458b-dfa2-46fc-a738-3d4417154d11-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.452588 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.449059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.452588 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.449094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b40458b-dfa2-46fc-a738-3d4417154d11-config-out\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549685 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-web-config\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549685 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b40458b-dfa2-46fc-a738-3d4417154d11-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549685 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b40458b-dfa2-46fc-a738-3d4417154d11-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549867 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549867 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549867 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.549867 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b40458b-dfa2-46fc-a738-3d4417154d11-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b40458b-dfa2-46fc-a738-3d4417154d11-config-out\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.549958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b40458b-dfa2-46fc-a738-3d4417154d11-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.550006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.550037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qs7w\" (UniqueName: \"kubernetes.io/projected/9b40458b-dfa2-46fc-a738-3d4417154d11-kube-api-access-6qs7w\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550585 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.550562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b40458b-dfa2-46fc-a738-3d4417154d11-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.550779 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.550752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b40458b-dfa2-46fc-a738-3d4417154d11-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.551105 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.551075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b40458b-dfa2-46fc-a738-3d4417154d11-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.552823 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.552796 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.552990 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.552927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.553303 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.553283 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.553407 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.553386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.553448 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.553386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.553515 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.553495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b40458b-dfa2-46fc-a738-3d4417154d11-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.553554 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.553510 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.554092 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.554075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b40458b-dfa2-46fc-a738-3d4417154d11-web-config\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.554217 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.554199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b40458b-dfa2-46fc-a738-3d4417154d11-config-out\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.563719 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.563700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qs7w\" (UniqueName: \"kubernetes.io/projected/9b40458b-dfa2-46fc-a738-3d4417154d11-kube-api-access-6qs7w\") pod \"alertmanager-main-0\" (UID: \"9b40458b-dfa2-46fc-a738-3d4417154d11\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.670869 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.670844 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:04.816533 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:04.816468 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:04.820545 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:38:04.820517 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b40458b_dfa2_46fc_a738_3d4417154d11.slice/crio-1ecff14d02e6267892e1e3c1baa9922cdab9e2c22e04f863cc901048e33b1a49 WatchSource:0}: Error finding container 1ecff14d02e6267892e1e3c1baa9922cdab9e2c22e04f863cc901048e33b1a49: Status 404 returned error can't find the container with id 1ecff14d02e6267892e1e3c1baa9922cdab9e2c22e04f863cc901048e33b1a49 Jun 08 19:38:05.054756 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:05.054727 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37a7abd4-6475-42b8-b481-088b654eedc6" path="/var/lib/kubelet/pods/37a7abd4-6475-42b8-b481-088b654eedc6/volumes" Jun 08 19:38:05.304022 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:05.303963 2561 generic.go:356] "Generic (PLEG): container finished" podID="9b40458b-dfa2-46fc-a738-3d4417154d11" containerID="f63923d90ad5aefdba089f7ae8e2829f44eff85bda158eec6f5ec76a534aa17a" exitCode=0 Jun 08 19:38:05.304402 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:05.304079 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerDied","Data":"f63923d90ad5aefdba089f7ae8e2829f44eff85bda158eec6f5ec76a534aa17a"} Jun 08 19:38:05.304402 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:05.304163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"1ecff14d02e6267892e1e3c1baa9922cdab9e2c22e04f863cc901048e33b1a49"} Jun 08 19:38:06.313933 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.313902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"ddb0c64a41b8f43644d06cd03999073c35434dbf4cfb72ed13dd7be2bc4ed09e"} Jun 08 19:38:06.314285 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.313970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"9ab317b43c0199058e621b5f12489cc7b52a343d5bdb3363df3e8486c2e7c36b"} Jun 08 19:38:06.314285 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.314016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"89aeb3fb6e1aff1ee646a4341bedccb6c2481c28a1b5e20f2a448c9c21c6f716"} Jun 08 19:38:06.314285 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.314055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"f9261d33da9236052ae78ad0932b1f53c295236a7ab9986a6a40e931514199f9"} Jun 08 19:38:06.314285 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.314086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"61c5bc27f1bf9532ef59642f29ad61d1ebe8c4749f9bf98c76868252950e4626"} Jun 08 19:38:06.314285 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.314112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b40458b-dfa2-46fc-a738-3d4417154d11","Type":"ContainerStarted","Data":"07b4e1c984280a32edc275367393c6c817fcd1d875e4d87dd28a0470221ba18a"} Jun 08 19:38:06.360664 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:38:06.360614 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.345094801 podStartE2EDuration="2.36059825s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.503449ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:06.35814163 +0000 UTC m=+379.745463291" watchObservedRunningTime="2026-06-08 19:38:06.36059825 +0000 UTC m=+379.747919892" Jun 08 19:39:09.609711 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.609626 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4jcgz/must-gather-9kfns"] Jun 08 19:39:09.612582 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.612561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.615092 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.615072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4jcgz\"/\"default-dockercfg-jnbv5\"" Jun 08 19:39:09.620587 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.615265 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4jcgz\"/\"openshift-service-ca.crt\"" Jun 08 19:39:09.620587 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.615566 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4jcgz\"/\"kube-root-ca.crt\"" Jun 08 19:39:09.623633 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.623613 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jcgz/must-gather-9kfns"] Jun 08 19:39:09.687501 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.687476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glwth\" (UniqueName: \"kubernetes.io/projected/d70410d3-5156-47fa-8ba7-b2d5dc49c3b7-kube-api-access-glwth\") pod \"must-gather-9kfns\" (UID: \"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7\") " pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.687601 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.687503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d70410d3-5156-47fa-8ba7-b2d5dc49c3b7-must-gather-output\") pod \"must-gather-9kfns\" (UID: \"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7\") " pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.788818 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.788782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glwth\" (UniqueName: \"kubernetes.io/projected/d70410d3-5156-47fa-8ba7-b2d5dc49c3b7-kube-api-access-glwth\") pod \"must-gather-9kfns\" (UID: \"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7\") " pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.788894 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.788823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d70410d3-5156-47fa-8ba7-b2d5dc49c3b7-must-gather-output\") pod \"must-gather-9kfns\" (UID: \"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7\") " pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.789210 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.789193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d70410d3-5156-47fa-8ba7-b2d5dc49c3b7-must-gather-output\") pod \"must-gather-9kfns\" (UID: \"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7\") " pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.796411 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.796390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glwth\" (UniqueName: \"kubernetes.io/projected/d70410d3-5156-47fa-8ba7-b2d5dc49c3b7-kube-api-access-glwth\") pod \"must-gather-9kfns\" (UID: \"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7\") " pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:09.924144 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:09.924082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jcgz/must-gather-9kfns" Jun 08 19:39:10.044926 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:10.044901 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jcgz/must-gather-9kfns"] Jun 08 19:39:10.047907 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:39:10.047885 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd70410d3_5156_47fa_8ba7_b2d5dc49c3b7.slice/crio-31d6a4d940226fd85e69c48bd6b42fdfa195c01b3632a4f28b7eb84c9679fdba WatchSource:0}: Error finding container 31d6a4d940226fd85e69c48bd6b42fdfa195c01b3632a4f28b7eb84c9679fdba: Status 404 returned error can't find the container with id 31d6a4d940226fd85e69c48bd6b42fdfa195c01b3632a4f28b7eb84c9679fdba Jun 08 19:39:10.543034 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:10.543003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jcgz/must-gather-9kfns" event={"ID":"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7","Type":"ContainerStarted","Data":"31d6a4d940226fd85e69c48bd6b42fdfa195c01b3632a4f28b7eb84c9679fdba"} Jun 08 19:39:11.551208 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:11.551138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jcgz/must-gather-9kfns" event={"ID":"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7","Type":"ContainerStarted","Data":"1a31a8f7aab078183bd7f279d1d4cc058fae131af1df7f8027b49836c4eb2e90"} Jun 08 19:39:11.551208 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:11.551192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jcgz/must-gather-9kfns" event={"ID":"d70410d3-5156-47fa-8ba7-b2d5dc49c3b7","Type":"ContainerStarted","Data":"f5d32a17f316c9e767d62525fe23ef5deb746989f16373a9e30df78fb2ca3170"} Jun 08 19:39:11.568747 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:11.568692 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4jcgz/must-gather-9kfns" podStartSLOduration=1.8863546329999998 podStartE2EDuration="2.568673756s" totalImagesPullingTime="682.319123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:11.567817389 +0000 UTC m=+444.955139054" watchObservedRunningTime="2026-06-08 19:39:11.568673756 +0000 UTC m=+444.955995431" Jun 08 19:39:12.181485 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:12.181457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f542t_9a7766f7-2067-440e-88ac-7bc3a55c395e/global-pull-secret-syncer/0.log" Jun 08 19:39:12.184319 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:12.184302 2561 ???:1] "http: TLS handshake error from 10.0.143.59:39064: EOF" Jun 08 19:39:12.376382 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:12.376349 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kkjhz_3e6a7f61-2455-4de7-9822-37583e5eea2e/konnectivity-agent/0.log" Jun 08 19:39:12.440448 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:12.440372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-91.ec2.internal_9e9d0e36d2dcf7f73f9867c67d996aba/haproxy/0.log" Jun 08 19:39:15.145640 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.145613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/alertmanager/0.log" Jun 08 19:39:15.171498 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.171462 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/config-reloader/0.log" Jun 08 19:39:15.196523 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.196500 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/kube-rbac-proxy-web/0.log" Jun 08 19:39:15.231530 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.231506 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/kube-rbac-proxy/0.log" Jun 08 19:39:15.263932 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.263861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/kube-rbac-proxy-metric/0.log" Jun 08 19:39:15.291003 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.290958 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/prom-label-proxy/0.log" Jun 08 19:39:15.321390 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.321364 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b40458b-dfa2-46fc-a738-3d4417154d11/init-config-reloader/0.log" Jun 08 19:39:15.417956 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.417867 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2wxl6_fc369df4-8167-49af-9761-25ebdca7cdab/kube-state-metrics/0.log" Jun 08 19:39:15.454347 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.454325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2wxl6_fc369df4-8167-49af-9761-25ebdca7cdab/kube-rbac-proxy-main/0.log" Jun 08 19:39:15.484780 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.484757 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2wxl6_fc369df4-8167-49af-9761-25ebdca7cdab/kube-rbac-proxy-self/0.log" Jun 08 19:39:15.559450 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.559423 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-52h7w_ff045944-5e3b-4bce-af07-66c1d875cc80/monitoring-plugin/0.log" Jun 08 19:39:15.604732 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.604694 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvstr_21445503-ea05-4f34-a8df-8ce0bcb8e5dc/node-exporter/0.log" Jun 08 19:39:15.630568 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.630523 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvstr_21445503-ea05-4f34-a8df-8ce0bcb8e5dc/kube-rbac-proxy/0.log" Jun 08 19:39:15.663414 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:15.663392 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvstr_21445503-ea05-4f34-a8df-8ce0bcb8e5dc/init-textfile/0.log" Jun 08 19:39:17.771119 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:17.771073 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-h7vbs_c636ac1e-112f-4528-8d12-714641b72e8e/networking-console-plugin/0.log" Jun 08 19:39:19.536542 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.536487 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n"] Jun 08 19:39:19.541107 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.541083 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.549032 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.548962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n"] Jun 08 19:39:19.578496 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.578462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-proc\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.578727 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.578708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-lib-modules\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.578824 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.578810 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-podres\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.578956 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.578943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9pc\" (UniqueName: \"kubernetes.io/projected/52edb088-7cdd-487b-a276-ddb8b5df3250-kube-api-access-kz9pc\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.579096 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.579081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-sys\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680239 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-proc\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680419 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680245 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-lib-modules\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680419 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-podres\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680419 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9pc\" (UniqueName: \"kubernetes.io/projected/52edb088-7cdd-487b-a276-ddb8b5df3250-kube-api-access-kz9pc\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680419 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-sys\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680630 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-sys\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680630 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-proc\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680741 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-lib-modules\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.680798 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.680738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52edb088-7cdd-487b-a276-ddb8b5df3250-podres\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.690533 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.690489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9pc\" (UniqueName: \"kubernetes.io/projected/52edb088-7cdd-487b-a276-ddb8b5df3250-kube-api-access-kz9pc\") pod \"perf-node-gather-daemonset-b4m8n\" (UID: \"52edb088-7cdd-487b-a276-ddb8b5df3250\") " pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.854529 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.854440 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:19.995934 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:19.995901 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n"] Jun 08 19:39:19.999059 ip-10-0-129-91 kubenswrapper[2561]: W0608 19:39:19.999031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod52edb088_7cdd_487b_a276_ddb8b5df3250.slice/crio-01ebbdcd0c3faee35bf04719017c3b944835bbc751d0e9b76caadc814f9ba0f7 WatchSource:0}: Error finding container 01ebbdcd0c3faee35bf04719017c3b944835bbc751d0e9b76caadc814f9ba0f7: Status 404 returned error can't find the container with id 01ebbdcd0c3faee35bf04719017c3b944835bbc751d0e9b76caadc814f9ba0f7 Jun 08 19:39:20.108698 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.108673 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz768_0eaac090-60d0-4498-a991-7ab711ca39d0/dns/0.log" Jun 08 19:39:20.129083 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.129064 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz768_0eaac090-60d0-4498-a991-7ab711ca39d0/kube-rbac-proxy/0.log" Jun 08 19:39:20.244658 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.244628 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stmv4_096e07ba-fccc-4742-82a5-5f23c35c7a1f/dns-node-resolver/0.log" Jun 08 19:39:20.597205 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.597118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" event={"ID":"52edb088-7cdd-487b-a276-ddb8b5df3250","Type":"ContainerStarted","Data":"7710b7eb1668cb57ea748e5995383d86b428d1bb36e13cc4d4dffff4d8e9cf84"} Jun 08 19:39:20.597205 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.597175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" event={"ID":"52edb088-7cdd-487b-a276-ddb8b5df3250","Type":"ContainerStarted","Data":"01ebbdcd0c3faee35bf04719017c3b944835bbc751d0e9b76caadc814f9ba0f7"} Jun 08 19:39:20.597693 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.597239 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:20.613210 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.613162 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" podStartSLOduration=1.613147388 podStartE2EDuration="1.613147388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:20.612151541 +0000 UTC m=+453.999473183" watchObservedRunningTime="2026-06-08 19:39:20.613147388 +0000 UTC m=+454.000469077" Jun 08 19:39:20.665767 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:20.665738 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kwg2l_5e319a45-1505-40c4-a7d4-7cc613cb071d/node-ca/0.log" Jun 08 19:39:21.707776 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:21.707748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-td2cl_bf113bd6-2ab0-4adf-8ac6-9f0f71805db8/serve-healthcheck-canary/0.log" Jun 08 19:39:22.152487 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:22.152459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kk2cs_2e5b38d8-db4f-42db-b9dc-ae54243472a5/kube-rbac-proxy/0.log" Jun 08 19:39:22.177510 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:22.177490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kk2cs_2e5b38d8-db4f-42db-b9dc-ae54243472a5/exporter/0.log" Jun 08 19:39:22.199813 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:22.199791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kk2cs_2e5b38d8-db4f-42db-b9dc-ae54243472a5/extractor/0.log" Jun 08 19:39:26.611193 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:26.611164 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4jcgz/perf-node-gather-daemonset-b4m8n" Jun 08 19:39:27.246035 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.246005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6rjf7_e6681202-33cf-4225-9a56-29295bd09923/kube-multus/0.log" Jun 08 19:39:27.443635 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.443606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/kube-multus-additional-cni-plugins/0.log" Jun 08 19:39:27.464748 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.464719 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/egress-router-binary-copy/0.log" Jun 08 19:39:27.489258 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.489237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/cni-plugins/0.log" Jun 08 19:39:27.511198 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.511134 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/bond-cni-plugin/0.log" Jun 08 19:39:27.532472 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.532448 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/routeoverride-cni/0.log" Jun 08 19:39:27.552760 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.552737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/whereabouts-cni-bincopy/0.log" Jun 08 19:39:27.574623 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.574585 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2kbq_4364d99c-f48c-4a28-b1c2-1b4997131e66/whereabouts-cni/0.log" Jun 08 19:39:27.863785 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.863747 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g7t5v_356c8b38-b4b5-44b0-aee6-e438f71a4f36/network-metrics-daemon/0.log" Jun 08 19:39:27.884337 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:27.884290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g7t5v_356c8b38-b4b5-44b0-aee6-e438f71a4f36/kube-rbac-proxy/0.log" Jun 08 19:39:28.814805 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.814724 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-controller/0.log" Jun 08 19:39:28.838311 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.838286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/0.log" Jun 08 19:39:28.838479 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.838461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovn-acl-logging/1.log" Jun 08 19:39:28.861920 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.861897 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/kube-rbac-proxy-node/0.log" Jun 08 19:39:28.888808 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.888787 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 19:39:28.913407 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.913388 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/northd/0.log" Jun 08 19:39:28.939003 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.938953 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/nbdb/0.log" Jun 08 19:39:28.962500 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:28.962472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/sbdb/0.log" Jun 08 19:39:29.006280 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:29.006252 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gcht_e815a195-bf1a-4736-ac52-3c5eaae249ae/ovnkube-controller/0.log" Jun 08 19:39:30.458631 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:30.458533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6klsd_e7ca8091-0b56-44ac-a17c-e0f694210e2e/network-check-target-container/0.log" Jun 08 19:39:31.466906 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:31.466884 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dgbsg_f2b89959-3a79-45b5-831c-f9d0e78f7455/iptables-alerter/0.log" Jun 08 19:39:32.103151 ip-10-0-129-91 kubenswrapper[2561]: I0608 19:39:32.103121 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sf7zn_da6ba5fc-ecb8-4c53-b432-8f0ab9e05591/tuned/0.log"