May 26 15:25:46.890497 ip-10-0-133-138 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 26 15:25:46.890511 ip-10-0-133-138 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 26 15:25:46.890521 ip-10-0-133-138 systemd[1]: kubelet.service: Failed with result 'resources'. May 26 15:25:46.890848 ip-10-0-133-138 systemd[1]: Failed to start Kubernetes Kubelet. May 26 15:25:58.150389 ip-10-0-133-138 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 26 15:25:58.150404 ip-10-0-133-138 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9206deb3bcd5404e93deb9f333c26f85 -- May 26 15:28:47.160755 ip-10-0-133-138 systemd[1]: Starting Kubernetes Kubelet... May 26 15:28:47.532610 ip-10-0-133-138 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 15:28:47.532610 ip-10-0-133-138 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 15:28:47.532610 ip-10-0-133-138 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 15:28:47.532610 ip-10-0-133-138 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 15:28:47.532610 ip-10-0-133-138 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 15:28:47.534120 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.534035 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 15:28:47.537445 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537430 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 15:28:47.537445 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537444 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537450 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537455 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537458 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537461 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537465 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537468 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537471 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537474 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537477 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537480 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537488 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537491 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537494 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537496 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537499 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537501 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537504 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537506 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:28:47.537506 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537513 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537516 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537519 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537521 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537524 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537526 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537529 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537532 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537534 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537537 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537539 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537542 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537544 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537547 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537549 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537552 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537554 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537557 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537561 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:28:47.537955 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537563 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537566 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537568 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537571 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537573 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537576 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537578 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537581 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537584 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537586 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537588 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537591 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537594 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537596 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537598 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537602 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537605 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537608 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537610 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:28:47.538407 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537613 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537617 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537621 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537624 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537626 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537629 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537631 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537634 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537637 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537639 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537642 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537644 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537647 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537649 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537652 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537654 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537657 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537659 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537661 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537664 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:28:47.538890 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537666 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537669 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537671 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537673 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537676 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537679 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537681 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.537684 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538030 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538035 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538038 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538040 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538043 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538046 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538049 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538051 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538054 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538056 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538059 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538061 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:28:47.539372 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538064 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538067 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538069 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538072 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538075 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538077 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538079 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538082 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538084 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538087 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538089 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538092 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538094 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538096 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538099 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538101 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538104 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538106 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538109 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538111 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:28:47.539867 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538114 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538117 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538120 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538122 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538125 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538127 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538130 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538133 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538136 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538138 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538141 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538143 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538146 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538149 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538151 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538154 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538157 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538160 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538163 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538165 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:28:47.540368 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538169 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538173 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538176 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538179 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538181 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538184 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538187 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538190 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538192 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538195 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538198 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538200 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538204 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538207 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538210 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538213 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538216 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538219 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538223 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538225 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:28:47.540873 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538228 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538230 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538233 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538235 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538238 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538240 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538243 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538246 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538251 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538253 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538256 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538258 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538261 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.538263 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539528 2559 flags.go:64] FLAG: --address="0.0.0.0" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539543 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539549 2559 flags.go:64] FLAG: --anonymous-auth="true" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539554 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539558 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539562 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539566 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 15:28:47.541375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539570 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539573 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539576 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539580 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539584 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539587 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539590 2559 flags.go:64] FLAG: --cgroup-root="" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539593 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539596 2559 flags.go:64] FLAG: --client-ca-file="" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539599 2559 flags.go:64] FLAG: --cloud-config="" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539602 2559 flags.go:64] FLAG: --cloud-provider="external" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539604 2559 flags.go:64] FLAG: --cluster-dns="[]" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539609 2559 flags.go:64] FLAG: --cluster-domain="" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539612 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539615 2559 flags.go:64] FLAG: --config-dir="" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539618 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539621 2559 flags.go:64] FLAG: --container-log-max-files="5" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539625 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539629 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539633 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539636 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539639 2559 flags.go:64] FLAG: --contention-profiling="false" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539642 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539644 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539648 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 15:28:47.541922 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539651 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539657 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539660 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539663 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539666 2559 flags.go:64] FLAG: --enable-load-reader="false" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539669 2559 flags.go:64] FLAG: --enable-server="true" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539671 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539675 2559 flags.go:64] FLAG: --event-burst="100" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539678 2559 flags.go:64] FLAG: --event-qps="50" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539681 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539684 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539687 2559 flags.go:64] FLAG: --eviction-hard="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539691 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539694 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539697 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539700 2559 flags.go:64] FLAG: --eviction-soft="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539703 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539706 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539709 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539711 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539714 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539717 2559 flags.go:64] FLAG: --fail-swap-on="true" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539720 2559 flags.go:64] FLAG: --feature-gates="" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539724 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539727 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 15:28:47.542547 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539730 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539733 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539737 2559 flags.go:64] FLAG: --healthz-port="10248" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539740 2559 flags.go:64] FLAG: --help="false" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539742 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-133-138.ec2.internal" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539745 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539749 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539751 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539755 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539758 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539761 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539764 2559 flags.go:64] FLAG: --image-service-endpoint="" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539766 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539769 2559 flags.go:64] FLAG: --kube-api-burst="100" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539783 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539786 2559 flags.go:64] FLAG: --kube-api-qps="50" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539789 2559 flags.go:64] FLAG: --kube-reserved="" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539792 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539796 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539799 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539802 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539804 2559 flags.go:64] FLAG: --lock-file="" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539807 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539810 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 15:28:47.543264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539813 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539818 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539821 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539824 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539827 2559 flags.go:64] FLAG: --logging-format="text" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539830 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539833 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539836 2559 flags.go:64] FLAG: --manifest-url="" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539839 2559 flags.go:64] FLAG: --manifest-url-header="" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539843 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539847 2559 flags.go:64] FLAG: --max-open-files="1000000" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539851 2559 flags.go:64] FLAG: --max-pods="110" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539854 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539857 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539860 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539863 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539866 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539869 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539872 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539880 2559 flags.go:64] FLAG: --node-status-max-images="50" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539883 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539886 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539889 2559 flags.go:64] FLAG: --pod-cidr="" May 26 15:28:47.543866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539891 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539897 2559 flags.go:64] FLAG: --pod-manifest-path="" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539899 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539903 2559 flags.go:64] FLAG: --pods-per-core="0" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539906 2559 flags.go:64] FLAG: --port="10250" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539909 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539915 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0810061152abf0150" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539918 2559 flags.go:64] FLAG: --qos-reserved="" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539921 2559 flags.go:64] FLAG: --read-only-port="10255" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539924 2559 flags.go:64] FLAG: --register-node="true" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539926 2559 flags.go:64] FLAG: --register-schedulable="true" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539929 2559 flags.go:64] FLAG: --register-with-taints="" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539933 2559 flags.go:64] FLAG: --registry-burst="10" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539936 2559 flags.go:64] FLAG: --registry-qps="5" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539939 2559 flags.go:64] FLAG: --reserved-cpus="" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539941 2559 flags.go:64] FLAG: --reserved-memory="" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539945 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539948 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539951 2559 flags.go:64] FLAG: --rotate-certificates="false" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539954 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539958 2559 flags.go:64] FLAG: --runonce="false" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539961 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539964 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539967 2559 flags.go:64] FLAG: --seccomp-default="false" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539970 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539972 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 15:28:47.544453 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539975 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539978 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539981 2559 flags.go:64] FLAG: --storage-driver-password="root" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539984 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539987 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539990 2559 flags.go:64] FLAG: --storage-driver-user="root" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539992 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539996 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.539998 2559 flags.go:64] FLAG: --system-cgroups="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540001 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540007 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540010 2559 flags.go:64] FLAG: --tls-cert-file="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540013 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540017 2559 flags.go:64] FLAG: --tls-min-version="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540020 2559 flags.go:64] FLAG: --tls-private-key-file="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540023 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540026 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540028 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540031 2559 flags.go:64] FLAG: --v="2" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540036 2559 flags.go:64] FLAG: --version="false" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540040 2559 flags.go:64] FLAG: --vmodule="" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540044 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540047 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540161 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:28:47.545085 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540167 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540170 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540173 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540176 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540179 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540181 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540184 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540186 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540189 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540191 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540194 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540197 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540199 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540202 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540205 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540208 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540210 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540213 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540216 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540219 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:28:47.545679 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540221 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540224 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540227 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540229 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540233 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540237 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540240 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540243 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540246 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540248 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540251 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540253 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540261 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540263 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540266 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540269 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540272 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540274 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540277 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540280 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:28:47.546183 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540282 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540285 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540287 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540290 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540292 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540295 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540297 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540300 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540302 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540308 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540311 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540314 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540317 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540319 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540322 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540324 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540327 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540329 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540332 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540334 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:28:47.546695 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540337 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540339 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540342 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540344 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540348 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540351 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540354 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540356 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540359 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540362 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540365 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540367 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540370 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540372 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540377 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540380 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540383 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540386 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540389 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:28:47.547179 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540392 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540394 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540400 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540402 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540405 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.540408 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.540413 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.546682 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.546697 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546743 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546748 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546751 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546755 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546758 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546761 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:28:47.547663 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546764 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546766 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546769 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546771 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546774 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546777 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546779 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546782 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546785 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546787 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546790 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546793 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546796 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546798 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546801 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546804 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546806 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546810 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546814 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:28:47.548083 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546816 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546819 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546822 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546824 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546827 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546831 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546836 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546840 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546843 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546846 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546849 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546852 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546854 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546858 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546860 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546863 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546865 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546868 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546871 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:28:47.548564 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546873 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546876 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546879 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546881 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546884 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546886 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546889 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546892 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546894 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546896 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546899 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546902 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546904 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546907 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546909 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546912 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546914 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546917 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546919 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546923 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:28:47.549033 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546926 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546929 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546931 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546934 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546936 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546939 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546942 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546944 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546947 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546949 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546952 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546954 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546957 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546959 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546962 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546964 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546966 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546970 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546972 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546975 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:28:47.549545 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546977 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.546980 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.546986 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547084 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547090 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547093 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547096 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547099 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547102 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547104 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547107 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547110 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547114 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547117 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547120 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:28:47.550015 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547122 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547125 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547127 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547130 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547132 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547135 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547137 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547140 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547142 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547145 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547147 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547150 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547152 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547154 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547157 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547160 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547162 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547164 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547167 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547169 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:28:47.550380 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547171 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547174 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547177 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547179 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547182 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547185 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547187 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547190 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547193 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547196 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547199 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547202 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547204 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547207 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547210 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547212 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547215 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547217 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547220 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547222 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:28:47.550877 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547225 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547227 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547230 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547232 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547235 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547237 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547240 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547242 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547244 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547247 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547250 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547252 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547255 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547258 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547260 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547263 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547266 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547268 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547271 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547273 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:28:47.551392 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547276 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547280 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547283 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547286 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547289 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547292 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547295 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547297 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547300 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547302 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547305 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547307 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547310 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:47.547312 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.547317 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 15:28:47.551892 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.548098 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 26 15:28:47.552259 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.550287 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 15:28:47.552259 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.551558 2559 server.go:1019] "Starting client certificate rotation" May 26 15:28:47.552259 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.551654 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 15:28:47.552259 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.551689 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 15:28:47.574847 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.574830 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 15:28:47.578459 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.578442 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 15:28:47.595894 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.595874 2559 log.go:25] "Validated CRI v1 runtime API" May 26 15:28:47.600664 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.600649 2559 log.go:25] "Validated CRI v1 image API" May 26 15:28:47.601870 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.601854 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 15:28:47.603811 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.603794 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 15:28:47.605740 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.605718 2559 fs.go:135] Filesystem UUIDs: map[57094d50-e9c0-437d-9bbb-87330c89fd10:/dev/nvme0n1p3 6dac0ba2-9b28-486f-8a3d-2e1643357f83:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 26 15:28:47.605827 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.605737 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 15:28:47.609958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.609852 2559 manager.go:217] Machine: {Timestamp:2026-05-26 15:28:47.60934913 +0000 UTC m=+0.344004779 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097101 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ddb62079f74b504caf36aa41e7f3d SystemUUID:ec2ddb62-079f-74b5-04ca-f36aa41e7f3d BootID:9206deb3-bcd5-404e-93de-b9f333c26f85 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:af:25:24:56:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:af:25:24:56:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:04:50:69:73:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 15:28:47.610755 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.610741 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 15:28:47.610859 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.610843 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 15:28:47.612978 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.612952 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 15:28:47.613112 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.612980 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 15:28:47.613160 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.613123 2559 topology_manager.go:138] "Creating topology manager with none policy" May 26 15:28:47.613160 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.613131 2559 container_manager_linux.go:306] "Creating device plugin manager" May 26 15:28:47.613160 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.613142 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 15:28:47.613986 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.613976 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 15:28:47.615083 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.615073 2559 state_mem.go:36] "Initialized new in-memory state store" May 26 15:28:47.615191 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.615183 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 15:28:47.617765 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.617755 2559 kubelet.go:491] "Attempting to sync node with API server" May 26 15:28:47.617799 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.617768 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 15:28:47.617799 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.617779 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 15:28:47.617799 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.617788 2559 kubelet.go:397] "Adding apiserver pod source" May 26 15:28:47.617931 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.617801 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 15:28:47.618991 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.618977 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 15:28:47.619057 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.618997 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 15:28:47.622349 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.622333 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 15:28:47.624891 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.624876 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 15:28:47.624968 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.624953 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9rlt" May 26 15:28:47.626949 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626927 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 15:28:47.626949 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626948 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626957 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626965 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626978 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626987 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.626995 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.627008 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.627018 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.627027 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.627049 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 15:28:47.627096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.627058 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 15:28:47.629039 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.629023 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 15:28:47.629095 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.629045 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 15:28:47.629297 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.629272 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 15:28:47.629363 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.629272 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 15:28:47.631912 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.631897 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 15:28:47.632232 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.632216 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 15:28:47.632308 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.632262 2559 server.go:1295] "Started kubelet" May 26 15:28:47.632393 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.632350 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 15:28:47.632487 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.632402 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 15:28:47.632529 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.632505 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 15:28:47.633099 ip-10-0-133-138 systemd[1]: Started Kubernetes Kubelet. May 26 15:28:47.634746 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.634720 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9rlt" May 26 15:28:47.637123 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.637104 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 15:28:47.638450 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.638434 2559 server.go:317] "Adding debug handlers to kubelet server" May 26 15:28:47.644522 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.644504 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 15:28:47.645168 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.645143 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 15:28:47.645393 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.645374 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 15:28:47.645393 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.645395 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 15:28:47.645546 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.645529 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 15:28:47.645643 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.645616 2559 reconstruct.go:97] "Volume reconstruction finished" May 26 15:28:47.645643 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.645623 2559 reconciler.go:26] "Reconciler: start to sync state" May 26 15:28:47.646089 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646072 2559 factory.go:55] Registering systemd factory May 26 15:28:47.646143 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646094 2559 factory.go:223] Registration of the systemd container factory successfully May 26 15:28:47.646384 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646349 2559 factory.go:153] Registering CRI-O factory May 26 15:28:47.646384 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646373 2559 factory.go:223] Registration of the crio container factory successfully May 26 15:28:47.646554 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646450 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 15:28:47.646554 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646474 2559 factory.go:103] Registering Raw factory May 26 15:28:47.646554 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646489 2559 manager.go:1196] Started watching for new ooms in manager May 26 15:28:47.646554 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.646541 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:47.646748 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.646542 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 15:28:47.647002 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.646987 2559 manager.go:319] Starting recovery of all containers May 26 15:28:47.650797 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.650773 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:28:47.653466 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.653286 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-138.ec2.internal\" not found" node="ip-10-0-133-138.ec2.internal" May 26 15:28:47.657537 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.657519 2559 manager.go:324] Recovery completed May 26 15:28:47.661486 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.661466 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:28:47.663357 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.663341 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientMemory" May 26 15:28:47.663452 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.663371 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:28:47.663452 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.663381 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientPID" May 26 15:28:47.663884 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.663860 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 15:28:47.663884 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.663875 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 15:28:47.663985 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.663894 2559 state_mem.go:36] "Initialized new in-memory state store" May 26 15:28:47.667718 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.667706 2559 policy_none.go:49] "None policy: Start" May 26 15:28:47.667761 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.667723 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 15:28:47.667761 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.667734 2559 state_mem.go:35] "Initializing new in-memory state store" May 26 15:28:47.710956 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.710935 2559 manager.go:341] "Starting Device Plugin manager" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.710973 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.710985 2559 server.go:85] "Starting device plugin registration server" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.711223 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.711234 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.711339 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.711443 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.711455 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.711897 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 15:28:47.725938 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.711936 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:47.769912 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.769891 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 15:28:47.771003 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.770982 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 15:28:47.771003 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.771004 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 15:28:47.771103 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.771020 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 15:28:47.771103 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.771027 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 26 15:28:47.771103 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.771064 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 15:28:47.776489 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.776475 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:28:47.812116 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.812093 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:28:47.812977 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.812957 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientMemory" May 26 15:28:47.813030 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.812991 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:28:47.813030 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.813001 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientPID" May 26 15:28:47.813030 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.813021 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-138.ec2.internal" May 26 15:28:47.822246 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.822230 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-138.ec2.internal" May 26 15:28:47.822289 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.822249 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-138.ec2.internal\": node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:47.838966 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.838950 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:47.871242 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.871224 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal"] May 26 15:28:47.871290 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.871280 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:28:47.872252 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.872240 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientMemory" May 26 15:28:47.872312 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.872265 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:28:47.872312 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.872281 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientPID" May 26 15:28:47.873807 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.873788 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:28:47.873966 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.873946 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:47.874004 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.873972 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:28:47.874428 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.874402 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientMemory" May 26 15:28:47.874491 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.874438 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:28:47.874491 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.874448 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientPID" May 26 15:28:47.874491 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.874474 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientMemory" May 26 15:28:47.874491 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.874491 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:28:47.874603 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.874500 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientPID" May 26 15:28:47.876102 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.876087 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" May 26 15:28:47.876186 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.876109 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:28:47.876763 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.876746 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientMemory" May 26 15:28:47.876842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.876773 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:28:47.876842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.876784 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeHasSufficientPID" May 26 15:28:47.900952 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.900936 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-138.ec2.internal\" not found" node="ip-10-0-133-138.ec2.internal" May 26 15:28:47.905205 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.905189 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-138.ec2.internal\" not found" node="ip-10-0-133-138.ec2.internal" May 26 15:28:47.939910 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:47.939894 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:47.947837 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.947818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ceab921fea60be7cba7c46ee01dff98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal\" (UID: \"8ceab921fea60be7cba7c46ee01dff98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:47.947911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.947841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ceab921fea60be7cba7c46ee01dff98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal\" (UID: \"8ceab921fea60be7cba7c46ee01dff98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:47.947911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:47.947860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f0de9b4d9b5f4cc43fcd9aec93b8726-config\") pod \"kube-apiserver-proxy-ip-10-0-133-138.ec2.internal\" (UID: \"3f0de9b4d9b5f4cc43fcd9aec93b8726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" May 26 15:28:48.040565 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:48.040518 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:48.048849 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.048831 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f0de9b4d9b5f4cc43fcd9aec93b8726-config\") pod \"kube-apiserver-proxy-ip-10-0-133-138.ec2.internal\" (UID: \"3f0de9b4d9b5f4cc43fcd9aec93b8726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" May 26 15:28:48.048910 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.048855 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ceab921fea60be7cba7c46ee01dff98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal\" (UID: \"8ceab921fea60be7cba7c46ee01dff98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:48.048910 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.048875 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ceab921fea60be7cba7c46ee01dff98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal\" (UID: \"8ceab921fea60be7cba7c46ee01dff98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:48.048978 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.048916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ceab921fea60be7cba7c46ee01dff98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal\" (UID: \"8ceab921fea60be7cba7c46ee01dff98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:48.048978 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.048939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f0de9b4d9b5f4cc43fcd9aec93b8726-config\") pod \"kube-apiserver-proxy-ip-10-0-133-138.ec2.internal\" (UID: \"3f0de9b4d9b5f4cc43fcd9aec93b8726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" May 26 15:28:48.048978 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.048939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ceab921fea60be7cba7c46ee01dff98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal\" (UID: \"8ceab921fea60be7cba7c46ee01dff98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:48.141185 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:48.141155 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:48.203578 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.203560 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:48.208083 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.208068 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" May 26 15:28:48.241615 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:48.241592 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:48.342108 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:48.342045 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:48.442575 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:48.442545 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:48.543100 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:48.543072 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-138.ec2.internal\" not found" May 26 15:28:48.551395 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.551379 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 15:28:48.551530 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.551515 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 15:28:48.551569 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.551540 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 15:28:48.638511 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.638442 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:23:47 +0000 UTC" deadline="2028-02-29 20:50:12.813256762 +0000 UTC" May 26 15:28:48.638511 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.638466 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15461h21m24.17479363s" May 26 15:28:48.641824 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.641803 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:28:48.642930 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.642913 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:28:48.645480 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.645466 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 15:28:48.645480 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.645473 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" May 26 15:28:48.655588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.655570 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 15:28:48.656332 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.656320 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" May 26 15:28:48.657248 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.657231 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 15:28:48.662023 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.662011 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 15:28:48.683499 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.683481 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzhr9" May 26 15:28:48.689308 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.689293 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gzhr9" May 26 15:28:48.829590 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:48.829557 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceab921fea60be7cba7c46ee01dff98.slice/crio-7948150cb1fa86038eec70e6ef2c8db030925d6e4f5e691c59936675a59cbe18 WatchSource:0}: Error finding container 7948150cb1fa86038eec70e6ef2c8db030925d6e4f5e691c59936675a59cbe18: Status 404 returned error can't find the container with id 7948150cb1fa86038eec70e6ef2c8db030925d6e4f5e691c59936675a59cbe18 May 26 15:28:48.829784 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:48.829760 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0de9b4d9b5f4cc43fcd9aec93b8726.slice/crio-55637ea69b2ee934e1be8b8d652133cb76545e70ab4c3a414e966ae1575ca7af WatchSource:0}: Error finding container 55637ea69b2ee934e1be8b8d652133cb76545e70ab4c3a414e966ae1575ca7af: Status 404 returned error can't find the container with id 55637ea69b2ee934e1be8b8d652133cb76545e70ab4c3a414e966ae1575ca7af May 26 15:28:48.834295 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:48.834283 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 15:28:49.547136 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.547103 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:28:49.619040 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.619011 2559 apiserver.go:52] "Watching apiserver" May 26 15:28:49.625211 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.625185 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 15:28:49.626299 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.626265 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ckzzg","kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal","openshift-cluster-node-tuning-operator/tuned-t67fg","openshift-dns/node-resolver-4wm7q","openshift-multus/multus-additional-cni-plugins-trlsj","openshift-multus/multus-nlb2d","openshift-multus/network-metrics-daemon-9gwg9","openshift-network-diagnostics/network-check-target-r87th","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss","openshift-image-registry/node-ca-k9v4q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal","openshift-network-operator/iptables-alerter-94vxk","openshift-ovn-kubernetes/ovnkube-node-kpxlw"] May 26 15:28:49.629131 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.629111 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:49.629221 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.629194 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:28:49.631320 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.631298 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.633528 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.633505 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 15:28:49.633619 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.633573 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k686d\"" May 26 15:28:49.633774 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.633739 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 15:28:49.635827 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.635809 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.636217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.635972 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.637964 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.637929 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 15:28:49.637964 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.637932 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lgl45\"" May 26 15:28:49.638253 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638238 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 15:28:49.638337 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638284 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 15:28:49.638337 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638246 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 15:28:49.638850 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638566 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wr4rj\"" May 26 15:28:49.638850 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638625 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 15:28:49.638850 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638663 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 15:28:49.638850 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.638751 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 15:28:49.640483 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.640217 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlb2d" May 26 15:28:49.640483 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.640310 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.642081 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.642066 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 15:28:49.642523 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.642507 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 15:28:49.642628 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.642548 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x8k9z\"" May 26 15:28:49.642628 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.642618 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 15:28:49.642733 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.642724 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8p67r\"" May 26 15:28:49.643101 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.643084 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:49.643179 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.643161 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:28:49.645329 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.645311 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.648173 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.647732 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 15:28:49.648173 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.647763 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 15:28:49.648173 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.647963 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 15:28:49.648173 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.648004 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84dq5\"" May 26 15:28:49.650032 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.650011 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.650123 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.650085 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.652041 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652021 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 15:28:49.652256 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652235 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 15:28:49.652352 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652261 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7dhxk\"" May 26 15:28:49.652585 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652499 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 15:28:49.652675 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652605 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 15:28:49.652675 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652615 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.652792 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.652621 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 15:28:49.653048 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.653027 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 15:28:49.653363 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.653332 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lp4pl\"" May 26 15:28:49.654661 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.654646 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 15:28:49.655250 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.655232 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 15:28:49.655377 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.655362 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 15:28:49.655377 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.655371 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 15:28:49.655524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.655490 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dpmr4\"" May 26 15:28:49.655584 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.655528 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 15:28:49.655707 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.655691 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 15:28:49.656542 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-systemd\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.656629 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-tuned\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.656629 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-cnibin\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.656629 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-cni-binary-copy\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.656629 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/338ae3af-7cf2-41da-86c9-d28d710a36a0-hosts-file\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.656842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-cnibin\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.656842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-var-lib-kubelet\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.656842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bpj\" (UniqueName: \"kubernetes.io/projected/d498e202-7f95-4b83-aef8-acd8fe75ce8f-kube-api-access-78bpj\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.656842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-os-release\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.656842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-system-cni-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97a19529-425a-47ca-b36d-b2977ddda8d2-cni-binary-copy\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-kubelet\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34cc8901-133f-4094-aafb-488de9fc6e23-host\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-cni-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.656983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-etc-selinux\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.657064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d28e805-9c72-4e28-a04b-cf4563552c00-konnectivity-ca\") pod \"konnectivity-agent-ckzzg\" (UID: \"5d28e805-9c72-4e28-a04b-cf4563552c00\") " pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r7kr\" (UniqueName: \"kubernetes.io/projected/338ae3af-7cf2-41da-86c9-d28d710a36a0-kube-api-access-6r7kr\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrwjs\" (UniqueName: \"kubernetes.io/projected/97a19529-425a-47ca-b36d-b2977ddda8d2-kube-api-access-xrwjs\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34cc8901-133f-4094-aafb-488de9fc6e23-serviceca\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-sys\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-conf-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-os-release\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-k8s-cni-cncf-io\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysctl-d\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-lib-modules\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysctl-conf\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs7wb\" (UniqueName: \"kubernetes.io/projected/b7e3906a-321e-467e-a2ff-cd54925e5c64-kube-api-access-vs7wb\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.657371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-etc-kubernetes\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-sys-fs\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d498e202-7f95-4b83-aef8-acd8fe75ce8f-tmp\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-socket-dir-parent\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-cni-bin\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-daemon-config\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-socket-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-device-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-modprobe-d\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-system-cni-dir\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-cni-multus\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9692l\" (UniqueName: \"kubernetes.io/projected/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-kube-api-access-9692l\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:49.657958 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-registration-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg6w7\" (UniqueName: \"kubernetes.io/projected/34cc8901-133f-4094-aafb-488de9fc6e23-kube-api-access-lg6w7\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-kubernetes\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-run\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.657960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d28e805-9c72-4e28-a04b-cf4563552c00-agent-certs\") pod \"konnectivity-agent-ckzzg\" (UID: \"5d28e805-9c72-4e28-a04b-cf4563552c00\") " pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfpc\" (UniqueName: \"kubernetes.io/projected/7c784640-fa8b-467e-8a78-8c0fff9d85b2-kube-api-access-dtfpc\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-multus-certs\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysconfig\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-host\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338ae3af-7cf2-41da-86c9-d28d710a36a0-tmp-dir\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-netns\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.658668 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.658168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-hostroot\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.690485 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.690453 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:23:48 +0000 UTC" deadline="2028-03-13 03:59:29.616106196 +0000 UTC" May 26 15:28:49.690485 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.690481 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15756h30m39.925628578s" May 26 15:28:49.746467 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.746447 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 15:28:49.758911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.758890 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-socket-dir-parent\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759018 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.758924 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-cni-bin\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759018 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.758957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqz5d\" (UniqueName: \"kubernetes.io/projected/a56be5ad-651f-412a-a2de-d0b9818b17d9-kube-api-access-cqz5d\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.759018 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.758986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.759178 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-socket-dir-parent\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759178 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759021 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.759178 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759068 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-cni-bin\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759178 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759081 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-daemon-config\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759178 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-socket-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759409 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759240 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-device-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759409 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-device-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759409 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759327 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-socket-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759409 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759333 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-modprobe-d\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.759409 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759450 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-modprobe-d\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759475 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-system-cni-dir\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759499 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-cni-multus\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759520 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9692l\" (UniqueName: \"kubernetes.io/projected/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-kube-api-access-9692l\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759535 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-registration-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lg6w7\" (UniqueName: \"kubernetes.io/projected/34cc8901-133f-4094-aafb-488de9fc6e23-kube-api-access-lg6w7\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759585 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-kubernetes\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-run\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-systemd-units\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759668 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-daemon-config\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.759705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759694 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-ovnkube-script-lib\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-kubernetes\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759726 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d28e805-9c72-4e28-a04b-cf4563552c00-agent-certs\") pod \"konnectivity-agent-ckzzg\" (UID: \"5d28e805-9c72-4e28-a04b-cf4563552c00\") " pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-registration-dir\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-run\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759755 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfpc\" (UniqueName: \"kubernetes.io/projected/7c784640-fa8b-467e-8a78-8c0fff9d85b2-kube-api-access-dtfpc\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-cni-multus\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759784 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-multus-certs\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759817 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysconfig\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759825 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-multus-certs\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759836 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-host\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-system-cni-dir\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-host\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.759964 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338ae3af-7cf2-41da-86c9-d28d710a36a0-tmp-dir\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysconfig\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760123 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-netns\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760161 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-hostroot\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.760413 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-netns\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760190 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-systemd\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-hostroot\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760246 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-tuned\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760258 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56be5ad-651f-412a-a2de-d0b9818b17d9-host-slash\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338ae3af-7cf2-41da-86c9-d28d710a36a0-tmp-dir\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/130c0d15-25e2-488e-9609-02abf35e90a1-ovn-node-metrics-cert\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760353 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-cnibin\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760379 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-cni-binary-copy\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-systemd\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/338ae3af-7cf2-41da-86c9-d28d710a36a0-hosts-file\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760474 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-cnibin\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760402 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/338ae3af-7cf2-41da-86c9-d28d710a36a0-hosts-file\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760596 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-cnibin\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760623 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-var-lib-kubelet\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760648 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78bpj\" (UniqueName: \"kubernetes.io/projected/d498e202-7f95-4b83-aef8-acd8fe75ce8f-kube-api-access-78bpj\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-slash\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.761167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-ovn\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-os-release\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760755 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-system-cni-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97a19529-425a-47ca-b36d-b2977ddda8d2-cni-binary-copy\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760801 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-kubelet\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760824 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34cc8901-133f-4094-aafb-488de9fc6e23-host\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760832 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-cnibin\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-var-lib-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7e3906a-321e-467e-a2ff-cd54925e5c64-cni-binary-copy\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-node-log\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-os-release\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-var-lib-kubelet\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-log-socket\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760976 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-var-lib-kubelet\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.760996 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-cni-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-system-cni-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.761987 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761020 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-etc-selinux\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-cni-netd\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-env-overrides\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761100 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d28e805-9c72-4e28-a04b-cf4563552c00-konnectivity-ca\") pod \"konnectivity-agent-ckzzg\" (UID: \"5d28e805-9c72-4e28-a04b-cf4563552c00\") " pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761127 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7kr\" (UniqueName: \"kubernetes.io/projected/338ae3af-7cf2-41da-86c9-d28d710a36a0-kube-api-access-6r7kr\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761154 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrwjs\" (UniqueName: \"kubernetes.io/projected/97a19529-425a-47ca-b36d-b2977ddda8d2-kube-api-access-xrwjs\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761178 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34cc8901-133f-4094-aafb-488de9fc6e23-serviceca\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-cni-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761268 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-sys\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-systemd\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761319 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-conf-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-run-netns\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-cni-bin\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761398 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761439 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-os-release\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761508 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-k8s-cni-cncf-io\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761534 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysctl-d\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.762760 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-etc-selinux\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761559 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-lib-modules\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34cc8901-133f-4094-aafb-488de9fc6e23-serviceca\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysctl-conf\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-kubelet\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-multus-conf-dir\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-etc-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34cc8901-133f-4094-aafb-488de9fc6e23-host\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761695 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs7wb\" (UniqueName: \"kubernetes.io/projected/b7e3906a-321e-467e-a2ff-cd54925e5c64-kube-api-access-vs7wb\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-etc-kubernetes\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761805 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-sys-fs\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761833 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d498e202-7f95-4b83-aef8-acd8fe75ce8f-tmp\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a56be5ad-651f-412a-a2de-d0b9818b17d9-iptables-alerter-script\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-ovnkube-config\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7e3906a-321e-467e-a2ff-cd54925e5c64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.761475 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97a19529-425a-47ca-b36d-b2977ddda8d2-cni-binary-copy\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.763524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xcz\" (UniqueName: \"kubernetes.io/projected/130c0d15-25e2-488e-9609-02abf35e90a1-kube-api-access-r8xcz\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762048 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-host-run-k8s-cni-cncf-io\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysctl-d\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-os-release\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a19529-425a-47ca-b36d-b2977ddda8d2-etc-kubernetes\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.762266 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-sys-fs\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-lib-modules\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.762372 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:50.262307548 +0000 UTC m=+2.996963206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-sys\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762509 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-sysctl-conf\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.762648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d28e805-9c72-4e28-a04b-cf4563552c00-konnectivity-ca\") pod \"konnectivity-agent-ckzzg\" (UID: \"5d28e805-9c72-4e28-a04b-cf4563552c00\") " pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.764270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.763642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d498e202-7f95-4b83-aef8-acd8fe75ce8f-etc-tuned\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.764831 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.764312 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d28e805-9c72-4e28-a04b-cf4563552c00-agent-certs\") pod \"konnectivity-agent-ckzzg\" (UID: \"5d28e805-9c72-4e28-a04b-cf4563552c00\") " pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.765710 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.765691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d498e202-7f95-4b83-aef8-acd8fe75ce8f-tmp\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.767308 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.767264 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:28:49.767308 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.767294 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:28:49.767308 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.767310 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:49.767569 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:49.767369 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:50.26735184 +0000 UTC m=+3.002007491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:49.768779 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.768756 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9692l\" (UniqueName: \"kubernetes.io/projected/e4ebfb9e-8411-4388-8b63-abd1a86b0b7c-kube-api-access-9692l\") pod \"aws-ebs-csi-driver-node-d48ss\" (UID: \"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.769037 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.769017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg6w7\" (UniqueName: \"kubernetes.io/projected/34cc8901-133f-4094-aafb-488de9fc6e23-kube-api-access-lg6w7\") pod \"node-ca-k9v4q\" (UID: \"34cc8901-133f-4094-aafb-488de9fc6e23\") " pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.769240 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.769219 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfpc\" (UniqueName: \"kubernetes.io/projected/7c784640-fa8b-467e-8a78-8c0fff9d85b2-kube-api-access-dtfpc\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:49.770163 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.770119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bpj\" (UniqueName: \"kubernetes.io/projected/d498e202-7f95-4b83-aef8-acd8fe75ce8f-kube-api-access-78bpj\") pod \"tuned-t67fg\" (UID: \"d498e202-7f95-4b83-aef8-acd8fe75ce8f\") " pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.775234 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.775187 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" event={"ID":"8ceab921fea60be7cba7c46ee01dff98","Type":"ContainerStarted","Data":"7948150cb1fa86038eec70e6ef2c8db030925d6e4f5e691c59936675a59cbe18"} May 26 15:28:49.776256 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.776232 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" event={"ID":"3f0de9b4d9b5f4cc43fcd9aec93b8726","Type":"ContainerStarted","Data":"55637ea69b2ee934e1be8b8d652133cb76545e70ab4c3a414e966ae1575ca7af"} May 26 15:28:49.776472 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.776450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r7kr\" (UniqueName: \"kubernetes.io/projected/338ae3af-7cf2-41da-86c9-d28d710a36a0-kube-api-access-6r7kr\") pod \"node-resolver-4wm7q\" (UID: \"338ae3af-7cf2-41da-86c9-d28d710a36a0\") " pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.776779 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.776757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs7wb\" (UniqueName: \"kubernetes.io/projected/b7e3906a-321e-467e-a2ff-cd54925e5c64-kube-api-access-vs7wb\") pod \"multus-additional-cni-plugins-trlsj\" (UID: \"b7e3906a-321e-467e-a2ff-cd54925e5c64\") " pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.776851 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.776766 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrwjs\" (UniqueName: \"kubernetes.io/projected/97a19529-425a-47ca-b36d-b2977ddda8d2-kube-api-access-xrwjs\") pod \"multus-nlb2d\" (UID: \"97a19529-425a-47ca-b36d-b2977ddda8d2\") " pod="openshift-multus/multus-nlb2d" May 26 15:28:49.823284 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.823208 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:28:49.862975 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.862937 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-systemd-units\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.862975 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.862986 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-ovnkube-script-lib\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863029 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56be5ad-651f-412a-a2de-d0b9818b17d9-host-slash\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863053 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/130c0d15-25e2-488e-9609-02abf35e90a1-ovn-node-metrics-cert\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863062 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-systemd-units\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863066 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863080 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-slash\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-slash\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a56be5ad-651f-412a-a2de-d0b9818b17d9-host-slash\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863134 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-ovn\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863168 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-ovn\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863176 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-var-lib-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863203 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-node-log\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-log-socket\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-var-lib-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-log-socket\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863282 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-cni-netd\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863306 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-env-overrides\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863302 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-node-log\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-cni-netd\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863334 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-systemd\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-systemd\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863371 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-run-netns\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863403 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-cni-bin\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863451 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-cni-bin\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-run-netns\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863465 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863492 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-kubelet\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-etc-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863546 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a56be5ad-651f-412a-a2de-d0b9818b17d9-iptables-alerter-script\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.863864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-kubelet\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-run-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863571 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-ovnkube-config\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-etc-openvswitch\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863613 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xcz\" (UniqueName: \"kubernetes.io/projected/130c0d15-25e2-488e-9609-02abf35e90a1-kube-api-access-r8xcz\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863640 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqz5d\" (UniqueName: \"kubernetes.io/projected/a56be5ad-651f-412a-a2de-d0b9818b17d9-kube-api-access-cqz5d\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863729 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-ovnkube-script-lib\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-env-overrides\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.863847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/130c0d15-25e2-488e-9609-02abf35e90a1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.864033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/130c0d15-25e2-488e-9609-02abf35e90a1-ovnkube-config\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.864595 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.864060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a56be5ad-651f-412a-a2de-d0b9818b17d9-iptables-alerter-script\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.865878 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.865851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/130c0d15-25e2-488e-9609-02abf35e90a1-ovn-node-metrics-cert\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.871102 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.871082 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqz5d\" (UniqueName: \"kubernetes.io/projected/a56be5ad-651f-412a-a2de-d0b9818b17d9-kube-api-access-cqz5d\") pod \"iptables-alerter-94vxk\" (UID: \"a56be5ad-651f-412a-a2de-d0b9818b17d9\") " pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:49.871208 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.871124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xcz\" (UniqueName: \"kubernetes.io/projected/130c0d15-25e2-488e-9609-02abf35e90a1-kube-api-access-r8xcz\") pod \"ovnkube-node-kpxlw\" (UID: \"130c0d15-25e2-488e-9609-02abf35e90a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:49.943095 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.943046 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t67fg" May 26 15:28:49.951167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.951141 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wm7q" May 26 15:28:49.960829 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.960804 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-trlsj" May 26 15:28:49.966292 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.966273 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlb2d" May 26 15:28:49.971864 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.971841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckzzg" May 26 15:28:49.979460 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.979439 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" May 26 15:28:49.987017 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.986999 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9v4q" May 26 15:28:49.993491 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:49.993473 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-94vxk" May 26 15:28:50.000027 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.000010 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:28:50.265720 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.265624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:50.265871 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.265788 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:50.265871 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.265862 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:51.265839064 +0000 UTC m=+4.000494699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:50.366967 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.366931 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:50.367103 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.367049 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:28:50.367103 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.367063 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:28:50.367103 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.367072 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:50.367199 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.367120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:51.367108633 +0000 UTC m=+4.101764282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:50.589934 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.589890 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130c0d15_25e2_488e_9609_02abf35e90a1.slice/crio-a3778c207b613864b0954ad0ff9ac65efa0263e8fce5289c46165c1d06eb3c0b WatchSource:0}: Error finding container a3778c207b613864b0954ad0ff9ac65efa0263e8fce5289c46165c1d06eb3c0b: Status 404 returned error can't find the container with id a3778c207b613864b0954ad0ff9ac65efa0263e8fce5289c46165c1d06eb3c0b May 26 15:28:50.591115 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.591082 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cc8901_133f_4094_aafb_488de9fc6e23.slice/crio-1a80e72988329fbda8f50f2150b39a664c0db0541fd4d9df9595b9502d6f73de WatchSource:0}: Error finding container 1a80e72988329fbda8f50f2150b39a664c0db0541fd4d9df9595b9502d6f73de: Status 404 returned error can't find the container with id 1a80e72988329fbda8f50f2150b39a664c0db0541fd4d9df9595b9502d6f73de May 26 15:28:50.595238 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.595218 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56be5ad_651f_412a_a2de_d0b9818b17d9.slice/crio-a3905dec2c67a043970e0c75199c4be1e8b41ed1fecf1011dc50395bbc314eb9 WatchSource:0}: Error finding container a3905dec2c67a043970e0c75199c4be1e8b41ed1fecf1011dc50395bbc314eb9: Status 404 returned error can't find the container with id a3905dec2c67a043970e0c75199c4be1e8b41ed1fecf1011dc50395bbc314eb9 May 26 15:28:50.595932 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.595908 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d28e805_9c72_4e28_a04b_cf4563552c00.slice/crio-17c227fda4d31e004080e14e1ee10444dae37a254769f6e2e0b8e838f5d9a683 WatchSource:0}: Error finding container 17c227fda4d31e004080e14e1ee10444dae37a254769f6e2e0b8e838f5d9a683: Status 404 returned error can't find the container with id 17c227fda4d31e004080e14e1ee10444dae37a254769f6e2e0b8e838f5d9a683 May 26 15:28:50.596630 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.596598 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ebfb9e_8411_4388_8b63_abd1a86b0b7c.slice/crio-aa0ba1d3b1bdb9d3d054ed2febfd7100d7d0d7b998bbcfed81600c4cb36d3d5b WatchSource:0}: Error finding container aa0ba1d3b1bdb9d3d054ed2febfd7100d7d0d7b998bbcfed81600c4cb36d3d5b: Status 404 returned error can't find the container with id aa0ba1d3b1bdb9d3d054ed2febfd7100d7d0d7b998bbcfed81600c4cb36d3d5b May 26 15:28:50.597399 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.597379 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e3906a_321e_467e_a2ff_cd54925e5c64.slice/crio-596da615c4a3e59c835d34546fc1da093a829e6df9a7c09507bff7dd1a8b10c8 WatchSource:0}: Error finding container 596da615c4a3e59c835d34546fc1da093a829e6df9a7c09507bff7dd1a8b10c8: Status 404 returned error can't find the container with id 596da615c4a3e59c835d34546fc1da093a829e6df9a7c09507bff7dd1a8b10c8 May 26 15:28:50.598156 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.598025 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a19529_425a_47ca_b36d_b2977ddda8d2.slice/crio-e78a8147cb13ec0a3ad42c88536581b45af18598d0237ed7a0e3c48636c74d83 WatchSource:0}: Error finding container e78a8147cb13ec0a3ad42c88536581b45af18598d0237ed7a0e3c48636c74d83: Status 404 returned error can't find the container with id e78a8147cb13ec0a3ad42c88536581b45af18598d0237ed7a0e3c48636c74d83 May 26 15:28:50.599628 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.599211 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd498e202_7f95_4b83_aef8_acd8fe75ce8f.slice/crio-749a976d7ff79151a34d8eb3149d0d8d5aeaaba37c2c8f0e4b691754dd7dd5f2 WatchSource:0}: Error finding container 749a976d7ff79151a34d8eb3149d0d8d5aeaaba37c2c8f0e4b691754dd7dd5f2: Status 404 returned error can't find the container with id 749a976d7ff79151a34d8eb3149d0d8d5aeaaba37c2c8f0e4b691754dd7dd5f2 May 26 15:28:50.600625 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:28:50.600576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338ae3af_7cf2_41da_86c9_d28d710a36a0.slice/crio-70d6fef45596ca0635568e056512e904a0e1f193bc6d5b13e2636e17d15d029a WatchSource:0}: Error finding container 70d6fef45596ca0635568e056512e904a0e1f193bc6d5b13e2636e17d15d029a: Status 404 returned error can't find the container with id 70d6fef45596ca0635568e056512e904a0e1f193bc6d5b13e2636e17d15d029a May 26 15:28:50.691197 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.691060 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:23:48 +0000 UTC" deadline="2028-03-06 04:36:52.08184626 +0000 UTC" May 26 15:28:50.691197 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.691197 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15589h8m1.390653006s" May 26 15:28:50.771746 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.771725 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:50.771885 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:50.771830 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:28:50.778909 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.778883 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wm7q" event={"ID":"338ae3af-7cf2-41da-86c9-d28d710a36a0","Type":"ContainerStarted","Data":"70d6fef45596ca0635568e056512e904a0e1f193bc6d5b13e2636e17d15d029a"} May 26 15:28:50.779871 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.779847 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-94vxk" event={"ID":"a56be5ad-651f-412a-a2de-d0b9818b17d9","Type":"ContainerStarted","Data":"a3905dec2c67a043970e0c75199c4be1e8b41ed1fecf1011dc50395bbc314eb9"} May 26 15:28:50.780947 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.780920 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"a3778c207b613864b0954ad0ff9ac65efa0263e8fce5289c46165c1d06eb3c0b"} May 26 15:28:50.782395 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.782368 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" event={"ID":"3f0de9b4d9b5f4cc43fcd9aec93b8726","Type":"ContainerStarted","Data":"73abea341bff2ca796fe0eae3e2028cad2752b1d01ae2a16c84bfe70762512e5"} May 26 15:28:50.783438 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.783402 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t67fg" event={"ID":"d498e202-7f95-4b83-aef8-acd8fe75ce8f","Type":"ContainerStarted","Data":"749a976d7ff79151a34d8eb3149d0d8d5aeaaba37c2c8f0e4b691754dd7dd5f2"} May 26 15:28:50.784357 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.784339 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlb2d" event={"ID":"97a19529-425a-47ca-b36d-b2977ddda8d2","Type":"ContainerStarted","Data":"e78a8147cb13ec0a3ad42c88536581b45af18598d0237ed7a0e3c48636c74d83"} May 26 15:28:50.785528 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.785507 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" event={"ID":"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c","Type":"ContainerStarted","Data":"aa0ba1d3b1bdb9d3d054ed2febfd7100d7d0d7b998bbcfed81600c4cb36d3d5b"} May 26 15:28:50.786686 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.786668 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckzzg" event={"ID":"5d28e805-9c72-4e28-a04b-cf4563552c00","Type":"ContainerStarted","Data":"17c227fda4d31e004080e14e1ee10444dae37a254769f6e2e0b8e838f5d9a683"} May 26 15:28:50.787699 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.787666 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerStarted","Data":"596da615c4a3e59c835d34546fc1da093a829e6df9a7c09507bff7dd1a8b10c8"} May 26 15:28:50.788506 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:50.788488 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9v4q" event={"ID":"34cc8901-133f-4094-aafb-488de9fc6e23","Type":"ContainerStarted","Data":"1a80e72988329fbda8f50f2150b39a664c0db0541fd4d9df9595b9502d6f73de"} May 26 15:28:51.275179 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:51.275095 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:51.275334 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.275264 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:51.275334 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.275332 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:53.275312999 +0000 UTC m=+6.009968635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:51.375899 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:51.375864 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:51.376092 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.376046 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:28:51.376092 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.376071 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:28:51.376092 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.376083 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:51.376265 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.376139 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:53.37612126 +0000 UTC m=+6.110776921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:51.781924 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:51.781431 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:51.781924 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:51.781560 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:28:51.811446 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:51.810608 2559 generic.go:358] "Generic (PLEG): container finished" podID="8ceab921fea60be7cba7c46ee01dff98" containerID="e15e03f6bb27528f3a9b72e0df51821b23db22810fb749ea6a33d58193a3cc25" exitCode=0 May 26 15:28:51.811690 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:51.811633 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" event={"ID":"8ceab921fea60be7cba7c46ee01dff98","Type":"ContainerDied","Data":"e15e03f6bb27528f3a9b72e0df51821b23db22810fb749ea6a33d58193a3cc25"} May 26 15:28:51.826161 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:51.826101 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-138.ec2.internal" podStartSLOduration=3.826080078 podStartE2EDuration="3.826080078s" podCreationTimestamp="2026-05-26 15:28:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:28:50.795991581 +0000 UTC m=+3.530647233" watchObservedRunningTime="2026-05-26 15:28:51.826080078 +0000 UTC m=+4.560735740" May 26 15:28:52.771451 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:52.771402 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:52.771651 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:52.771564 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:28:52.824186 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:52.823552 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" event={"ID":"8ceab921fea60be7cba7c46ee01dff98","Type":"ContainerStarted","Data":"617156994d9b01997e83e302d170a7b65ec5ab954540919e6067b840a0c12189"} May 26 15:28:53.289691 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:53.289653 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:53.289876 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.289824 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:53.289940 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.289885 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:57.289866819 +0000 UTC m=+10.024522472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:53.390985 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:53.390950 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:53.391159 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.391143 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:28:53.391216 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.391167 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:28:53.391216 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.391180 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:53.391335 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.391242 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:28:57.39122326 +0000 UTC m=+10.125878915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:53.771887 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:53.771806 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:53.772044 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:53.771946 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:28:54.772210 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:54.771716 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:54.772210 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:54.771858 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:28:55.771887 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:55.771856 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:55.772049 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:55.771978 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:28:56.771638 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:56.771601 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:56.772127 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:56.771753 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:28:57.319731 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:57.319692 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:57.320068 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.319822 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:57.320068 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.319882 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:05.319862963 +0000 UTC m=+18.054518616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:28:57.420988 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:57.420948 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:57.423785 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.422210 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:28:57.424785 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.422237 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:28:57.424924 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.424792 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:57.425131 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.425111 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:05.425087492 +0000 UTC m=+18.159743141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:28:57.772254 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:57.772181 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:57.772712 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:57.772295 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:28:58.771877 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:58.771842 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:28:58.772041 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:58.772003 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:28:59.771967 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:28:59.771822 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:28:59.771967 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:28:59.771959 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:00.772214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:00.772180 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:00.772699 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:00.772300 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:01.771807 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:01.771771 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:01.771979 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:01.771892 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:02.771538 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:02.771502 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:02.771928 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:02.771653 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:03.772019 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:03.771983 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:03.772457 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:03.772116 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:04.772073 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:04.772039 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:04.772491 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:04.772159 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:05.382289 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:05.382251 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:05.382473 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.382435 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:29:05.382529 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.382517 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:21.382493988 +0000 UTC m=+34.117149636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:29:05.482749 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:05.482715 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:05.482912 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.482849 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:29:05.482912 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.482864 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:29:05.482912 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.482874 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:29:05.483032 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.482922 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:21.48290903 +0000 UTC m=+34.217564666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:29:05.774104 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:05.774033 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:05.774533 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:05.774146 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:06.772260 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:06.772229 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:06.772437 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:06.772338 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:07.772176 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:07.772141 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:07.772645 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:07.772242 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:08.771846 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.771555 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:08.771991 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:08.771954 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:08.850750 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.850676 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"0c0e102bc248686dd71f3d603cdbfbbf8060822e9645bdc6ba618c7e031859be"} May 26 15:29:08.850750 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.850716 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"43af1728e156accefd3ace39286771aebcec686ed8e8fdc696a0a11d43a2a54a"} May 26 15:29:08.850750 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.850731 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"86eabfe1786762d21bbc13966f811a533eb6b65c235d51b99859e7aa38596a19"} May 26 15:29:08.850750 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.850746 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"d001170c7d0ab683ee7f380f306e82a1f7c75d8f6d07f7d0eff4020b22b5f029"} May 26 15:29:08.851545 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.850757 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"e2cf9276901c6ccaab24947e585cfc8214d5f695a7df1e07994fccd637c3b673"} May 26 15:29:08.851545 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.850766 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"2c9bf1f4cafa40735dab2ccaec3ba881760df2162be608d354764dd642da06fb"} May 26 15:29:08.851784 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.851761 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t67fg" event={"ID":"d498e202-7f95-4b83-aef8-acd8fe75ce8f","Type":"ContainerStarted","Data":"7d9f357cbf0cdda14c236d284db9d6e7bc2936b8cd416f9bad30f6ac6aa0aca7"} May 26 15:29:08.852951 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.852933 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlb2d" event={"ID":"97a19529-425a-47ca-b36d-b2977ddda8d2","Type":"ContainerStarted","Data":"88f8cd2cedeb52c92d0b0bf4060cf29462868c94ab8b83c821bdfdb0e21c1a41"} May 26 15:29:08.854059 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.854041 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" event={"ID":"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c","Type":"ContainerStarted","Data":"55f6ef30e63c5cc9d5a2122edde909370afac5a4965dfa73457dd8f97c9b7ec2"} May 26 15:29:08.855104 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.855083 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckzzg" event={"ID":"5d28e805-9c72-4e28-a04b-cf4563552c00","Type":"ContainerStarted","Data":"abc981e27c41a4fe87d1e2b4858fc96527d4ea4d8bf26e99ff041073379b1e76"} May 26 15:29:08.856388 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.856367 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7e3906a-321e-467e-a2ff-cd54925e5c64" containerID="a479d4533c39316c63c680ec4e2e3ef6e56c0253674214a8e935ab2ae5232a31" exitCode=0 May 26 15:29:08.856486 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.856449 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerDied","Data":"a479d4533c39316c63c680ec4e2e3ef6e56c0253674214a8e935ab2ae5232a31"} May 26 15:29:08.857710 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.857691 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9v4q" event={"ID":"34cc8901-133f-4094-aafb-488de9fc6e23","Type":"ContainerStarted","Data":"0c71f35b94564e154bba26ca199d3df8584592c748142e4eb75ba892a120a9b8"} May 26 15:29:08.858924 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.858902 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wm7q" event={"ID":"338ae3af-7cf2-41da-86c9-d28d710a36a0","Type":"ContainerStarted","Data":"ed6e4e43a9a2a3cfc2e9ae0d86d7d587670c1fc4d9ae4baf15a4ff2e0b7ac62d"} May 26 15:29:08.868191 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.868158 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t67fg" podStartSLOduration=4.391076314 podStartE2EDuration="21.868149437s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.6015789 +0000 UTC m=+3.336234535" lastFinishedPulling="2026-05-26 15:29:08.078652019 +0000 UTC m=+20.813307658" observedRunningTime="2026-05-26 15:29:08.868008752 +0000 UTC m=+21.602664410" watchObservedRunningTime="2026-05-26 15:29:08.868149437 +0000 UTC m=+21.602805095" May 26 15:29:08.868589 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.868568 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-138.ec2.internal" podStartSLOduration=20.868560757 podStartE2EDuration="20.868560757s" podCreationTimestamp="2026-05-26 15:28:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:28:52.83924828 +0000 UTC m=+5.573903939" watchObservedRunningTime="2026-05-26 15:29:08.868560757 +0000 UTC m=+21.603216427" May 26 15:29:08.881316 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.881283 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4wm7q" podStartSLOduration=4.40600775 podStartE2EDuration="21.881274075s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.601813161 +0000 UTC m=+3.336468812" lastFinishedPulling="2026-05-26 15:29:08.077079495 +0000 UTC m=+20.811735137" observedRunningTime="2026-05-26 15:29:08.881158194 +0000 UTC m=+21.615813852" watchObservedRunningTime="2026-05-26 15:29:08.881274075 +0000 UTC m=+21.615929733" May 26 15:29:08.921609 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.921568 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nlb2d" podStartSLOduration=4.405909289 podStartE2EDuration="21.921558077s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.600759978 +0000 UTC m=+3.335415614" lastFinishedPulling="2026-05-26 15:29:08.116408761 +0000 UTC m=+20.851064402" observedRunningTime="2026-05-26 15:29:08.921228274 +0000 UTC m=+21.655883959" watchObservedRunningTime="2026-05-26 15:29:08.921558077 +0000 UTC m=+21.656213735" May 26 15:29:08.934675 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.934645 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ckzzg" podStartSLOduration=4.456304168 podStartE2EDuration="21.934635822s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.598112341 +0000 UTC m=+3.332767984" lastFinishedPulling="2026-05-26 15:29:08.076443989 +0000 UTC m=+20.811099638" observedRunningTime="2026-05-26 15:29:08.934457196 +0000 UTC m=+21.669112853" watchObservedRunningTime="2026-05-26 15:29:08.934635822 +0000 UTC m=+21.669291497" May 26 15:29:08.949769 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:08.949739 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k9v4q" podStartSLOduration=8.868541548 podStartE2EDuration="21.949729478s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.593397819 +0000 UTC m=+3.328053458" lastFinishedPulling="2026-05-26 15:29:03.674585748 +0000 UTC m=+16.409241388" observedRunningTime="2026-05-26 15:29:08.949222722 +0000 UTC m=+21.683878382" watchObservedRunningTime="2026-05-26 15:29:08.949729478 +0000 UTC m=+21.684385137" May 26 15:29:09.580568 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.580536 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 15:29:09.723378 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.723270 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T15:29:09.580565256Z","UUID":"f1a193c8-f5f1-4f92-91e3-8fcc870ead0e","Handler":null,"Name":"","Endpoint":""} May 26 15:29:09.725282 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.725252 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 15:29:09.725282 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.725280 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 15:29:09.774458 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.774380 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:09.774591 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:09.774496 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:09.862926 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.862881 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" event={"ID":"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c","Type":"ContainerStarted","Data":"9595ba11f15ae019d6a448eb57fd44a5fee548a92c97ad1241ac284aad805aa3"} May 26 15:29:09.864530 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.864452 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-94vxk" event={"ID":"a56be5ad-651f-412a-a2de-d0b9818b17d9","Type":"ContainerStarted","Data":"3be2902458d7c237962f654afb9971d7d4af9019ab658f55c1ceb4b7b67355d6"} May 26 15:29:09.880471 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:09.880410 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-94vxk" podStartSLOduration=5.399979331 podStartE2EDuration="22.880397987s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.597082291 +0000 UTC m=+3.331737950" lastFinishedPulling="2026-05-26 15:29:08.077500959 +0000 UTC m=+20.812156606" observedRunningTime="2026-05-26 15:29:09.87987672 +0000 UTC m=+22.614532379" watchObservedRunningTime="2026-05-26 15:29:09.880397987 +0000 UTC m=+22.615053645" May 26 15:29:10.749473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.749449 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ckzzg" May 26 15:29:10.750024 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.750007 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ckzzg" May 26 15:29:10.771908 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.771884 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:10.772016 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:10.771969 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:10.867941 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.867908 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" event={"ID":"e4ebfb9e-8411-4388-8b63-abd1a86b0b7c","Type":"ContainerStarted","Data":"650aa405b2f860d2c49ad632d6b4b7f8dd0f80089e26922cd09b47a383139fa2"} May 26 15:29:10.870581 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.870558 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"87e3d302e6a6fbf70b67e0a6608b23a2de91f24d3a2cf335f8eed964dc244d57"} May 26 15:29:10.870972 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.870947 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ckzzg" May 26 15:29:10.871381 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.871364 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ckzzg" May 26 15:29:10.886775 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:10.886737 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d48ss" podStartSLOduration=4.178389716 podStartE2EDuration="23.88672645s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.598682296 +0000 UTC m=+3.333337941" lastFinishedPulling="2026-05-26 15:29:10.30701904 +0000 UTC m=+23.041674675" observedRunningTime="2026-05-26 15:29:10.886496166 +0000 UTC m=+23.621151824" watchObservedRunningTime="2026-05-26 15:29:10.88672645 +0000 UTC m=+23.621382108" May 26 15:29:11.774184 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:11.774013 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:11.774343 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:11.774249 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:12.771295 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:12.771255 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:12.771860 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:12.771389 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:13.774408 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.774387 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:13.774911 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:13.774496 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:13.878893 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.878578 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" event={"ID":"130c0d15-25e2-488e-9609-02abf35e90a1","Type":"ContainerStarted","Data":"ee8efc0865ab9323ff2d11461a39ecdde1e82c9e4241d68ed083ca472fa7efcf"} May 26 15:29:13.878893 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.878836 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:29:13.878893 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.878857 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:29:13.894463 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.894439 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:29:13.894592 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.894526 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:29:13.909715 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:13.909676 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" podStartSLOduration=9.222968649 podStartE2EDuration="26.909664795s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.592153087 +0000 UTC m=+3.326808724" lastFinishedPulling="2026-05-26 15:29:08.278849227 +0000 UTC m=+21.013504870" observedRunningTime="2026-05-26 15:29:13.908721277 +0000 UTC m=+26.643376936" watchObservedRunningTime="2026-05-26 15:29:13.909664795 +0000 UTC m=+26.644320432" May 26 15:29:14.771722 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:14.771693 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:14.771883 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:14.771787 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:14.882351 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:14.882314 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7e3906a-321e-467e-a2ff-cd54925e5c64" containerID="36365e6a2c30a4fe326c264356396b564d72898b75e6c110a5b86aedc87b6afb" exitCode=0 May 26 15:29:14.882759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:14.882368 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerDied","Data":"36365e6a2c30a4fe326c264356396b564d72898b75e6c110a5b86aedc87b6afb"} May 26 15:29:14.882759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:14.882613 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 15:29:15.643092 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:15.642997 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9gwg9"] May 26 15:29:15.643092 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:15.643129 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:15.643463 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:15.643252 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:15.645363 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:15.645341 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r87th"] May 26 15:29:15.645498 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:15.645473 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:15.645588 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:15.645569 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:15.884248 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:15.884226 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 15:29:16.887976 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:16.887946 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7e3906a-321e-467e-a2ff-cd54925e5c64" containerID="3ad3f91666def780644669952b4bc673a0404a51b42a5f26c7b0abb0501662b8" exitCode=0 May 26 15:29:16.888238 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:16.888013 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerDied","Data":"3ad3f91666def780644669952b4bc673a0404a51b42a5f26c7b0abb0501662b8"} May 26 15:29:17.777565 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:17.777384 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:17.777714 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:17.777385 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:17.777714 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:17.777627 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:17.777714 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:17.777394 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:29:17.777831 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:17.777699 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:18.894285 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:18.894254 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7e3906a-321e-467e-a2ff-cd54925e5c64" containerID="39729fa47219bdbc26554c3cb5f1df8298a457ad98b9a66b602663448431262e" exitCode=0 May 26 15:29:18.894830 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:18.894307 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerDied","Data":"39729fa47219bdbc26554c3cb5f1df8298a457ad98b9a66b602663448431262e"} May 26 15:29:19.771940 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:19.771907 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:19.771940 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:19.771924 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:19.772182 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:19.772017 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r87th" podUID="3be7b7e9-1d71-45ba-b11d-3180a34eca24" May 26 15:29:19.772182 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:19.772156 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:29:21.053940 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.053867 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-138.ec2.internal" event="NodeReady" May 26 15:29:21.054393 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.054011 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 15:29:21.098628 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.098599 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4995x"] May 26 15:29:21.122791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.122763 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-htqpz"] May 26 15:29:21.122955 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.122927 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4995x" May 26 15:29:21.125395 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.125353 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 15:29:21.125395 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.125371 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kps4r\"" May 26 15:29:21.125651 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.125637 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 15:29:21.137330 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.137310 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4995x"] May 26 15:29:21.137406 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.137336 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-htqpz"] May 26 15:29:21.137473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.137444 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.140261 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.140240 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 15:29:21.140353 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.140328 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 15:29:21.140514 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.140495 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fm4rf\"" May 26 15:29:21.140639 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.140589 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 15:29:21.199007 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.198967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-config-volume\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.199007 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.199010 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.199208 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.199032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-tmp-dir\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.199208 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.199113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2srm\" (UniqueName: \"kubernetes.io/projected/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-kube-api-access-g2srm\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.300282 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-config-volume\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.300482 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300290 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.300482 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.300437 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:21.300580 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.300501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:29:21.800479898 +0000 UTC m=+34.535135548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:21.300580 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300530 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-tmp-dir\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.300683 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300580 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2srm\" (UniqueName: \"kubernetes.io/projected/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-kube-api-access-g2srm\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.300683 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qthhx\" (UniqueName: \"kubernetes.io/projected/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-kube-api-access-qthhx\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.300774 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.300824 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-tmp-dir\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.300947 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.300918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-config-volume\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.312841 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.312819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2srm\" (UniqueName: \"kubernetes.io/projected/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-kube-api-access-g2srm\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.401840 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.401808 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:21.401976 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.401851 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qthhx\" (UniqueName: \"kubernetes.io/projected/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-kube-api-access-qthhx\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.401976 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.401889 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.401976 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.401966 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:29:21.402134 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.401989 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:21.402134 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.402047 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:53.402026975 +0000 UTC m=+66.136682625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:29:21.402134 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.402068 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:29:21.902058882 +0000 UTC m=+34.636714524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:21.418871 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.418851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qthhx\" (UniqueName: \"kubernetes.io/projected/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-kube-api-access-qthhx\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.502660 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.502631 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:21.502809 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.502791 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:29:21.502850 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.502814 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:29:21.502850 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.502824 2559 projected.go:194] Error preparing data for projected volume kube-api-access-rgw9n for pod openshift-network-diagnostics/network-check-target-r87th: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:29:21.502912 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.502874 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n podName:3be7b7e9-1d71-45ba-b11d-3180a34eca24 nodeName:}" failed. No retries permitted until 2026-05-26 15:29:53.502856434 +0000 UTC m=+66.237512073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rgw9n" (UniqueName: "kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n") pod "network-check-target-r87th" (UID: "3be7b7e9-1d71-45ba-b11d-3180a34eca24") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:29:21.771872 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.771791 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:21.771872 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.771829 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:21.774925 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.774901 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 15:29:21.775048 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.774970 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6kkkw\"" May 26 15:29:21.775048 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.774903 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 15:29:21.775242 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.775226 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2qlwj\"" May 26 15:29:21.775684 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.775648 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 15:29:21.804767 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.804743 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:21.804872 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.804859 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:21.804926 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.804917 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:29:22.804902935 +0000 UTC m=+35.539558571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:21.905894 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:21.905860 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:21.906056 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.906009 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:21.906125 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:21.906076 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:29:22.90605737 +0000 UTC m=+35.640713025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:22.813163 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:22.813125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:22.813739 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:22.813310 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:22.813739 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:22.813403 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:29:24.813380547 +0000 UTC m=+37.548036185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:22.913776 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:22.913735 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:22.913966 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:22.913891 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:22.914031 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:22.913975 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:29:24.913957014 +0000 UTC m=+37.648612658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:24.827767 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:24.827727 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:24.828166 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:24.827886 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:24.828166 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:24.827986 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:29:28.827963139 +0000 UTC m=+41.562618778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:24.928797 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:24.928760 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:24.928939 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:24.928899 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:24.928981 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:24.928959 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:29:28.928944339 +0000 UTC m=+41.663599976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:25.908932 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:25.908897 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7e3906a-321e-467e-a2ff-cd54925e5c64" containerID="94c60a073c3eaa7109c0eec1700c44380ed1169b41d1b4aeb44602b8fe0eaa11" exitCode=0 May 26 15:29:25.908932 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:25.908935 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerDied","Data":"94c60a073c3eaa7109c0eec1700c44380ed1169b41d1b4aeb44602b8fe0eaa11"} May 26 15:29:26.913110 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:26.912927 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7e3906a-321e-467e-a2ff-cd54925e5c64" containerID="c7e5705842bffa7b0ad5f8f777e4ccaa77d619faafc599c94bb69464b0137ac6" exitCode=0 May 26 15:29:26.913110 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:26.913001 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerDied","Data":"c7e5705842bffa7b0ad5f8f777e4ccaa77d619faafc599c94bb69464b0137ac6"} May 26 15:29:27.918202 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:27.918162 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trlsj" event={"ID":"b7e3906a-321e-467e-a2ff-cd54925e5c64","Type":"ContainerStarted","Data":"092f8a5bda2dbbc084ef36d1a21b3d0396ddccb285962d87264ec40f0a12486b"} May 26 15:29:27.941249 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:27.941207 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-trlsj" podStartSLOduration=6.5212686810000005 podStartE2EDuration="40.941191325s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:28:50.600058389 +0000 UTC m=+3.334714026" lastFinishedPulling="2026-05-26 15:29:25.019981031 +0000 UTC m=+37.754636670" observedRunningTime="2026-05-26 15:29:27.939998755 +0000 UTC m=+40.674654412" watchObservedRunningTime="2026-05-26 15:29:27.941191325 +0000 UTC m=+40.675846983" May 26 15:29:28.857874 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:28.857824 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:28.858056 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:28.857979 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:28.858056 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:28.858046 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:29:36.858029489 +0000 UTC m=+49.592685125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:28.958678 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:28.958647 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:28.959026 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:28.958771 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:28.959026 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:28.958815 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:29:36.958803039 +0000 UTC m=+49.693458675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:36.912723 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:36.912668 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:36.913190 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:36.912827 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:36.913190 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:36.912892 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:29:52.912875865 +0000 UTC m=+65.647531502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:37.013452 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:37.013383 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:37.013660 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:37.013553 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:37.013660 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:37.013630 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:29:53.013610165 +0000 UTC m=+65.748265819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:47.788163 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:47.788136 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpxlw" May 26 15:29:52.916684 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:52.916636 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:29:52.917067 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:52.916755 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:29:52.917067 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:52.916814 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:30:24.916799548 +0000 UTC m=+97.651455184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:29:53.017507 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.017471 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:29:53.017694 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:53.017604 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:29:53.017694 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:53.017663 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:30:25.017648762 +0000 UTC m=+97.752304397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:29:53.419496 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.419457 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:29:53.422065 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.422045 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 15:29:53.430020 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:53.430001 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 15:29:53.430123 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:29:53.430091 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:57.430069056 +0000 UTC m=+130.164724705 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : secret "metrics-daemon-secret" not found May 26 15:29:53.519929 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.519896 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:53.522678 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.522656 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 15:29:53.532933 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.532908 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 15:29:53.543538 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.543514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgw9n\" (UniqueName: \"kubernetes.io/projected/3be7b7e9-1d71-45ba-b11d-3180a34eca24-kube-api-access-rgw9n\") pod \"network-check-target-r87th\" (UID: \"3be7b7e9-1d71-45ba-b11d-3180a34eca24\") " pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:53.594112 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.594081 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6kkkw\"" May 26 15:29:53.602508 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.602486 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:53.787696 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.787662 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r87th"] May 26 15:29:53.790767 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:29:53.790738 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be7b7e9_1d71_45ba_b11d_3180a34eca24.slice/crio-4ae1ab5aace2f1dc37c211e40b6d3deeed75c39594e08b607530528039508208 WatchSource:0}: Error finding container 4ae1ab5aace2f1dc37c211e40b6d3deeed75c39594e08b607530528039508208: Status 404 returned error can't find the container with id 4ae1ab5aace2f1dc37c211e40b6d3deeed75c39594e08b607530528039508208 May 26 15:29:53.962074 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:53.961994 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r87th" event={"ID":"3be7b7e9-1d71-45ba-b11d-3180a34eca24","Type":"ContainerStarted","Data":"4ae1ab5aace2f1dc37c211e40b6d3deeed75c39594e08b607530528039508208"} May 26 15:29:56.969506 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:56.969400 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r87th" event={"ID":"3be7b7e9-1d71-45ba-b11d-3180a34eca24","Type":"ContainerStarted","Data":"82f8c03b75a7e8644b26edd4171809b1df506ac554ec5cdf9722801f793d61f9"} May 26 15:29:56.969866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:56.969528 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:29:56.987249 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:29:56.987204 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r87th" podStartSLOduration=67.101180774 podStartE2EDuration="1m9.987192147s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:29:53.792438877 +0000 UTC m=+66.527094513" lastFinishedPulling="2026-05-26 15:29:56.678450237 +0000 UTC m=+69.413105886" observedRunningTime="2026-05-26 15:29:56.985894149 +0000 UTC m=+69.720549806" watchObservedRunningTime="2026-05-26 15:29:56.987192147 +0000 UTC m=+69.721847858" May 26 15:30:24.930617 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:24.930574 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:30:24.931202 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:24.930683 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:30:24.931202 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:24.930750 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls podName:2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d nodeName:}" failed. No retries permitted until 2026-05-26 15:31:28.930732316 +0000 UTC m=+161.665387953 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls") pod "dns-default-4995x" (UID: "2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d") : secret "dns-default-metrics-tls" not found May 26 15:30:25.031125 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:25.031094 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:30:25.031280 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:25.031215 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:30:25.031280 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:25.031268 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert podName:1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd nodeName:}" failed. No retries permitted until 2026-05-26 15:31:29.031255802 +0000 UTC m=+161.765911439 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert") pod "ingress-canary-htqpz" (UID: "1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd") : secret "canary-serving-cert" not found May 26 15:30:27.973519 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:27.973491 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r87th" May 26 15:30:45.370835 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.370802 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k"] May 26 15:30:45.373532 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.373517 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" May 26 15:30:45.377045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.377012 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 26 15:30:45.377045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.377023 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 26 15:30:45.377201 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.377127 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9wwjq\"" May 26 15:30:45.378781 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.378762 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-87rvv"] May 26 15:30:45.380582 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.380565 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.382990 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.382970 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 15:30:45.383098 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.382972 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zdzc7\"" May 26 15:30:45.383174 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.383165 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 15:30:45.383539 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.383520 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 15:30:45.383630 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.383580 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 15:30:45.387750 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.387732 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k"] May 26 15:30:45.390749 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.390731 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 15:30:45.397264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.397242 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-87rvv"] May 26 15:30:45.455430 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.455400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35346e60-32df-4804-b90d-4a557e8d1ca9-trusted-ca\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.455573 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.455446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35346e60-32df-4804-b90d-4a557e8d1ca9-config\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.455573 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.455467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35346e60-32df-4804-b90d-4a557e8d1ca9-serving-cert\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.455573 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.455546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwqk5\" (UniqueName: \"kubernetes.io/projected/35346e60-32df-4804-b90d-4a557e8d1ca9-kube-api-access-cwqk5\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.455674 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.455577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lnrh\" (UniqueName: \"kubernetes.io/projected/0a0cde1b-771d-4f1c-819b-b5a0757440f2-kube-api-access-2lnrh\") pod \"volume-data-source-validator-5cf8c89d64-99h5k\" (UID: \"0a0cde1b-771d-4f1c-819b-b5a0757440f2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" May 26 15:30:45.475319 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.475296 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c9d85dfdd-h6bbx"] May 26 15:30:45.476932 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.476918 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.479242 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.479219 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 26 15:30:45.479473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.479459 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 15:30:45.479569 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.479503 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 26 15:30:45.479569 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.479460 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 15:30:45.479730 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.479713 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 26 15:30:45.479920 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.479906 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ggrkn\"" May 26 15:30:45.480460 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.480446 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 26 15:30:45.490400 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.490377 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c9d85dfdd-h6bbx"] May 26 15:30:45.556514 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556489 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwqk5\" (UniqueName: \"kubernetes.io/projected/35346e60-32df-4804-b90d-4a557e8d1ca9-kube-api-access-cwqk5\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.556629 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556523 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lnrh\" (UniqueName: \"kubernetes.io/projected/0a0cde1b-771d-4f1c-819b-b5a0757440f2-kube-api-access-2lnrh\") pod \"volume-data-source-validator-5cf8c89d64-99h5k\" (UID: \"0a0cde1b-771d-4f1c-819b-b5a0757440f2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" May 26 15:30:45.556629 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdv5g\" (UniqueName: \"kubernetes.io/projected/41a523c4-f001-4d2e-9c1a-43a17ac173c4-kube-api-access-gdv5g\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.556757 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556738 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35346e60-32df-4804-b90d-4a557e8d1ca9-trusted-ca\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.556816 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.556816 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556806 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35346e60-32df-4804-b90d-4a557e8d1ca9-config\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.556924 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-stats-auth\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.556924 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-default-certificate\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.556924 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556899 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35346e60-32df-4804-b90d-4a557e8d1ca9-serving-cert\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.557064 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.556929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.557361 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.557343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35346e60-32df-4804-b90d-4a557e8d1ca9-config\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.557560 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.557544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35346e60-32df-4804-b90d-4a557e8d1ca9-trusted-ca\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.559216 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.559197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35346e60-32df-4804-b90d-4a557e8d1ca9-serving-cert\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.564076 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.564052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lnrh\" (UniqueName: \"kubernetes.io/projected/0a0cde1b-771d-4f1c-819b-b5a0757440f2-kube-api-access-2lnrh\") pod \"volume-data-source-validator-5cf8c89d64-99h5k\" (UID: \"0a0cde1b-771d-4f1c-819b-b5a0757440f2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" May 26 15:30:45.564616 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.564595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwqk5\" (UniqueName: \"kubernetes.io/projected/35346e60-32df-4804-b90d-4a557e8d1ca9-kube-api-access-cwqk5\") pod \"console-operator-76dff48d59-87rvv\" (UID: \"35346e60-32df-4804-b90d-4a557e8d1ca9\") " pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.657993 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.657916 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdv5g\" (UniqueName: \"kubernetes.io/projected/41a523c4-f001-4d2e-9c1a-43a17ac173c4-kube-api-access-gdv5g\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.657993 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.657986 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.658166 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.658006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-stats-auth\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.658166 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.658025 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-default-certificate\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.658166 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.658045 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.658166 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:45.658148 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 15:30:45.658352 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:45.658209 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:46.158193145 +0000 UTC m=+118.892848802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : configmap references non-existent config key: service-ca.crt May 26 15:30:45.658352 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:45.658231 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:46.158224543 +0000 UTC m=+118.892880179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : secret "router-metrics-certs-default" not found May 26 15:30:45.660301 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.660284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-stats-auth\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.660404 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.660385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-default-certificate\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.668280 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.668259 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdv5g\" (UniqueName: \"kubernetes.io/projected/41a523c4-f001-4d2e-9c1a-43a17ac173c4-kube-api-access-gdv5g\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:45.681989 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.681969 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" May 26 15:30:45.689580 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.689559 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:45.823128 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.823101 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k"] May 26 15:30:45.826038 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:30:45.826011 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0cde1b_771d_4f1c_819b_b5a0757440f2.slice/crio-ca3058819f388acd16bf413f97bed679ecd61b5e1253a4a488e46e7e582e1d04 WatchSource:0}: Error finding container ca3058819f388acd16bf413f97bed679ecd61b5e1253a4a488e46e7e582e1d04: Status 404 returned error can't find the container with id ca3058819f388acd16bf413f97bed679ecd61b5e1253a4a488e46e7e582e1d04 May 26 15:30:45.838856 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:45.838833 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-87rvv"] May 26 15:30:45.841592 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:30:45.841561 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35346e60_32df_4804_b90d_4a557e8d1ca9.slice/crio-f747c7dae667736e082a99a40f6bff15857afd532d6841bfa484dc8633bde2ef WatchSource:0}: Error finding container f747c7dae667736e082a99a40f6bff15857afd532d6841bfa484dc8633bde2ef: Status 404 returned error can't find the container with id f747c7dae667736e082a99a40f6bff15857afd532d6841bfa484dc8633bde2ef May 26 15:30:46.059896 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:46.059815 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" event={"ID":"35346e60-32df-4804-b90d-4a557e8d1ca9","Type":"ContainerStarted","Data":"f747c7dae667736e082a99a40f6bff15857afd532d6841bfa484dc8633bde2ef"} May 26 15:30:46.060736 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:46.060699 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" event={"ID":"0a0cde1b-771d-4f1c-819b-b5a0757440f2","Type":"ContainerStarted","Data":"ca3058819f388acd16bf413f97bed679ecd61b5e1253a4a488e46e7e582e1d04"} May 26 15:30:46.163071 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:46.163037 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:46.163217 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:46.163198 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 15:30:46.163282 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:46.163207 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:46.163282 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:46.163267 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:47.163247717 +0000 UTC m=+119.897903353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : secret "router-metrics-certs-default" not found May 26 15:30:46.163384 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:46.163292 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:47.163283256 +0000 UTC m=+119.897938895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : configmap references non-existent config key: service-ca.crt May 26 15:30:47.169839 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.169788 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:47.170222 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.169850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:47.170222 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:47.169961 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 15:30:47.170222 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:47.169988 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:49.169968157 +0000 UTC m=+121.904623814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : configmap references non-existent config key: service-ca.crt May 26 15:30:47.170222 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:47.170011 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:49.170001649 +0000 UTC m=+121.904657289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : secret "router-metrics-certs-default" not found May 26 15:30:47.393249 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.393222 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld"] May 26 15:30:47.395262 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.395238 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.397694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.397671 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 26 15:30:47.397820 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.397784 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 26 15:30:47.397871 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.397826 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 26 15:30:47.398517 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.398480 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 26 15:30:47.398517 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.398486 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fhn4c\"" May 26 15:30:47.405873 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.405854 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld"] May 26 15:30:47.472430 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.472342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86f18de1-2bef-41df-9529-88e4a59976dc-config\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.472430 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.472406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86f18de1-2bef-41df-9529-88e4a59976dc-serving-cert\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.472620 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.472439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b76f\" (UniqueName: \"kubernetes.io/projected/86f18de1-2bef-41df-9529-88e4a59976dc-kube-api-access-8b76f\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.573055 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.573014 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86f18de1-2bef-41df-9529-88e4a59976dc-config\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.573234 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.573099 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86f18de1-2bef-41df-9529-88e4a59976dc-serving-cert\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.573234 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.573127 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b76f\" (UniqueName: \"kubernetes.io/projected/86f18de1-2bef-41df-9529-88e4a59976dc-kube-api-access-8b76f\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.573688 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.573658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86f18de1-2bef-41df-9529-88e4a59976dc-config\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.575675 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.575648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86f18de1-2bef-41df-9529-88e4a59976dc-serving-cert\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.581804 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.581760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b76f\" (UniqueName: \"kubernetes.io/projected/86f18de1-2bef-41df-9529-88e4a59976dc-kube-api-access-8b76f\") pod \"service-ca-operator-57b5b68b8-bzmld\" (UID: \"86f18de1-2bef-41df-9529-88e4a59976dc\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:47.708814 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.708781 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fhn4c\"" May 26 15:30:47.717172 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:47.717144 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" May 26 15:30:48.038657 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.038628 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld"] May 26 15:30:48.041533 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:30:48.041509 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f18de1_2bef_41df_9529_88e4a59976dc.slice/crio-b2892e482ea99e93de71093de0955a10817d56c8aea8f9fd256b68b09970baf6 WatchSource:0}: Error finding container b2892e482ea99e93de71093de0955a10817d56c8aea8f9fd256b68b09970baf6: Status 404 returned error can't find the container with id b2892e482ea99e93de71093de0955a10817d56c8aea8f9fd256b68b09970baf6 May 26 15:30:48.066397 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.066368 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" event={"ID":"0a0cde1b-771d-4f1c-819b-b5a0757440f2","Type":"ContainerStarted","Data":"b696bcb4c994d86c1a42a0eadb45ce1560ae0ff14a98fc871b1436af7242f9ce"} May 26 15:30:48.067750 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.067731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/0.log" May 26 15:30:48.067828 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.067771 2559 generic.go:358] "Generic (PLEG): container finished" podID="35346e60-32df-4804-b90d-4a557e8d1ca9" containerID="0d9e32e305295a38e4b9f7687f5b829f6811d7e094d22101e2bfe5437ffe5520" exitCode=255 May 26 15:30:48.067879 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.067849 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" event={"ID":"35346e60-32df-4804-b90d-4a557e8d1ca9","Type":"ContainerDied","Data":"0d9e32e305295a38e4b9f7687f5b829f6811d7e094d22101e2bfe5437ffe5520"} May 26 15:30:48.067993 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.067980 2559 scope.go:117] "RemoveContainer" containerID="0d9e32e305295a38e4b9f7687f5b829f6811d7e094d22101e2bfe5437ffe5520" May 26 15:30:48.068785 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.068768 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" event={"ID":"86f18de1-2bef-41df-9529-88e4a59976dc","Type":"ContainerStarted","Data":"b2892e482ea99e93de71093de0955a10817d56c8aea8f9fd256b68b09970baf6"} May 26 15:30:48.085036 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.084999 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-99h5k" podStartSLOduration=1.632464073 podStartE2EDuration="3.0849885s" podCreationTimestamp="2026-05-26 15:30:45 +0000 UTC" firstStartedPulling="2026-05-26 15:30:45.827861245 +0000 UTC m=+118.562516881" lastFinishedPulling="2026-05-26 15:30:47.280385673 +0000 UTC m=+120.015041308" observedRunningTime="2026-05-26 15:30:48.084762294 +0000 UTC m=+120.819417953" watchObservedRunningTime="2026-05-26 15:30:48.0849885 +0000 UTC m=+120.819644224" May 26 15:30:48.486699 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.486627 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq"] May 26 15:30:48.488594 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.488579 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" May 26 15:30:48.490880 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.490859 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bvx9x\"" May 26 15:30:48.497435 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.497395 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq"] May 26 15:30:48.582230 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.582208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdth\" (UniqueName: \"kubernetes.io/projected/d39e2877-83c2-4cd1-b354-13559b6f1260-kube-api-access-xgdth\") pod \"network-check-source-7f44b6dd87-bc8sq\" (UID: \"d39e2877-83c2-4cd1-b354-13559b6f1260\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" May 26 15:30:48.683291 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.683260 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdth\" (UniqueName: \"kubernetes.io/projected/d39e2877-83c2-4cd1-b354-13559b6f1260-kube-api-access-xgdth\") pod \"network-check-source-7f44b6dd87-bc8sq\" (UID: \"d39e2877-83c2-4cd1-b354-13559b6f1260\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" May 26 15:30:48.692507 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.692485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdth\" (UniqueName: \"kubernetes.io/projected/d39e2877-83c2-4cd1-b354-13559b6f1260-kube-api-access-xgdth\") pod \"network-check-source-7f44b6dd87-bc8sq\" (UID: \"d39e2877-83c2-4cd1-b354-13559b6f1260\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" May 26 15:30:48.797257 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.797190 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" May 26 15:30:48.935501 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:48.935472 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq"] May 26 15:30:48.939741 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:30:48.939715 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39e2877_83c2_4cd1_b354_13559b6f1260.slice/crio-060e0a14da7fc7642b20640959d409a668598edcda1610440b854b634864b527 WatchSource:0}: Error finding container 060e0a14da7fc7642b20640959d409a668598edcda1610440b854b634864b527: Status 404 returned error can't find the container with id 060e0a14da7fc7642b20640959d409a668598edcda1610440b854b634864b527 May 26 15:30:49.072238 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.072211 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/1.log" May 26 15:30:49.072681 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.072663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/0.log" May 26 15:30:49.072783 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.072706 2559 generic.go:358] "Generic (PLEG): container finished" podID="35346e60-32df-4804-b90d-4a557e8d1ca9" containerID="87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547" exitCode=255 May 26 15:30:49.072835 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.072787 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" event={"ID":"35346e60-32df-4804-b90d-4a557e8d1ca9","Type":"ContainerDied","Data":"87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547"} May 26 15:30:49.072869 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.072832 2559 scope.go:117] "RemoveContainer" containerID="0d9e32e305295a38e4b9f7687f5b829f6811d7e094d22101e2bfe5437ffe5520" May 26 15:30:49.073081 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.073063 2559 scope.go:117] "RemoveContainer" containerID="87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547" May 26 15:30:49.073295 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:49.073268 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-87rvv_openshift-console-operator(35346e60-32df-4804-b90d-4a557e8d1ca9)\"" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" podUID="35346e60-32df-4804-b90d-4a557e8d1ca9" May 26 15:30:49.074643 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.074621 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" event={"ID":"d39e2877-83c2-4cd1-b354-13559b6f1260","Type":"ContainerStarted","Data":"db37167c7cf399f641ad65b157e0f0c0f09ab58da3febb18825c2f4d7154db22"} May 26 15:30:49.074749 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.074653 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" event={"ID":"d39e2877-83c2-4cd1-b354-13559b6f1260","Type":"ContainerStarted","Data":"060e0a14da7fc7642b20640959d409a668598edcda1610440b854b634864b527"} May 26 15:30:49.104233 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.104192 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-bc8sq" podStartSLOduration=1.104179202 podStartE2EDuration="1.104179202s" podCreationTimestamp="2026-05-26 15:30:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:30:49.103413723 +0000 UTC m=+121.838069392" watchObservedRunningTime="2026-05-26 15:30:49.104179202 +0000 UTC m=+121.838834859" May 26 15:30:49.188184 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.188152 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:49.188364 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:49.188344 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:53.188316073 +0000 UTC m=+125.922971716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : configmap references non-existent config key: service-ca.crt May 26 15:30:49.188482 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:49.188405 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:49.188531 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:49.188514 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 15:30:49.188591 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:49.188574 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:30:53.188557515 +0000 UTC m=+125.923213170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : secret "router-metrics-certs-default" not found May 26 15:30:50.077865 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:50.077834 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" event={"ID":"86f18de1-2bef-41df-9529-88e4a59976dc","Type":"ContainerStarted","Data":"f90df55d54ae59621d90da500cdb43f036f38e7034e2f0b2a62155f761e52442"} May 26 15:30:50.079361 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:50.079323 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/1.log" May 26 15:30:50.079870 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:50.079848 2559 scope.go:117] "RemoveContainer" containerID="87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547" May 26 15:30:50.080014 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:50.079996 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-87rvv_openshift-console-operator(35346e60-32df-4804-b90d-4a557e8d1ca9)\"" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" podUID="35346e60-32df-4804-b90d-4a557e8d1ca9" May 26 15:30:50.093496 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:50.093454 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" podStartSLOduration=1.134032569 podStartE2EDuration="3.093441209s" podCreationTimestamp="2026-05-26 15:30:47 +0000 UTC" firstStartedPulling="2026-05-26 15:30:48.043614685 +0000 UTC m=+120.778270320" lastFinishedPulling="2026-05-26 15:30:50.003023317 +0000 UTC m=+122.737678960" observedRunningTime="2026-05-26 15:30:50.092748612 +0000 UTC m=+122.827404272" watchObservedRunningTime="2026-05-26 15:30:50.093441209 +0000 UTC m=+122.828096867" May 26 15:30:52.455152 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:52.455120 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wm7q_338ae3af-7cf2-41da-86c9-d28d710a36a0/dns-node-resolver/0.log" May 26 15:30:53.217834 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.217804 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:53.218046 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.217842 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:30:53.218046 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:53.217935 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 15:30:53.218046 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:53.217969 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:31:01.217950454 +0000 UTC m=+133.952606096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : configmap references non-existent config key: service-ca.crt May 26 15:30:53.218046 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:53.217991 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:31:01.217984147 +0000 UTC m=+133.952639783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : secret "router-metrics-certs-default" not found May 26 15:30:53.655321 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.655295 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9v4q_34cc8901-133f-4094-aafb-488de9fc6e23/node-ca/0.log" May 26 15:30:53.873715 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.873681 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-gfjl9"] May 26 15:30:53.875651 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.875635 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:53.878139 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.878119 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9jnbh\"" May 26 15:30:53.878484 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.878470 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 26 15:30:53.879061 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.879039 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 26 15:30:53.879156 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.879058 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 26 15:30:53.879156 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.879105 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 26 15:30:53.888533 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:53.888510 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-gfjl9"] May 26 15:30:54.024469 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.024385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ktt\" (UniqueName: \"kubernetes.io/projected/52ccd09a-5324-4143-a123-afd518c69b05-kube-api-access-58ktt\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.024469 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.024435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/52ccd09a-5324-4143-a123-afd518c69b05-signing-cabundle\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.024617 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.024549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/52ccd09a-5324-4143-a123-afd518c69b05-signing-key\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.125797 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.125768 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58ktt\" (UniqueName: \"kubernetes.io/projected/52ccd09a-5324-4143-a123-afd518c69b05-kube-api-access-58ktt\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.125797 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.125798 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/52ccd09a-5324-4143-a123-afd518c69b05-signing-cabundle\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.125963 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.125890 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/52ccd09a-5324-4143-a123-afd518c69b05-signing-key\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.126606 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.126590 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/52ccd09a-5324-4143-a123-afd518c69b05-signing-cabundle\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.128183 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.128166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/52ccd09a-5324-4143-a123-afd518c69b05-signing-key\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.133504 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.133486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ktt\" (UniqueName: \"kubernetes.io/projected/52ccd09a-5324-4143-a123-afd518c69b05-kube-api-access-58ktt\") pod \"service-ca-67d667c7d-gfjl9\" (UID: \"52ccd09a-5324-4143-a123-afd518c69b05\") " pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.184559 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.184540 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" May 26 15:30:54.300878 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:54.300804 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-gfjl9"] May 26 15:30:54.303259 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:30:54.303233 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ccd09a_5324_4143_a123_afd518c69b05.slice/crio-4325fa62fbdb8f73060c0ed63e58a017a8512789fa0d6bd9987772efde75f7d6 WatchSource:0}: Error finding container 4325fa62fbdb8f73060c0ed63e58a017a8512789fa0d6bd9987772efde75f7d6: Status 404 returned error can't find the container with id 4325fa62fbdb8f73060c0ed63e58a017a8512789fa0d6bd9987772efde75f7d6 May 26 15:30:55.090475 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:55.090442 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" event={"ID":"52ccd09a-5324-4143-a123-afd518c69b05","Type":"ContainerStarted","Data":"1418a04f78bd566c0b887b60af52dc84fad64a38842bcdf55a1e037998d477aa"} May 26 15:30:55.090475 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:55.090478 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" event={"ID":"52ccd09a-5324-4143-a123-afd518c69b05","Type":"ContainerStarted","Data":"4325fa62fbdb8f73060c0ed63e58a017a8512789fa0d6bd9987772efde75f7d6"} May 26 15:30:55.109917 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:55.109866 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-gfjl9" podStartSLOduration=2.109848856 podStartE2EDuration="2.109848856s" podCreationTimestamp="2026-05-26 15:30:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:30:55.107981534 +0000 UTC m=+127.842637193" watchObservedRunningTime="2026-05-26 15:30:55.109848856 +0000 UTC m=+127.844504516" May 26 15:30:55.690392 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:55.690356 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:55.690587 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:55.690403 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:30:55.690886 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:55.690871 2559 scope.go:117] "RemoveContainer" containerID="87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547" May 26 15:30:55.691094 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:55.691073 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-87rvv_openshift-console-operator(35346e60-32df-4804-b90d-4a557e8d1ca9)\"" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" podUID="35346e60-32df-4804-b90d-4a557e8d1ca9" May 26 15:30:57.452583 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:30:57.452549 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:30:57.452950 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:57.452656 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 15:30:57.452950 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:30:57.452725 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs podName:7c784640-fa8b-467e-8a78-8c0fff9d85b2 nodeName:}" failed. No retries permitted until 2026-05-26 15:32:59.452708786 +0000 UTC m=+252.187364422 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs") pod "network-metrics-daemon-9gwg9" (UID: "7c784640-fa8b-467e-8a78-8c0fff9d85b2") : secret "metrics-daemon-secret" not found May 26 15:31:01.278378 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:01.278343 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:01.278873 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:01.278394 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:01.278873 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:01.278573 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle podName:41a523c4-f001-4d2e-9c1a-43a17ac173c4 nodeName:}" failed. No retries permitted until 2026-05-26 15:31:17.278548988 +0000 UTC m=+150.013204637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle") pod "router-default-5c9d85dfdd-h6bbx" (UID: "41a523c4-f001-4d2e-9c1a-43a17ac173c4") : configmap references non-existent config key: service-ca.crt May 26 15:31:01.280785 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:01.280768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41a523c4-f001-4d2e-9c1a-43a17ac173c4-metrics-certs\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:07.775168 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:07.775123 2559 scope.go:117] "RemoveContainer" containerID="87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547" May 26 15:31:08.129685 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:08.129658 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:31:08.129989 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:08.129975 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/1.log" May 26 15:31:08.130045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:08.130008 2559 generic.go:358] "Generic (PLEG): container finished" podID="35346e60-32df-4804-b90d-4a557e8d1ca9" containerID="a1db45785eacf2e6e52d67dbf90a654431ed177c7b7a876673ec912d54583b6c" exitCode=255 May 26 15:31:08.130045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:08.130039 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" event={"ID":"35346e60-32df-4804-b90d-4a557e8d1ca9","Type":"ContainerDied","Data":"a1db45785eacf2e6e52d67dbf90a654431ed177c7b7a876673ec912d54583b6c"} May 26 15:31:08.130138 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:08.130066 2559 scope.go:117] "RemoveContainer" containerID="87b129a25f1ec6803cd31dd8f94700c9a30e2739179be90df11364ae42ee0547" May 26 15:31:08.130435 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:08.130402 2559 scope.go:117] "RemoveContainer" containerID="a1db45785eacf2e6e52d67dbf90a654431ed177c7b7a876673ec912d54583b6c" May 26 15:31:08.130624 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:08.130603 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-87rvv_openshift-console-operator(35346e60-32df-4804-b90d-4a557e8d1ca9)\"" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" podUID="35346e60-32df-4804-b90d-4a557e8d1ca9" May 26 15:31:09.133934 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:09.133905 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:31:15.689913 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:15.689875 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:31:15.689913 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:15.689915 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:31:15.690383 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:15.690175 2559 scope.go:117] "RemoveContainer" containerID="a1db45785eacf2e6e52d67dbf90a654431ed177c7b7a876673ec912d54583b6c" May 26 15:31:15.690383 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:15.690323 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-87rvv_openshift-console-operator(35346e60-32df-4804-b90d-4a557e8d1ca9)\"" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" podUID="35346e60-32df-4804-b90d-4a557e8d1ca9" May 26 15:31:16.449773 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.449741 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vws6g"] May 26 15:31:16.454195 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.454175 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.457333 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.457311 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 15:31:16.457473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.457357 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 15:31:16.457473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.457386 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 15:31:16.457473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.457406 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hvxkc\"" May 26 15:31:16.457473 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.457407 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 15:31:16.462868 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.462848 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vws6g"] May 26 15:31:16.551731 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.551706 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d9b55f47f-sdmx2"] May 26 15:31:16.554653 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.554628 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.557293 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.557268 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 15:31:16.557404 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.557352 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 15:31:16.557404 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.557369 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 15:31:16.557404 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.557377 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jz28j\"" May 26 15:31:16.561791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.561771 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 15:31:16.566007 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.565988 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9b55f47f-sdmx2"] May 26 15:31:16.588271 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.588247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.588371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.588287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-crio-socket\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.588371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.588319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.588371 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.588346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4zs\" (UniqueName: \"kubernetes.io/projected/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-kube-api-access-ct4zs\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.588575 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.588378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-data-volume\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689304 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/457c5ea5-81d0-435e-aa4b-1a5125e47a11-trusted-ca\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689454 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-registry-tls\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689454 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689329 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-data-volume\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689454 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/457c5ea5-81d0-435e-aa4b-1a5125e47a11-image-registry-private-configuration\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689584 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/457c5ea5-81d0-435e-aa4b-1a5125e47a11-registry-certificates\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689584 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/457c5ea5-81d0-435e-aa4b-1a5125e47a11-installation-pull-secrets\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689584 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689542 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689584 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znq2v\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-kube-api-access-znq2v\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-bound-sa-token\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-data-volume\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689633 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/457c5ea5-81d0-435e-aa4b-1a5125e47a11-ca-trust-extracted\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.689726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689698 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-crio-socket\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689715 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4zs\" (UniqueName: \"kubernetes.io/projected/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-kube-api-access-ct4zs\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.689929 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.689792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-crio-socket\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.690822 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.690806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.691711 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.691695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.697800 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.697778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4zs\" (UniqueName: \"kubernetes.io/projected/d71a4fad-fea8-49d9-8ca7-fd389ab557a7-kube-api-access-ct4zs\") pod \"insights-runtime-extractor-vws6g\" (UID: \"d71a4fad-fea8-49d9-8ca7-fd389ab557a7\") " pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.763687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.763639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vws6g" May 26 15:31:16.790765 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790735 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znq2v\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-kube-api-access-znq2v\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.790884 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790794 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-bound-sa-token\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.790884 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790814 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/457c5ea5-81d0-435e-aa4b-1a5125e47a11-ca-trust-extracted\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.790884 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790846 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/457c5ea5-81d0-435e-aa4b-1a5125e47a11-trusted-ca\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.790884 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790871 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-registry-tls\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.791113 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790901 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/457c5ea5-81d0-435e-aa4b-1a5125e47a11-image-registry-private-configuration\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.791113 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790930 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/457c5ea5-81d0-435e-aa4b-1a5125e47a11-registry-certificates\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.791113 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.790979 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/457c5ea5-81d0-435e-aa4b-1a5125e47a11-installation-pull-secrets\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.791269 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.791250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/457c5ea5-81d0-435e-aa4b-1a5125e47a11-ca-trust-extracted\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.791967 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.791936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/457c5ea5-81d0-435e-aa4b-1a5125e47a11-registry-certificates\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.792143 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.792122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/457c5ea5-81d0-435e-aa4b-1a5125e47a11-trusted-ca\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.793546 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.793527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/457c5ea5-81d0-435e-aa4b-1a5125e47a11-installation-pull-secrets\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.793641 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.793592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/457c5ea5-81d0-435e-aa4b-1a5125e47a11-image-registry-private-configuration\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.793932 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.793915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-registry-tls\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.798735 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.798694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-bound-sa-token\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.799088 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.799062 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znq2v\" (UniqueName: \"kubernetes.io/projected/457c5ea5-81d0-435e-aa4b-1a5125e47a11-kube-api-access-znq2v\") pod \"image-registry-7d9b55f47f-sdmx2\" (UID: \"457c5ea5-81d0-435e-aa4b-1a5125e47a11\") " pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.863467 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.863436 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:16.889402 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.889377 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vws6g"] May 26 15:31:16.893113 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:16.893069 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71a4fad_fea8_49d9_8ca7_fd389ab557a7.slice/crio-90a302e67c1b847fa92c0ca9c794085302b5d0444d022e9f758d073ee31bb476 WatchSource:0}: Error finding container 90a302e67c1b847fa92c0ca9c794085302b5d0444d022e9f758d073ee31bb476: Status 404 returned error can't find the container with id 90a302e67c1b847fa92c0ca9c794085302b5d0444d022e9f758d073ee31bb476 May 26 15:31:16.992866 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:16.992769 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9b55f47f-sdmx2"] May 26 15:31:16.995113 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:16.995083 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457c5ea5_81d0_435e_aa4b_1a5125e47a11.slice/crio-6ebd5cf718e0504cdd400deeb61c7022f7531edc652832b63f2d3c49e1547728 WatchSource:0}: Error finding container 6ebd5cf718e0504cdd400deeb61c7022f7531edc652832b63f2d3c49e1547728: Status 404 returned error can't find the container with id 6ebd5cf718e0504cdd400deeb61c7022f7531edc652832b63f2d3c49e1547728 May 26 15:31:17.154314 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.154282 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" event={"ID":"457c5ea5-81d0-435e-aa4b-1a5125e47a11","Type":"ContainerStarted","Data":"a88c1b849ad8ae58d552e2e408283fce7d70a96f819ff5424d0af190516cd758"} May 26 15:31:17.154314 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.154318 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" event={"ID":"457c5ea5-81d0-435e-aa4b-1a5125e47a11","Type":"ContainerStarted","Data":"6ebd5cf718e0504cdd400deeb61c7022f7531edc652832b63f2d3c49e1547728"} May 26 15:31:17.154569 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.154365 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:17.155619 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.155600 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vws6g" event={"ID":"d71a4fad-fea8-49d9-8ca7-fd389ab557a7","Type":"ContainerStarted","Data":"bdf599ce4e45c192a92ee7bec7c365423fc6809f53b44ef9535aa1f9ef4d8185"} May 26 15:31:17.155717 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.155622 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vws6g" event={"ID":"d71a4fad-fea8-49d9-8ca7-fd389ab557a7","Type":"ContainerStarted","Data":"90a302e67c1b847fa92c0ca9c794085302b5d0444d022e9f758d073ee31bb476"} May 26 15:31:17.172389 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.172354 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" podStartSLOduration=1.172343449 podStartE2EDuration="1.172343449s" podCreationTimestamp="2026-05-26 15:31:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:31:17.172084341 +0000 UTC m=+149.906740000" watchObservedRunningTime="2026-05-26 15:31:17.172343449 +0000 UTC m=+149.906999107" May 26 15:31:17.296892 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.296809 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:17.298027 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.297999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41a523c4-f001-4d2e-9c1a-43a17ac173c4-service-ca-bundle\") pod \"router-default-5c9d85dfdd-h6bbx\" (UID: \"41a523c4-f001-4d2e-9c1a-43a17ac173c4\") " pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:17.588146 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.588113 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ggrkn\"" May 26 15:31:17.596165 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.596141 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:17.730762 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:17.730737 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c9d85dfdd-h6bbx"] May 26 15:31:17.750542 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:17.750507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a523c4_f001_4d2e_9c1a_43a17ac173c4.slice/crio-a29732b147a262c061c8259405aaa9217ee63137953127a73fb092ed7c7afce9 WatchSource:0}: Error finding container a29732b147a262c061c8259405aaa9217ee63137953127a73fb092ed7c7afce9: Status 404 returned error can't find the container with id a29732b147a262c061c8259405aaa9217ee63137953127a73fb092ed7c7afce9 May 26 15:31:18.159676 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:18.159647 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vws6g" event={"ID":"d71a4fad-fea8-49d9-8ca7-fd389ab557a7","Type":"ContainerStarted","Data":"3f785ebfb5ae275a9c0ba672d06a36387a0397de565c6033f67a7e888d462172"} May 26 15:31:18.160853 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:18.160828 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" event={"ID":"41a523c4-f001-4d2e-9c1a-43a17ac173c4","Type":"ContainerStarted","Data":"f6b6f5515406200ed55f71c59e8d3d043bfe15ef1345bda369a5c3a768898245"} May 26 15:31:18.160974 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:18.160858 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" event={"ID":"41a523c4-f001-4d2e-9c1a-43a17ac173c4","Type":"ContainerStarted","Data":"a29732b147a262c061c8259405aaa9217ee63137953127a73fb092ed7c7afce9"} May 26 15:31:18.179264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:18.179224 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" podStartSLOduration=33.179212178 podStartE2EDuration="33.179212178s" podCreationTimestamp="2026-05-26 15:30:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:31:18.17779704 +0000 UTC m=+150.912452696" watchObservedRunningTime="2026-05-26 15:31:18.179212178 +0000 UTC m=+150.913867836" May 26 15:31:18.597069 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:18.597037 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:18.599568 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:18.599548 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:19.163240 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:19.163205 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:19.164651 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:19.164631 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c9d85dfdd-h6bbx" May 26 15:31:20.167451 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:20.167406 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vws6g" event={"ID":"d71a4fad-fea8-49d9-8ca7-fd389ab557a7","Type":"ContainerStarted","Data":"ac4b9270cb60fa7518c53091ccb33755100971b9d9dd3ced2cabaa12364b0897"} May 26 15:31:20.190628 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:20.190581 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vws6g" podStartSLOduration=1.6258800340000001 podStartE2EDuration="4.190568848s" podCreationTimestamp="2026-05-26 15:31:16 +0000 UTC" firstStartedPulling="2026-05-26 15:31:16.946951781 +0000 UTC m=+149.681607432" lastFinishedPulling="2026-05-26 15:31:19.511640607 +0000 UTC m=+152.246296246" observedRunningTime="2026-05-26 15:31:20.190109828 +0000 UTC m=+152.924765488" watchObservedRunningTime="2026-05-26 15:31:20.190568848 +0000 UTC m=+152.925224505" May 26 15:31:23.645756 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.645725 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7"] May 26 15:31:23.650526 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.650504 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.652971 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.652949 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 15:31:23.653126 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.653103 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-58wr2\"" May 26 15:31:23.653189 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.652960 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 15:31:23.653847 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.653830 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 15:31:23.653973 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.653952 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 15:31:23.653973 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.653851 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 15:31:23.657777 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.657756 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7"] May 26 15:31:23.747567 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.747536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d65a96-cdf4-488d-9562-9673eca29397-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.747717 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.747578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.747717 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.747636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.747717 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.747654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77tm\" (UniqueName: \"kubernetes.io/projected/71d65a96-cdf4-488d-9562-9673eca29397-kube-api-access-d77tm\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.848639 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.848607 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.848818 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.848651 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.848818 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.848672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d77tm\" (UniqueName: \"kubernetes.io/projected/71d65a96-cdf4-488d-9562-9673eca29397-kube-api-access-d77tm\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.848818 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:23.848771 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 26 15:31:23.848818 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.848785 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d65a96-cdf4-488d-9562-9673eca29397-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.849013 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:23.848838 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-tls podName:71d65a96-cdf4-488d-9562-9673eca29397 nodeName:}" failed. No retries permitted until 2026-05-26 15:31:24.348818747 +0000 UTC m=+157.083474400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-vdfq7" (UID: "71d65a96-cdf4-488d-9562-9673eca29397") : secret "prometheus-operator-tls" not found May 26 15:31:23.849415 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.849396 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d65a96-cdf4-488d-9562-9673eca29397-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.850977 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.850954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:23.857367 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:23.857342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77tm\" (UniqueName: \"kubernetes.io/projected/71d65a96-cdf4-488d-9562-9673eca29397-kube-api-access-d77tm\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:24.134497 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:24.134439 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4995x" podUID="2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d" May 26 15:31:24.146581 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:24.146546 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-htqpz" podUID="1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd" May 26 15:31:24.178771 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:24.178747 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4995x" May 26 15:31:24.350675 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:24.350645 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:24.353042 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:24.353017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71d65a96-cdf4-488d-9562-9673eca29397-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-vdfq7\" (UID: \"71d65a96-cdf4-488d-9562-9673eca29397\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:24.560823 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:24.560797 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" May 26 15:31:24.674729 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:24.674694 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7"] May 26 15:31:24.677678 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:24.677645 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d65a96_cdf4_488d_9562_9673eca29397.slice/crio-affac09fc44559d2af5eb55b353f1d0f7e670d1f12e49b0f65f542ac53ad5075 WatchSource:0}: Error finding container affac09fc44559d2af5eb55b353f1d0f7e670d1f12e49b0f65f542ac53ad5075: Status 404 returned error can't find the container with id affac09fc44559d2af5eb55b353f1d0f7e670d1f12e49b0f65f542ac53ad5075 May 26 15:31:24.784844 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:24.784810 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9gwg9" podUID="7c784640-fa8b-467e-8a78-8c0fff9d85b2" May 26 15:31:25.182216 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:25.182179 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" event={"ID":"71d65a96-cdf4-488d-9562-9673eca29397","Type":"ContainerStarted","Data":"affac09fc44559d2af5eb55b353f1d0f7e670d1f12e49b0f65f542ac53ad5075"} May 26 15:31:27.189015 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:27.188979 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" event={"ID":"71d65a96-cdf4-488d-9562-9673eca29397","Type":"ContainerStarted","Data":"16058d8672c676a2d94cf3ec8b4c48b2167054e021071ef0227f5f759bb4d089"} May 26 15:31:27.189015 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:27.189018 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" event={"ID":"71d65a96-cdf4-488d-9562-9673eca29397","Type":"ContainerStarted","Data":"3a3f5923db0e83dd9b52518ebdb18fdf35f4763296b6af2b06a0acdd3562ae94"} May 26 15:31:27.205526 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:27.205481 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-vdfq7" podStartSLOduration=2.675759157 podStartE2EDuration="4.205467083s" podCreationTimestamp="2026-05-26 15:31:23 +0000 UTC" firstStartedPulling="2026-05-26 15:31:24.67937657 +0000 UTC m=+157.414032205" lastFinishedPulling="2026-05-26 15:31:26.209084279 +0000 UTC m=+158.943740131" observedRunningTime="2026-05-26 15:31:27.205181296 +0000 UTC m=+159.939836955" watchObservedRunningTime="2026-05-26 15:31:27.205467083 +0000 UTC m=+159.940122741" May 26 15:31:28.977510 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:28.977474 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:31:28.980269 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:28.980240 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d-metrics-tls\") pod \"dns-default-4995x\" (UID: \"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d\") " pod="openshift-dns/dns-default-4995x" May 26 15:31:29.003311 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.003289 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l2xhg"] May 26 15:31:29.006579 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.006559 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.008901 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.008882 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 15:31:29.009022 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.009003 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2pfqt\"" May 26 15:31:29.009259 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.008897 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 15:31:29.009259 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.009224 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 15:31:29.014195 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.014171 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7"] May 26 15:31:29.017846 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.017828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.022571 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.022545 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 26 15:31:29.022571 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.022556 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 26 15:31:29.023378 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.023329 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 26 15:31:29.023526 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.023510 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r65k9\"" May 26 15:31:29.035335 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.035316 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7"] May 26 15:31:29.078274 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8jw2\" (UniqueName: \"kubernetes.io/projected/4a2f1960-3a00-46ea-82c3-84befa424350-kube-api-access-j8jw2\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078374 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-tls\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078374 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-sys\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078374 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d91b190b-d8aa-4bd6-95ab-1158bd75366e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.078374 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-root\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078574 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-wtmp\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078574 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91b190b-d8aa-4bd6-95ab-1158bd75366e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.078574 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-textfile\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078574 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8vh7\" (UniqueName: \"kubernetes.io/projected/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-api-access-w8vh7\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.078574 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.078791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.078791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a2f1960-3a00-46ea-82c3-84befa424350-metrics-client-ca\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.078791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078671 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:31:29.078791 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.078696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.080888 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.080867 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd-cert\") pod \"ingress-canary-htqpz\" (UID: \"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd\") " pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:31:29.179296 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179264 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.179459 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179308 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.179459 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a2f1960-3a00-46ea-82c3-84befa424350-metrics-client-ca\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.179459 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179371 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.179459 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8jw2\" (UniqueName: \"kubernetes.io/projected/4a2f1960-3a00-46ea-82c3-84befa424350-kube-api-access-j8jw2\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.179459 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179447 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-tls\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.179721 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179472 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-sys\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.179721 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:29.179583 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 26 15:31:29.179721 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:29.179637 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-tls podName:4a2f1960-3a00-46ea-82c3-84befa424350 nodeName:}" failed. No retries permitted until 2026-05-26 15:31:29.679618519 +0000 UTC m=+162.414274171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-tls") pod "node-exporter-l2xhg" (UID: "4a2f1960-3a00-46ea-82c3-84befa424350") : secret "node-exporter-tls" not found May 26 15:31:29.180191 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.179654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-sys\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.180126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.180197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d91b190b-d8aa-4bd6-95ab-1158bd75366e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.180914 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-root\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.180957 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-wtmp\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181008 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91b190b-d8aa-4bd6-95ab-1158bd75366e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181042 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-textfile\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d91b190b-d8aa-4bd6-95ab-1158bd75366e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181105 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8vh7\" (UniqueName: \"kubernetes.io/projected/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-api-access-w8vh7\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181145 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181219 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:29.181358 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-accelerators-collector-config\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:29.181414 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-tls podName:d91b190b-d8aa-4bd6-95ab-1158bd75366e nodeName:}" failed. No retries permitted until 2026-05-26 15:31:29.681397516 +0000 UTC m=+162.416053158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-phdw7" (UID: "d91b190b-d8aa-4bd6-95ab-1158bd75366e") : secret "kube-state-metrics-tls" not found May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.181742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-textfile\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.182468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-root\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.186444 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.182599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-wtmp\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.187283 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.182721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91b190b-d8aa-4bd6-95ab-1158bd75366e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.187283 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.186989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a2f1960-3a00-46ea-82c3-84befa424350-metrics-client-ca\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.187283 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.187091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.189789 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.189765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.191520 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.191372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8jw2\" (UniqueName: \"kubernetes.io/projected/4a2f1960-3a00-46ea-82c3-84befa424350-kube-api-access-j8jw2\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.192497 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.192472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8vh7\" (UniqueName: \"kubernetes.io/projected/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-api-access-w8vh7\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.281570 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.281509 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kps4r\"" May 26 15:31:29.289516 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.289492 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4995x" May 26 15:31:29.453533 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.453461 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4995x"] May 26 15:31:29.458036 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:29.458005 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aad4a39_bdee_4d9b_bcf1_b45b14c95d3d.slice/crio-01dce55cc1bde767c1ac27b6d06fdea1fb46439ba7278d8491b6c92e87edc951 WatchSource:0}: Error finding container 01dce55cc1bde767c1ac27b6d06fdea1fb46439ba7278d8491b6c92e87edc951: Status 404 returned error can't find the container with id 01dce55cc1bde767c1ac27b6d06fdea1fb46439ba7278d8491b6c92e87edc951 May 26 15:31:29.685054 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.685016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.685239 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.685064 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-tls\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.687383 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.687350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a2f1960-3a00-46ea-82c3-84befa424350-node-exporter-tls\") pod \"node-exporter-l2xhg\" (UID: \"4a2f1960-3a00-46ea-82c3-84befa424350\") " pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.687582 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.687562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91b190b-d8aa-4bd6-95ab-1158bd75366e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-phdw7\" (UID: \"d91b190b-d8aa-4bd6-95ab-1158bd75366e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:29.918167 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.918138 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l2xhg" May 26 15:31:29.925838 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:29.925809 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2f1960_3a00_46ea_82c3_84befa424350.slice/crio-d3e0937168554f65955cad825aefa4804072b339bfb9216b623ca1d5300b3315 WatchSource:0}: Error finding container d3e0937168554f65955cad825aefa4804072b339bfb9216b623ca1d5300b3315: Status 404 returned error can't find the container with id d3e0937168554f65955cad825aefa4804072b339bfb9216b623ca1d5300b3315 May 26 15:31:29.926948 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:29.926930 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" May 26 15:31:30.072954 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:30.072920 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7"] May 26 15:31:30.076486 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:30.076456 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91b190b_d8aa_4bd6_95ab_1158bd75366e.slice/crio-7a3910d75f2599b9b78d09fe31702c5a7916e24559f5b81a49efe552510d28fc WatchSource:0}: Error finding container 7a3910d75f2599b9b78d09fe31702c5a7916e24559f5b81a49efe552510d28fc: Status 404 returned error can't find the container with id 7a3910d75f2599b9b78d09fe31702c5a7916e24559f5b81a49efe552510d28fc May 26 15:31:30.198272 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:30.198216 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4995x" event={"ID":"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d","Type":"ContainerStarted","Data":"01dce55cc1bde767c1ac27b6d06fdea1fb46439ba7278d8491b6c92e87edc951"} May 26 15:31:30.199467 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:30.199442 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2xhg" event={"ID":"4a2f1960-3a00-46ea-82c3-84befa424350","Type":"ContainerStarted","Data":"d3e0937168554f65955cad825aefa4804072b339bfb9216b623ca1d5300b3315"} May 26 15:31:30.200601 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:30.200577 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" event={"ID":"d91b190b-d8aa-4bd6-95ab-1158bd75366e","Type":"ContainerStarted","Data":"7a3910d75f2599b9b78d09fe31702c5a7916e24559f5b81a49efe552510d28fc"} May 26 15:31:30.771653 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:30.771623 2559 scope.go:117] "RemoveContainer" containerID="a1db45785eacf2e6e52d67dbf90a654431ed177c7b7a876673ec912d54583b6c" May 26 15:31:32.208116 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.208078 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4995x" event={"ID":"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d","Type":"ContainerStarted","Data":"ec261e2536c0633be189a1ad4e75911f9baa3fd5eeec75a43ddaa2148bfd5f88"} May 26 15:31:32.208116 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.208122 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4995x" event={"ID":"2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d","Type":"ContainerStarted","Data":"6468903f70aa05c2502a8f1b3347a3dd6018e3b733d8292176263d5b9d105f5a"} May 26 15:31:32.208639 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.208199 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4995x" May 26 15:31:32.209873 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.209855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:31:32.209988 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.209928 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" event={"ID":"35346e60-32df-4804-b90d-4a557e8d1ca9","Type":"ContainerStarted","Data":"0aa21164e706c239d938d76852ded2d52388f47bd9edd07e88c882d02c6bc6d7"} May 26 15:31:32.210185 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.210153 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:31:32.211490 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.211458 2559 generic.go:358] "Generic (PLEG): container finished" podID="4a2f1960-3a00-46ea-82c3-84befa424350" containerID="e23ce857b2a8da974944a888d96611bb8be2857212da8f733b8f8cf390be125d" exitCode=0 May 26 15:31:32.211616 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.211540 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2xhg" event={"ID":"4a2f1960-3a00-46ea-82c3-84befa424350","Type":"ContainerDied","Data":"e23ce857b2a8da974944a888d96611bb8be2857212da8f733b8f8cf390be125d"} May 26 15:31:32.213658 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.213635 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" event={"ID":"d91b190b-d8aa-4bd6-95ab-1158bd75366e","Type":"ContainerStarted","Data":"17efddf5f4882cee176ebf60ebf96d9a34c6cbf08bed5b4b8e7d400199e49133"} May 26 15:31:32.213752 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.213665 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" event={"ID":"d91b190b-d8aa-4bd6-95ab-1158bd75366e","Type":"ContainerStarted","Data":"a5c1e30703eefd645c0eaaf4e0cbf6ceff79402ea309c36f144e10d4ee0123f7"} May 26 15:31:32.213752 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.213680 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" event={"ID":"d91b190b-d8aa-4bd6-95ab-1158bd75366e","Type":"ContainerStarted","Data":"723b7418612648304c73003c4d0183cd395c118bd51fed6cab68bd5f10ac54aa"} May 26 15:31:32.227435 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.227370 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4995x" podStartSLOduration=129.137955825 podStartE2EDuration="2m11.227357114s" podCreationTimestamp="2026-05-26 15:29:21 +0000 UTC" firstStartedPulling="2026-05-26 15:31:29.460229089 +0000 UTC m=+162.194884725" lastFinishedPulling="2026-05-26 15:31:31.549630363 +0000 UTC m=+164.284286014" observedRunningTime="2026-05-26 15:31:32.226556266 +0000 UTC m=+164.961211922" watchObservedRunningTime="2026-05-26 15:31:32.227357114 +0000 UTC m=+164.962012775" May 26 15:31:32.270837 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.270784 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" podStartSLOduration=45.171608514 podStartE2EDuration="47.270767442s" podCreationTimestamp="2026-05-26 15:30:45 +0000 UTC" firstStartedPulling="2026-05-26 15:30:45.843254685 +0000 UTC m=+118.577910321" lastFinishedPulling="2026-05-26 15:30:47.942413608 +0000 UTC m=+120.677069249" observedRunningTime="2026-05-26 15:31:32.269454263 +0000 UTC m=+165.004109915" watchObservedRunningTime="2026-05-26 15:31:32.270767442 +0000 UTC m=+165.005423104" May 26 15:31:32.294164 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.294123 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-phdw7" podStartSLOduration=2.822504785 podStartE2EDuration="4.294110503s" podCreationTimestamp="2026-05-26 15:31:28 +0000 UTC" firstStartedPulling="2026-05-26 15:31:30.079088825 +0000 UTC m=+162.813744465" lastFinishedPulling="2026-05-26 15:31:31.550694537 +0000 UTC m=+164.285350183" observedRunningTime="2026-05-26 15:31:32.292788643 +0000 UTC m=+165.027444305" watchObservedRunningTime="2026-05-26 15:31:32.294110503 +0000 UTC m=+165.028766161" May 26 15:31:32.571797 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.571768 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-87rvv" May 26 15:31:32.788272 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.788239 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-dcrjk"] May 26 15:31:32.790709 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.790676 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:32.793904 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.793885 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 26 15:31:32.794281 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.794260 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 26 15:31:32.795168 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.795156 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9d29t\"" May 26 15:31:32.810169 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.810118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdd86\" (UniqueName: \"kubernetes.io/projected/7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8-kube-api-access-pdd86\") pod \"downloads-57bd96b888-dcrjk\" (UID: \"7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8\") " pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:32.817589 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.817568 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-dcrjk"] May 26 15:31:32.911115 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.911092 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdd86\" (UniqueName: \"kubernetes.io/projected/7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8-kube-api-access-pdd86\") pod \"downloads-57bd96b888-dcrjk\" (UID: \"7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8\") " pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:32.922659 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:32.922631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdd86\" (UniqueName: \"kubernetes.io/projected/7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8-kube-api-access-pdd86\") pod \"downloads-57bd96b888-dcrjk\" (UID: \"7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8\") " pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:33.099765 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.099735 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:33.217907 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.217846 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2xhg" event={"ID":"4a2f1960-3a00-46ea-82c3-84befa424350","Type":"ContainerStarted","Data":"9c8fd84c70e40fa21cab06ee8f2d365a3661d65dfefee2975035d326f53cb9db"} May 26 15:31:33.217907 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.217900 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l2xhg" event={"ID":"4a2f1960-3a00-46ea-82c3-84befa424350","Type":"ContainerStarted","Data":"4b46651a1efe06ffbaa770c243646d1a272ff139a021ecd3147e8e53eebd26ba"} May 26 15:31:33.225402 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.225379 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-dcrjk"] May 26 15:31:33.227977 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:33.227942 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c37cb67_a3a1_4e3c_8e76_a3fed93a83b8.slice/crio-9fa858cb2ac39e49c18825812f8c0a110bf54c6385afea6eed073046b317f160 WatchSource:0}: Error finding container 9fa858cb2ac39e49c18825812f8c0a110bf54c6385afea6eed073046b317f160: Status 404 returned error can't find the container with id 9fa858cb2ac39e49c18825812f8c0a110bf54c6385afea6eed073046b317f160 May 26 15:31:33.241063 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.241023 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l2xhg" podStartSLOduration=3.618788198 podStartE2EDuration="5.241005743s" podCreationTimestamp="2026-05-26 15:31:28 +0000 UTC" firstStartedPulling="2026-05-26 15:31:29.927411243 +0000 UTC m=+162.662066879" lastFinishedPulling="2026-05-26 15:31:31.549628785 +0000 UTC m=+164.284284424" observedRunningTime="2026-05-26 15:31:33.24079204 +0000 UTC m=+165.975447714" watchObservedRunningTime="2026-05-26 15:31:33.241005743 +0000 UTC m=+165.975661402" May 26 15:31:33.817685 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.817656 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn"] May 26 15:31:33.820553 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.820528 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:33.823084 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.823049 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 26 15:31:33.823084 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.823060 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-7rgvk\"" May 26 15:31:33.833030 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.833006 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn"] May 26 15:31:33.919312 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:33.919273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/482c1c3e-21b8-488d-a098-cc1ceeb1a1d2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-p7nkn\" (UID: \"482c1c3e-21b8-488d-a098-cc1ceeb1a1d2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:34.020475 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:34.020373 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/482c1c3e-21b8-488d-a098-cc1ceeb1a1d2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-p7nkn\" (UID: \"482c1c3e-21b8-488d-a098-cc1ceeb1a1d2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:34.020657 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:34.020547 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 26 15:31:34.020657 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:31:34.020632 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482c1c3e-21b8-488d-a098-cc1ceeb1a1d2-monitoring-plugin-cert podName:482c1c3e-21b8-488d-a098-cc1ceeb1a1d2 nodeName:}" failed. No retries permitted until 2026-05-26 15:31:34.520605361 +0000 UTC m=+167.255261004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/482c1c3e-21b8-488d-a098-cc1ceeb1a1d2-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-p7nkn" (UID: "482c1c3e-21b8-488d-a098-cc1ceeb1a1d2") : secret "monitoring-plugin-cert" not found May 26 15:31:34.221604 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:34.221519 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-dcrjk" event={"ID":"7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8","Type":"ContainerStarted","Data":"9fa858cb2ac39e49c18825812f8c0a110bf54c6385afea6eed073046b317f160"} May 26 15:31:34.525258 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:34.525167 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/482c1c3e-21b8-488d-a098-cc1ceeb1a1d2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-p7nkn\" (UID: \"482c1c3e-21b8-488d-a098-cc1ceeb1a1d2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:34.528479 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:34.528453 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/482c1c3e-21b8-488d-a098-cc1ceeb1a1d2-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-p7nkn\" (UID: \"482c1c3e-21b8-488d-a098-cc1ceeb1a1d2\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:34.732475 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:34.732428 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:34.876998 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:34.876965 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn"] May 26 15:31:34.880464 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:34.880434 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482c1c3e_21b8_488d_a098_cc1ceeb1a1d2.slice/crio-b2c769738a93197a813f0eaaed6109ffbd8dd4140457e9dd00489104ca48e70a WatchSource:0}: Error finding container b2c769738a93197a813f0eaaed6109ffbd8dd4140457e9dd00489104ca48e70a: Status 404 returned error can't find the container with id b2c769738a93197a813f0eaaed6109ffbd8dd4140457e9dd00489104ca48e70a May 26 15:31:35.228408 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.228366 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" event={"ID":"482c1c3e-21b8-488d-a098-cc1ceeb1a1d2","Type":"ContainerStarted","Data":"b2c769738a93197a813f0eaaed6109ffbd8dd4140457e9dd00489104ca48e70a"} May 26 15:31:35.345196 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.341840 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:31:35.349194 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.349170 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.354131 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354068 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 15:31:35.354279 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354193 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 15:31:35.354550 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354529 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 15:31:35.354666 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354586 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 15:31:35.354666 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354613 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 15:31:35.354857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354831 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 15:31:35.354978 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.354928 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 15:31:35.355093 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355075 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 15:31:35.355241 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355225 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 15:31:35.355313 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355259 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxwv2\"" May 26 15:31:35.355375 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355325 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fi4as96lm20pb\"" May 26 15:31:35.355735 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355570 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 15:31:35.355735 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355635 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 15:31:35.355735 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.355694 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 15:31:35.363159 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.361848 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 15:31:35.364961 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.364940 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:31:35.434578 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.434578 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.434822 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.434822 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.434822 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.434822 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.434822 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.434985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-config\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435297 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p595\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-kube-api-access-2p595\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.435646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.435582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537505 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537552 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537582 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537704 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-config\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537745 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p595\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-kube-api-access-2p595\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537819 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537848 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537875 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.537911 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537901 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537950 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.537995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538002 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538020 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538057 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538088 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538117 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.538588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.539029 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.538723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.540757 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.539172 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.540757 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.540393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.541568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.541686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.541829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-config\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.542344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.542473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.542938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.543591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.544708 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.544688 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.545102 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.545033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.548495 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.548454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p595\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-kube-api-access-2p595\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.549870 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.549826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.549870 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.549860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.550648 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.550625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.551934 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.551907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.665545 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.665008 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:31:35.834270 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:35.834235 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:31:35.843623 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:35.843283 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4173f11_c286_4e7b_9935_0797d5e9e75a.slice/crio-cf4e39c8379622af3d7f8a0e08294cfb229545babed1454537bbddb74c8ce985 WatchSource:0}: Error finding container cf4e39c8379622af3d7f8a0e08294cfb229545babed1454537bbddb74c8ce985: Status 404 returned error can't find the container with id cf4e39c8379622af3d7f8a0e08294cfb229545babed1454537bbddb74c8ce985 May 26 15:31:36.232972 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:36.232877 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"cf4e39c8379622af3d7f8a0e08294cfb229545babed1454537bbddb74c8ce985"} May 26 15:31:37.241370 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:37.241332 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" event={"ID":"482c1c3e-21b8-488d-a098-cc1ceeb1a1d2","Type":"ContainerStarted","Data":"a1db8bf421c16744256b95a44df786eec44df71cdb205657cf28b266220d51ce"} May 26 15:31:37.242296 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:37.242273 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:37.244182 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:37.244097 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" exitCode=0 May 26 15:31:37.244182 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:37.244148 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} May 26 15:31:37.248731 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:37.248698 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" May 26 15:31:37.258824 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:37.258779 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-p7nkn" podStartSLOduration=2.728249447 podStartE2EDuration="4.258764563s" podCreationTimestamp="2026-05-26 15:31:33 +0000 UTC" firstStartedPulling="2026-05-26 15:31:34.882699621 +0000 UTC m=+167.617355256" lastFinishedPulling="2026-05-26 15:31:36.413214716 +0000 UTC m=+169.147870372" observedRunningTime="2026-05-26 15:31:37.258193321 +0000 UTC m=+169.992848980" watchObservedRunningTime="2026-05-26 15:31:37.258764563 +0000 UTC m=+169.993420223" May 26 15:31:38.165699 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:38.165666 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d9b55f47f-sdmx2" May 26 15:31:38.771339 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:38.771252 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:31:38.771339 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:38.771295 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:31:38.774052 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:38.774025 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fm4rf\"" May 26 15:31:38.782245 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:38.782227 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-htqpz" May 26 15:31:38.926499 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:38.926389 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-htqpz"] May 26 15:31:38.929257 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:31:38.929224 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5016be_069f_4fb4_8e1b_2c5ecdd17ddd.slice/crio-dcc525aa9a1fa7d9cc007f0b86c87fe856f8f0fc150c625644e3f4af37dc7b8a WatchSource:0}: Error finding container dcc525aa9a1fa7d9cc007f0b86c87fe856f8f0fc150c625644e3f4af37dc7b8a: Status 404 returned error can't find the container with id dcc525aa9a1fa7d9cc007f0b86c87fe856f8f0fc150c625644e3f4af37dc7b8a May 26 15:31:39.250830 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:39.250794 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-htqpz" event={"ID":"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd","Type":"ContainerStarted","Data":"dcc525aa9a1fa7d9cc007f0b86c87fe856f8f0fc150c625644e3f4af37dc7b8a"} May 26 15:31:42.222170 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:42.221734 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4995x" May 26 15:31:42.264381 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:42.264343 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} May 26 15:31:42.264575 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:42.264389 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} May 26 15:31:42.266168 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:42.266129 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-htqpz" event={"ID":"1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd","Type":"ContainerStarted","Data":"1a68483c043abe528e2053dcbbf0f791ba3d9f76935dbd89b1f7d610a5dde63d"} May 26 15:31:42.283322 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:42.283268 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-htqpz" podStartSLOduration=138.4935525 podStartE2EDuration="2m21.283253567s" podCreationTimestamp="2026-05-26 15:29:21 +0000 UTC" firstStartedPulling="2026-05-26 15:31:38.931313984 +0000 UTC m=+171.665969634" lastFinishedPulling="2026-05-26 15:31:41.721015054 +0000 UTC m=+174.455670701" observedRunningTime="2026-05-26 15:31:42.28314181 +0000 UTC m=+175.017797470" watchObservedRunningTime="2026-05-26 15:31:42.283253567 +0000 UTC m=+175.017909227" May 26 15:31:51.301456 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.301363 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} May 26 15:31:51.301456 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.301447 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} May 26 15:31:51.301456 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.301462 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} May 26 15:31:51.302060 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.301472 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerStarted","Data":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} May 26 15:31:51.303222 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.303183 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-dcrjk" event={"ID":"7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8","Type":"ContainerStarted","Data":"5270ff777a609250194d42ae7a5c6448c60a743c511a4414243d1b7fc0ce45e5"} May 26 15:31:51.303394 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.303366 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:51.309957 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.309932 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-dcrjk" May 26 15:31:51.339807 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.339761 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.431767581 podStartE2EDuration="16.339748318s" podCreationTimestamp="2026-05-26 15:31:35 +0000 UTC" firstStartedPulling="2026-05-26 15:31:35.846927584 +0000 UTC m=+168.581583219" lastFinishedPulling="2026-05-26 15:31:50.754908314 +0000 UTC m=+183.489563956" observedRunningTime="2026-05-26 15:31:51.337564887 +0000 UTC m=+184.072220545" watchObservedRunningTime="2026-05-26 15:31:51.339748318 +0000 UTC m=+184.074403975" May 26 15:31:51.357048 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:51.357007 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-dcrjk" podStartSLOduration=1.789602088 podStartE2EDuration="19.356990813s" podCreationTimestamp="2026-05-26 15:31:32 +0000 UTC" firstStartedPulling="2026-05-26 15:31:33.229542134 +0000 UTC m=+165.964197770" lastFinishedPulling="2026-05-26 15:31:50.796930843 +0000 UTC m=+183.531586495" observedRunningTime="2026-05-26 15:31:51.356352545 +0000 UTC m=+184.091008207" watchObservedRunningTime="2026-05-26 15:31:51.356990813 +0000 UTC m=+184.091646474" May 26 15:31:55.665432 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:31:55.665378 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:16.378609 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:16.378579 2559 generic.go:358] "Generic (PLEG): container finished" podID="86f18de1-2bef-41df-9529-88e4a59976dc" containerID="f90df55d54ae59621d90da500cdb43f036f38e7034e2f0b2a62155f761e52442" exitCode=0 May 26 15:32:16.379121 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:16.378643 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" event={"ID":"86f18de1-2bef-41df-9529-88e4a59976dc","Type":"ContainerDied","Data":"f90df55d54ae59621d90da500cdb43f036f38e7034e2f0b2a62155f761e52442"} May 26 15:32:16.379121 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:16.379007 2559 scope.go:117] "RemoveContainer" containerID="f90df55d54ae59621d90da500cdb43f036f38e7034e2f0b2a62155f761e52442" May 26 15:32:17.384399 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:17.384360 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-bzmld" event={"ID":"86f18de1-2bef-41df-9529-88e4a59976dc","Type":"ContainerStarted","Data":"12bebbe1572c6bb57429534eed7d5fb8939b27a25f6d15b9e03a9dfe620cef5e"} May 26 15:32:35.666142 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:35.666104 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:35.681584 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:35.681557 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:36.448026 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:36.447999 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:53.699228 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699193 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:32:53.699657 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699629 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="prometheus" containerID="cri-o://08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" gracePeriod=600 May 26 15:32:53.699727 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699669 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy" containerID="cri-o://54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" gracePeriod=600 May 26 15:32:53.699782 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699704 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="thanos-sidecar" containerID="cri-o://a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" gracePeriod=600 May 26 15:32:53.699782 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699718 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-web" containerID="cri-o://0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" gracePeriod=600 May 26 15:32:53.699782 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699727 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="config-reloader" containerID="cri-o://b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" gracePeriod=600 May 26 15:32:53.699904 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.699790 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" gracePeriod=600 May 26 15:32:53.948962 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:53.948936 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.102066 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102035 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-grpc-tls\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102226 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102090 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-tls\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102226 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102124 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-config-out\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102226 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102156 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-kube-rbac-proxy\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102356 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102285 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-serving-certs-ca-bundle\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102356 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102337 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-db\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102486 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102367 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-trusted-ca-bundle\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102486 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102394 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-metrics-client-ca\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102486 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102455 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102486 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102479 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-thanos-prometheus-http-client-file\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102517 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-config\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102558 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-rulefiles-0\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102582 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-metrics-client-certs\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102608 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102662 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p595\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-kube-api-access-2p595\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102933 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102696 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-kubelet-serving-ca-bundle\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102933 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102696 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:32:54.102933 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102733 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-tls-assets\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.102933 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.102760 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-web-config\") pod \"e4173f11-c286-4e7b-9935-0797d5e9e75a\" (UID: \"e4173f11-c286-4e7b-9935-0797d5e9e75a\") " May 26 15:32:54.103122 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.103017 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.103685 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.103260 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:32:54.104759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.104325 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:32:54.104759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.104618 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:32:54.104759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.104630 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.104759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.104642 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.105079 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.104813 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.105174 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.105107 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-config" (OuterVolumeSpecName: "config") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.105402 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.105306 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:32:54.106148 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.105885 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.106148 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.105995 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:32:54.107181 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.107142 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-config-out" (OuterVolumeSpecName: "config-out") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:32:54.107257 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.107183 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.107257 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.107234 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-kube-api-access-2p595" (OuterVolumeSpecName: "kube-api-access-2p595") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "kube-api-access-2p595". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:32:54.107633 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.107611 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:32:54.107753 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.107714 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.108118 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.108098 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.115988 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.115968 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-web-config" (OuterVolumeSpecName: "web-config") pod "e4173f11-c286-4e7b-9935-0797d5e9e75a" (UID: "e4173f11-c286-4e7b-9935-0797d5e9e75a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:32:54.203664 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203631 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p595\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-kube-api-access-2p595\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203664 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203664 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203676 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4173f11-c286-4e7b-9935-0797d5e9e75a-tls-assets\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203685 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-web-config\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203694 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-grpc-tls\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203702 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203710 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-config-out\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203719 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-kube-rbac-proxy\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203727 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-db\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203736 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203745 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-configmap-metrics-client-ca\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203754 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203763 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203773 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-config\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203781 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4173f11-c286-4e7b-9935-0797d5e9e75a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.203788 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203789 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-metrics-client-certs\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.204180 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.203798 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4173f11-c286-4e7b-9935-0797d5e9e75a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:32:54.484665 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484592 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" exitCode=0 May 26 15:32:54.484665 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484618 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" exitCode=0 May 26 15:32:54.484665 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484624 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" exitCode=0 May 26 15:32:54.484665 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484633 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" exitCode=0 May 26 15:32:54.484665 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484638 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" exitCode=0 May 26 15:32:54.484665 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484643 2559 generic.go:358] "Generic (PLEG): container finished" podID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" exitCode=0 May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484683 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484701 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484728 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484740 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484751 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484762 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484777 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484787 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.484965 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.484789 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4173f11-c286-4e7b-9935-0797d5e9e75a","Type":"ContainerDied","Data":"cf4e39c8379622af3d7f8a0e08294cfb229545babed1454537bbddb74c8ce985"} May 26 15:32:54.492646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.492550 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.499114 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.499098 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.505257 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.505238 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.507759 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.507738 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:32:54.511951 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.511930 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:32:54.513160 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.513142 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.519100 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.519082 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.525328 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.525313 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.531447 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.531432 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.531724 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.531703 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.531775 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.531731 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} err="failed to get container status \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" May 26 15:32:54.531775 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.531760 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.531991 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.531975 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.532036 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.531997 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} err="failed to get container status \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" May 26 15:32:54.532036 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532013 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.532238 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.532222 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.532299 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532246 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} err="failed to get container status \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" May 26 15:32:54.532299 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532266 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.532513 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.532498 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.532566 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532517 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} err="failed to get container status \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" May 26 15:32:54.532566 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532530 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.532757 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.532740 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.532795 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532769 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} err="failed to get container status \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" May 26 15:32:54.532795 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.532783 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.533001 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.532985 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.533056 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533009 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} err="failed to get container status \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" May 26 15:32:54.533056 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533031 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.533254 ip-10-0-133-138 kubenswrapper[2559]: E0526 15:32:54.533238 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.533293 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533261 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} err="failed to get container status \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" May 26 15:32:54.533293 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533274 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.533478 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533460 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} err="failed to get container status \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" May 26 15:32:54.533551 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533479 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.533691 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533668 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} err="failed to get container status \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" May 26 15:32:54.533746 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533692 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.533872 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533858 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} err="failed to get container status \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" May 26 15:32:54.533920 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.533872 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.534019 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534006 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} err="failed to get container status \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" May 26 15:32:54.534073 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534019 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.534166 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534153 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} err="failed to get container status \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" May 26 15:32:54.534222 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534166 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.534310 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534297 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} err="failed to get container status \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" May 26 15:32:54.534310 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534310 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.534501 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534485 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} err="failed to get container status \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" May 26 15:32:54.534501 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534501 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.534664 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534651 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} err="failed to get container status \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" May 26 15:32:54.534722 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534664 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.534815 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534797 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} err="failed to get container status \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" May 26 15:32:54.534879 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534817 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.535016 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.534998 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} err="failed to get container status \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" May 26 15:32:54.535059 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535017 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.535200 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535186 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} err="failed to get container status \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" May 26 15:32:54.535245 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535200 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.535412 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535394 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} err="failed to get container status \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" May 26 15:32:54.535521 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535412 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.535646 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535628 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} err="failed to get container status \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" May 26 15:32:54.535684 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535647 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.535882 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535859 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} err="failed to get container status \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" May 26 15:32:54.535924 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.535885 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.536179 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536153 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} err="failed to get container status \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" May 26 15:32:54.536327 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536179 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.536468 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536441 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} err="failed to get container status \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" May 26 15:32:54.536561 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536470 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.537185 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536736 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} err="failed to get container status \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" May 26 15:32:54.537185 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536759 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.537185 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.536990 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} err="failed to get container status \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" May 26 15:32:54.537185 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537006 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.537405 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537305 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} err="failed to get container status \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" May 26 15:32:54.537405 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537339 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537606 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} err="failed to get container status \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537628 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537854 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} err="failed to get container status \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.537874 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538092 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} err="failed to get container status \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538111 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538130 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538308 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} err="failed to get container status \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538329 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538519 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538535 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538549 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="config-reloader" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538557 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="config-reloader" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538567 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="init-config-reloader" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538576 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="init-config-reloader" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538592 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="prometheus" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538600 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="prometheus" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538611 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="thanos-sidecar" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538618 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="thanos-sidecar" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538549 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} err="failed to get container status \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538639 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-thanos" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538647 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-thanos" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538648 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538656 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-web" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538664 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-web" May 26 15:32:54.539881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538720 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="thanos-sidecar" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538729 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-web" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538739 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy-thanos" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538747 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="config-reloader" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538756 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="kube-rbac-proxy" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538765 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" containerName="prometheus" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538847 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} err="failed to get container status \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.538868 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539071 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} err="failed to get container status \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539090 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539289 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} err="failed to get container status \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539307 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539524 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} err="failed to get container status \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539547 2559 scope.go:117] "RemoveContainer" containerID="da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539747 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95"} err="failed to get container status \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": rpc error: code = NotFound desc = could not find container \"da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95\": container with ID starting with da49c37b192db7cebf3b229f21f58c61ae4b55a2726043e8451ba80ea9d30c95 not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539769 2559 scope.go:117] "RemoveContainer" containerID="54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.539986 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757"} err="failed to get container status \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": rpc error: code = NotFound desc = could not find container \"54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757\": container with ID starting with 54fa3a76b41f786ab7eaa7eb68ffd67d03a21590d28f34234410a06d2006c757 not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540002 2559 scope.go:117] "RemoveContainer" containerID="0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540222 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996"} err="failed to get container status \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": rpc error: code = NotFound desc = could not find container \"0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996\": container with ID starting with 0ccc4f71ab51f22bbc6919b96451871fe852b338ea776127d652875124762996 not found: ID does not exist" May 26 15:32:54.540857 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540240 2559 scope.go:117] "RemoveContainer" containerID="a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540451 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027"} err="failed to get container status \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": rpc error: code = NotFound desc = could not find container \"a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027\": container with ID starting with a14a3140fd5ee0eaa9abe4a4090b75ba04ca8bedaed6841c79199f675a9a1027 not found: ID does not exist" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540468 2559 scope.go:117] "RemoveContainer" containerID="b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540654 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e"} err="failed to get container status \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": rpc error: code = NotFound desc = could not find container \"b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e\": container with ID starting with b730b914af26dcc4e4413bc14f9522824f8d390e433fec577f8283d61fbb430e not found: ID does not exist" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540675 2559 scope.go:117] "RemoveContainer" containerID="08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540878 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3"} err="failed to get container status \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": rpc error: code = NotFound desc = could not find container \"08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3\": container with ID starting with 08fad67f2837c865806717246bf3fcc7f8e5ea6114d79de53c678299e51efde3 not found: ID does not exist" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.540896 2559 scope.go:117] "RemoveContainer" containerID="3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f" May 26 15:32:54.541687 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.541206 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f"} err="failed to get container status \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": rpc error: code = NotFound desc = could not find container \"3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f\": container with ID starting with 3d7135ad189c4b8d2883937d16f2edcddeb8b5db5179ea5f440760d02c87001f not found: ID does not exist" May 26 15:32:54.542536 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.542521 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.544949 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.544927 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 15:32:54.545080 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.544989 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 15:32:54.545080 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545001 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxwv2\"" May 26 15:32:54.545203 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545147 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 15:32:54.545261 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545245 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 15:32:54.545360 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545323 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 15:32:54.545360 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545439 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 15:32:54.545360 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545538 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 15:32:54.545360 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545546 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 15:32:54.545360 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545541 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 15:32:54.545360 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545582 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 15:32:54.546111 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.545647 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fi4as96lm20pb\"" May 26 15:32:54.546111 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.546081 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 15:32:54.549096 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.549075 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 15:32:54.552842 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.552811 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 15:32:54.554214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.554194 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:32:54.706824 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.706782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-web-config\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.706824 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.706829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.706853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.706912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.706951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.706989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-config-out\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-config\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707214 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tl8c\" (UniqueName: \"kubernetes.io/projected/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-kube-api-access-8tl8c\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707703 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707703 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707703 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.707703 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.707371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.807983 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808014 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808033 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808275 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808052 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808275 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808067 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tl8c\" (UniqueName: \"kubernetes.io/projected/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-kube-api-access-8tl8c\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808275 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808275 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808489 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808275 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808489 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808585 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808514 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808585 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808546 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-web-config\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808585 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808569 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808743 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808593 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808743 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808636 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808743 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808660 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808743 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808743 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-config-out\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808980 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-config\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808980 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808783 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808980 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.808980 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.809180 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.808977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.811562 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.811534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.811562 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.811553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.811726 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.811597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.812073 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.811769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.812073 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.811844 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-config-out\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.812073 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.811963 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.812279 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.812205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.812438 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.812396 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.812803 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.812781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.813661 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.813642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-web-config\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.814045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.814024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-config\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.814045 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.814042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.814187 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.814156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.816347 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.816328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tl8c\" (UniqueName: \"kubernetes.io/projected/aa61e4a9-be41-4d00-a1e4-dfde0a2de549-kube-api-access-8tl8c\") pod \"prometheus-k8s-0\" (UID: \"aa61e4a9-be41-4d00-a1e4-dfde0a2de549\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.853144 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.853122 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:54.984102 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:54.984024 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:32:54.986325 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:32:54.986294 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa61e4a9_be41_4d00_a1e4_dfde0a2de549.slice/crio-0bc8ddaae143694e4f520f27c2c8af7ffa23107eda52a963027ced0a5be54e6c WatchSource:0}: Error finding container 0bc8ddaae143694e4f520f27c2c8af7ffa23107eda52a963027ced0a5be54e6c: Status 404 returned error can't find the container with id 0bc8ddaae143694e4f520f27c2c8af7ffa23107eda52a963027ced0a5be54e6c May 26 15:32:55.488988 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:55.488907 2559 generic.go:358] "Generic (PLEG): container finished" podID="aa61e4a9-be41-4d00-a1e4-dfde0a2de549" containerID="2fa2cc37b142fc4c88c4262ac6f9576df3be251131be7ce9f63200d80c14c008" exitCode=0 May 26 15:32:55.488988 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:55.488967 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerDied","Data":"2fa2cc37b142fc4c88c4262ac6f9576df3be251131be7ce9f63200d80c14c008"} May 26 15:32:55.488988 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:55.488986 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"0bc8ddaae143694e4f520f27c2c8af7ffa23107eda52a963027ced0a5be54e6c"} May 26 15:32:55.779235 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:55.779203 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4173f11-c286-4e7b-9935-0797d5e9e75a" path="/var/lib/kubelet/pods/e4173f11-c286-4e7b-9935-0797d5e9e75a/volumes" May 26 15:32:56.495082 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.495001 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"8f14d83598009cbb5344dd4f84d9a63e399c4a6c7a3444b027ae4538b3ccde87"} May 26 15:32:56.495082 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.495040 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"a08e8c823217e81ae6bd7d6e4d7c3239f0ccf669b50b887d24a0b3d15e0f416f"} May 26 15:32:56.495082 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.495052 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"079e228c85c93ce4287171bcb360e727db944e2f930c74924f8e04fa5f0bb159"} May 26 15:32:56.495082 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.495064 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"07c1badcabd65aa5c1c7097ea35de190c038604b3e43173fdc7f77caa34713d7"} May 26 15:32:56.495082 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.495076 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"6bacb3d276f2f7d35de77d264561bd6e23316cf2b56459df563824f94e9373ec"} May 26 15:32:56.495479 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.495089 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa61e4a9-be41-4d00-a1e4-dfde0a2de549","Type":"ContainerStarted","Data":"8944ada15ff502cf9ce8fbf15267c28fe7ad08b32a09c771aa2839be2d7b0239"} May 26 15:32:56.524932 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:56.524885 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.524871053 podStartE2EDuration="2.524871053s" podCreationTimestamp="2026-05-26 15:32:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:32:56.524480609 +0000 UTC m=+249.259136266" watchObservedRunningTime="2026-05-26 15:32:56.524871053 +0000 UTC m=+249.259526705" May 26 15:32:59.547336 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:59.547301 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:32:59.549632 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:59.549611 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c784640-fa8b-467e-8a78-8c0fff9d85b2-metrics-certs\") pod \"network-metrics-daemon-9gwg9\" (UID: \"7c784640-fa8b-467e-8a78-8c0fff9d85b2\") " pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:32:59.774688 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:59.774656 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2qlwj\"" May 26 15:32:59.782636 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:59.782608 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gwg9" May 26 15:32:59.853452 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:59.853404 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:32:59.900156 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:32:59.900129 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9gwg9"] May 26 15:32:59.903405 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:32:59.903380 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c784640_fa8b_467e_8a78_8c0fff9d85b2.slice/crio-9e2cd607e0cfdb6429769cd998545c253e5482f85185a6c4bbc283d9c9a72998 WatchSource:0}: Error finding container 9e2cd607e0cfdb6429769cd998545c253e5482f85185a6c4bbc283d9c9a72998: Status 404 returned error can't find the container with id 9e2cd607e0cfdb6429769cd998545c253e5482f85185a6c4bbc283d9c9a72998 May 26 15:33:00.509591 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:00.509548 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gwg9" event={"ID":"7c784640-fa8b-467e-8a78-8c0fff9d85b2","Type":"ContainerStarted","Data":"9e2cd607e0cfdb6429769cd998545c253e5482f85185a6c4bbc283d9c9a72998"} May 26 15:33:01.513995 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:01.513960 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gwg9" event={"ID":"7c784640-fa8b-467e-8a78-8c0fff9d85b2","Type":"ContainerStarted","Data":"2a490d96d2a55406b12d29417cf56b83106667370f051bf7f3e6dc7ceecdf98f"} May 26 15:33:01.513995 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:01.513997 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gwg9" event={"ID":"7c784640-fa8b-467e-8a78-8c0fff9d85b2","Type":"ContainerStarted","Data":"ab38914e5ec7fe13652c6b07608c926cbad8193f0f2efd47cde41aadf3f286f2"} May 26 15:33:01.532078 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:01.532034 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9gwg9" podStartSLOduration=253.498959397 podStartE2EDuration="4m14.531997183s" podCreationTimestamp="2026-05-26 15:28:47 +0000 UTC" firstStartedPulling="2026-05-26 15:32:59.905584779 +0000 UTC m=+252.640240415" lastFinishedPulling="2026-05-26 15:33:00.938622561 +0000 UTC m=+253.673278201" observedRunningTime="2026-05-26 15:33:01.530599896 +0000 UTC m=+254.265255553" watchObservedRunningTime="2026-05-26 15:33:01.531997183 +0000 UTC m=+254.266652881" May 26 15:33:47.659069 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:47.659044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:33:47.659557 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:47.659050 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:33:47.668838 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:47.668820 2559 kubelet.go:1628] "Image garbage collection succeeded" May 26 15:33:54.854207 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:54.854171 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:33:54.869447 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:54.869410 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:33:55.683793 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:33:55.683766 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:34:45.745881 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.745809 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-487sq"] May 26 15:34:45.749018 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.749001 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.751403 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.751374 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 15:34:45.756992 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.756973 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-487sq"] May 26 15:34:45.830198 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.830170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4d43c10-6447-405f-86ef-a0e353bc11fb-kubelet-config\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.830338 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.830207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4d43c10-6447-405f-86ef-a0e353bc11fb-original-pull-secret\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.830338 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.830283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4d43c10-6447-405f-86ef-a0e353bc11fb-dbus\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.931388 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.931361 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4d43c10-6447-405f-86ef-a0e353bc11fb-dbus\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.931528 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.931402 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4d43c10-6447-405f-86ef-a0e353bc11fb-kubelet-config\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.931528 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.931444 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4d43c10-6447-405f-86ef-a0e353bc11fb-original-pull-secret\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.931528 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.931513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4d43c10-6447-405f-86ef-a0e353bc11fb-kubelet-config\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.931630 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.931569 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4d43c10-6447-405f-86ef-a0e353bc11fb-dbus\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:45.933612 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:45.933596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4d43c10-6447-405f-86ef-a0e353bc11fb-original-pull-secret\") pod \"global-pull-secret-syncer-487sq\" (UID: \"a4d43c10-6447-405f-86ef-a0e353bc11fb\") " pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:46.058952 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:46.058883 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-487sq" May 26 15:34:46.180050 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:46.180026 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-487sq"] May 26 15:34:46.189562 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:46.189537 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 15:34:46.814010 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:46.813974 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-487sq" event={"ID":"a4d43c10-6447-405f-86ef-a0e353bc11fb","Type":"ContainerStarted","Data":"52373d407da6eb3b9fe37cb1196dd8a7a8fbb9e6b75a6831bdc393a306aad09e"} May 26 15:34:50.827217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:50.827184 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-487sq" event={"ID":"a4d43c10-6447-405f-86ef-a0e353bc11fb","Type":"ContainerStarted","Data":"c8f2513fd9dad22b02c5ab87f441bd3a99322448063d13358d70e7187f4a87be"} May 26 15:34:50.854903 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:34:50.854852 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-487sq" podStartSLOduration=2.243968159 podStartE2EDuration="5.854836921s" podCreationTimestamp="2026-05-26 15:34:45 +0000 UTC" firstStartedPulling="2026-05-26 15:34:46.189673682 +0000 UTC m=+358.924329318" lastFinishedPulling="2026-05-26 15:34:49.800542444 +0000 UTC m=+362.535198080" observedRunningTime="2026-05-26 15:34:50.854330097 +0000 UTC m=+363.588985756" watchObservedRunningTime="2026-05-26 15:34:50.854836921 +0000 UTC m=+363.589492579" May 26 15:38:47.680644 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:38:47.680612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:38:47.681524 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:38:47.681494 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:39:05.960677 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:05.960599 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n"] May 26 15:39:05.963856 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:05.963841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:39:05.966125 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:05.966106 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-qkz4m\"/\"default-dockercfg-d65wt\"" May 26 15:39:05.966197 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:05.966147 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-qkz4m\"/\"openshift-service-ca.crt\"" May 26 15:39:05.966908 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:05.966892 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-qkz4m\"/\"kube-root-ca.crt\"" May 26 15:39:05.972237 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:05.972218 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n"] May 26 15:39:06.057586 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:06.057553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j5ns\" (UniqueName: \"kubernetes.io/projected/f1b03e05-6848-489c-80df-9c080113598c-kube-api-access-5j5ns\") pod \"test-trainjob-94sq9-node-0-0-xsn2n\" (UID: \"f1b03e05-6848-489c-80df-9c080113598c\") " pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:39:06.158794 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:06.158761 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5ns\" (UniqueName: \"kubernetes.io/projected/f1b03e05-6848-489c-80df-9c080113598c-kube-api-access-5j5ns\") pod \"test-trainjob-94sq9-node-0-0-xsn2n\" (UID: \"f1b03e05-6848-489c-80df-9c080113598c\") " pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:39:06.167310 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:06.167286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5ns\" (UniqueName: \"kubernetes.io/projected/f1b03e05-6848-489c-80df-9c080113598c-kube-api-access-5j5ns\") pod \"test-trainjob-94sq9-node-0-0-xsn2n\" (UID: \"f1b03e05-6848-489c-80df-9c080113598c\") " pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:39:06.283299 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:06.283205 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:39:06.403926 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:06.403901 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n"] May 26 15:39:06.406000 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:39:06.405961 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1b03e05_6848_489c_80df_9c080113598c.slice/crio-87c3a394b5a4efb03b20c4df0fa08f874b3f27bc4d2fb54947a33a5b074e781f WatchSource:0}: Error finding container 87c3a394b5a4efb03b20c4df0fa08f874b3f27bc4d2fb54947a33a5b074e781f: Status 404 returned error can't find the container with id 87c3a394b5a4efb03b20c4df0fa08f874b3f27bc4d2fb54947a33a5b074e781f May 26 15:39:06.541824 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:39:06.541741 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" event={"ID":"f1b03e05-6848-489c-80df-9c080113598c","Type":"ContainerStarted","Data":"87c3a394b5a4efb03b20c4df0fa08f874b3f27bc4d2fb54947a33a5b074e781f"} May 26 15:40:21.783242 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:21.783206 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" event={"ID":"f1b03e05-6848-489c-80df-9c080113598c","Type":"ContainerStarted","Data":"d3c0c05c5892590d453e7a10e69bffdd3f84f8299126eacba928b0e66bfa28dc"} May 26 15:40:21.801400 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:21.801341 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" podStartSLOduration=1.641558785 podStartE2EDuration="1m16.801323494s" podCreationTimestamp="2026-05-26 15:39:05 +0000 UTC" firstStartedPulling="2026-05-26 15:39:06.407912776 +0000 UTC m=+619.142568411" lastFinishedPulling="2026-05-26 15:40:21.567677485 +0000 UTC m=+694.302333120" observedRunningTime="2026-05-26 15:40:21.799403917 +0000 UTC m=+694.534059573" watchObservedRunningTime="2026-05-26 15:40:21.801323494 +0000 UTC m=+694.535979154" May 26 15:40:23.814820 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:23.814793 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-qkz4m_test-trainjob-94sq9-node-0-0-xsn2n_f1b03e05-6848-489c-80df-9c080113598c/node/0.log" May 26 15:40:24.793087 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:24.793059 2559 generic.go:358] "Generic (PLEG): container finished" podID="f1b03e05-6848-489c-80df-9c080113598c" containerID="d3c0c05c5892590d453e7a10e69bffdd3f84f8299126eacba928b0e66bfa28dc" exitCode=0 May 26 15:40:24.793243 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:24.793109 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" event={"ID":"f1b03e05-6848-489c-80df-9c080113598c","Type":"ContainerDied","Data":"d3c0c05c5892590d453e7a10e69bffdd3f84f8299126eacba928b0e66bfa28dc"} May 26 15:40:25.927844 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:25.927817 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:40:26.069165 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.069140 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j5ns\" (UniqueName: \"kubernetes.io/projected/f1b03e05-6848-489c-80df-9c080113598c-kube-api-access-5j5ns\") pod \"f1b03e05-6848-489c-80df-9c080113598c\" (UID: \"f1b03e05-6848-489c-80df-9c080113598c\") " May 26 15:40:26.071197 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.071173 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b03e05-6848-489c-80df-9c080113598c-kube-api-access-5j5ns" (OuterVolumeSpecName: "kube-api-access-5j5ns") pod "f1b03e05-6848-489c-80df-9c080113598c" (UID: "f1b03e05-6848-489c-80df-9c080113598c"). InnerVolumeSpecName "kube-api-access-5j5ns". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:40:26.170303 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.170241 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j5ns\" (UniqueName: \"kubernetes.io/projected/f1b03e05-6848-489c-80df-9c080113598c-kube-api-access-5j5ns\") on node \"ip-10-0-133-138.ec2.internal\" DevicePath \"\"" May 26 15:40:26.799852 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.799824 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" event={"ID":"f1b03e05-6848-489c-80df-9c080113598c","Type":"ContainerDied","Data":"87c3a394b5a4efb03b20c4df0fa08f874b3f27bc4d2fb54947a33a5b074e781f"} May 26 15:40:26.799852 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.799853 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87c3a394b5a4efb03b20c4df0fa08f874b3f27bc4d2fb54947a33a5b074e781f" May 26 15:40:26.800122 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.799861 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n" May 26 15:40:26.814466 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:26.814445 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-qkz4m_test-trainjob-94sq9-node-0-0-xsn2n_f1b03e05-6848-489c-80df-9c080113598c/node/0.log" May 26 15:40:27.246951 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:27.246926 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-qkz4m_test-trainjob-94sq9-node-0-0-xsn2n_f1b03e05-6848-489c-80df-9c080113598c/node/0.log" May 26 15:40:32.277921 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:32.277887 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n"] May 26 15:40:32.283705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:32.283680 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-qkz4m/test-trainjob-94sq9-node-0-0-xsn2n"] May 26 15:40:33.775840 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:40:33.775808 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b03e05-6848-489c-80df-9c080113598c" path="/var/lib/kubelet/pods/f1b03e05-6848-489c-80df-9c080113598c/volumes" May 26 15:41:22.095817 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.095778 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4b79k/must-gather-fztw4"] May 26 15:41:22.096293 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.096101 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1b03e05-6848-489c-80df-9c080113598c" containerName="node" May 26 15:41:22.096293 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.096113 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b03e05-6848-489c-80df-9c080113598c" containerName="node" May 26 15:41:22.096293 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.096173 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1b03e05-6848-489c-80df-9c080113598c" containerName="node" May 26 15:41:22.098019 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.097995 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.100434 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.100402 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4b79k\"/\"kube-root-ca.crt\"" May 26 15:41:22.101197 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.101175 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4b79k\"/\"default-dockercfg-2q2sm\"" May 26 15:41:22.101197 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.101183 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4b79k\"/\"openshift-service-ca.crt\"" May 26 15:41:22.105879 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.105853 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b79k/must-gather-fztw4"] May 26 15:41:22.198900 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.198865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93cb234c-4fdc-43bf-8178-22b3692b5fae-must-gather-output\") pod \"must-gather-fztw4\" (UID: \"93cb234c-4fdc-43bf-8178-22b3692b5fae\") " pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.199062 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.198969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp9nq\" (UniqueName: \"kubernetes.io/projected/93cb234c-4fdc-43bf-8178-22b3692b5fae-kube-api-access-wp9nq\") pod \"must-gather-fztw4\" (UID: \"93cb234c-4fdc-43bf-8178-22b3692b5fae\") " pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.299583 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.299545 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp9nq\" (UniqueName: \"kubernetes.io/projected/93cb234c-4fdc-43bf-8178-22b3692b5fae-kube-api-access-wp9nq\") pod \"must-gather-fztw4\" (UID: \"93cb234c-4fdc-43bf-8178-22b3692b5fae\") " pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.299802 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.299600 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93cb234c-4fdc-43bf-8178-22b3692b5fae-must-gather-output\") pod \"must-gather-fztw4\" (UID: \"93cb234c-4fdc-43bf-8178-22b3692b5fae\") " pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.299925 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.299908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93cb234c-4fdc-43bf-8178-22b3692b5fae-must-gather-output\") pod \"must-gather-fztw4\" (UID: \"93cb234c-4fdc-43bf-8178-22b3692b5fae\") " pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.308217 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.308192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp9nq\" (UniqueName: \"kubernetes.io/projected/93cb234c-4fdc-43bf-8178-22b3692b5fae-kube-api-access-wp9nq\") pod \"must-gather-fztw4\" (UID: \"93cb234c-4fdc-43bf-8178-22b3692b5fae\") " pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.416534 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.416439 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b79k/must-gather-fztw4" May 26 15:41:22.543979 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.543953 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b79k/must-gather-fztw4"] May 26 15:41:22.546432 ip-10-0-133-138 kubenswrapper[2559]: W0526 15:41:22.546381 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93cb234c_4fdc_43bf_8178_22b3692b5fae.slice/crio-cd640c3321c7aeab98c2c73da976b5822ae5b759e6aca18482ce95b4a37cf066 WatchSource:0}: Error finding container cd640c3321c7aeab98c2c73da976b5822ae5b759e6aca18482ce95b4a37cf066: Status 404 returned error can't find the container with id cd640c3321c7aeab98c2c73da976b5822ae5b759e6aca18482ce95b4a37cf066 May 26 15:41:22.548145 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.548129 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 15:41:22.957342 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:22.957307 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b79k/must-gather-fztw4" event={"ID":"93cb234c-4fdc-43bf-8178-22b3692b5fae","Type":"ContainerStarted","Data":"cd640c3321c7aeab98c2c73da976b5822ae5b759e6aca18482ce95b4a37cf066"} May 26 15:41:23.963854 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:23.963807 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b79k/must-gather-fztw4" event={"ID":"93cb234c-4fdc-43bf-8178-22b3692b5fae","Type":"ContainerStarted","Data":"fb38b969938cd0587147a1b05195b7258b496b4b8b6b003f444b217f84434fd8"} May 26 15:41:23.963854 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:23.963857 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b79k/must-gather-fztw4" event={"ID":"93cb234c-4fdc-43bf-8178-22b3692b5fae","Type":"ContainerStarted","Data":"55a120fbbc78baaf955212886c2aa9509fbcb7cbe41f15d2411a0d6b5a1d7695"} May 26 15:41:23.980693 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:23.980623 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4b79k/must-gather-fztw4" podStartSLOduration=1.18617831 podStartE2EDuration="1.98060229s" podCreationTimestamp="2026-05-26 15:41:22 +0000 UTC" firstStartedPulling="2026-05-26 15:41:22.548263049 +0000 UTC m=+755.282918685" lastFinishedPulling="2026-05-26 15:41:23.342687018 +0000 UTC m=+756.077342665" observedRunningTime="2026-05-26 15:41:23.978155114 +0000 UTC m=+756.712810773" watchObservedRunningTime="2026-05-26 15:41:23.98060229 +0000 UTC m=+756.715257948" May 26 15:41:24.706072 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:24.706041 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-487sq_a4d43c10-6447-405f-86ef-a0e353bc11fb/global-pull-secret-syncer/0.log" May 26 15:41:24.841921 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:24.841894 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ckzzg_5d28e805-9c72-4e28-a04b-cf4563552c00/konnectivity-agent/0.log" May 26 15:41:24.921409 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:24.921382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-138.ec2.internal_3f0de9b4d9b5f4cc43fcd9aec93b8726/haproxy/0.log" May 26 15:41:28.357880 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.357848 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-phdw7_d91b190b-d8aa-4bd6-95ab-1158bd75366e/kube-state-metrics/0.log" May 26 15:41:28.377284 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.377242 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-phdw7_d91b190b-d8aa-4bd6-95ab-1158bd75366e/kube-rbac-proxy-main/0.log" May 26 15:41:28.406720 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.406673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-phdw7_d91b190b-d8aa-4bd6-95ab-1158bd75366e/kube-rbac-proxy-self/0.log" May 26 15:41:28.457735 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.457688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-p7nkn_482c1c3e-21b8-488d-a098-cc1ceeb1a1d2/monitoring-plugin/0.log" May 26 15:41:28.622767 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.622735 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2xhg_4a2f1960-3a00-46ea-82c3-84befa424350/node-exporter/0.log" May 26 15:41:28.642943 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.642904 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2xhg_4a2f1960-3a00-46ea-82c3-84befa424350/kube-rbac-proxy/0.log" May 26 15:41:28.664446 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.664410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l2xhg_4a2f1960-3a00-46ea-82c3-84befa424350/init-textfile/0.log" May 26 15:41:28.769132 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.769102 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/prometheus/0.log" May 26 15:41:28.790975 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.790946 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/config-reloader/0.log" May 26 15:41:28.813474 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.813447 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/thanos-sidecar/0.log" May 26 15:41:28.833972 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.833944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/kube-rbac-proxy-web/0.log" May 26 15:41:28.859129 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.859101 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/kube-rbac-proxy/0.log" May 26 15:41:28.887071 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.886979 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/kube-rbac-proxy-thanos/0.log" May 26 15:41:28.912497 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.912454 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa61e4a9-be41-4d00-a1e4-dfde0a2de549/init-config-reloader/0.log" May 26 15:41:28.945390 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.945352 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-vdfq7_71d65a96-cdf4-488d-9562-9673eca29397/prometheus-operator/0.log" May 26 15:41:28.963694 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:28.963647 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-vdfq7_71d65a96-cdf4-488d-9562-9673eca29397/kube-rbac-proxy/0.log" May 26 15:41:30.649097 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:30.649056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/2.log" May 26 15:41:30.659330 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:30.659294 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-87rvv_35346e60-32df-4804-b90d-4a557e8d1ca9/console-operator/3.log" May 26 15:41:31.015311 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.015230 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-dcrjk_7c37cb67-a3a1-4e3c-8e76-a3fed93a83b8/download-server/0.log" May 26 15:41:31.359212 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.359176 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc"] May 26 15:41:31.363110 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.363084 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.381108 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.381085 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc"] May 26 15:41:31.439953 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.439924 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-99h5k_0a0cde1b-771d-4f1c-819b-b5a0757440f2/volume-data-source-validator/0.log" May 26 15:41:31.485620 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.485589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-podres\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.485798 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.485638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nbn\" (UniqueName: \"kubernetes.io/projected/5dd59851-340d-426d-a36c-389762b35830-kube-api-access-z2nbn\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.485798 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.485668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-proc\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.485798 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.485722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-sys\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.485798 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.485751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-lib-modules\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587010 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.586977 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-sys\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587192 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587020 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-lib-modules\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587192 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587057 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-podres\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587192 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587100 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nbn\" (UniqueName: \"kubernetes.io/projected/5dd59851-340d-426d-a36c-389762b35830-kube-api-access-z2nbn\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587192 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587137 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-proc\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587192 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-podres\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587192 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587101 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-sys\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587442 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587195 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-lib-modules\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.587442 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.587233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5dd59851-340d-426d-a36c-389762b35830-proc\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.595740 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.595718 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nbn\" (UniqueName: \"kubernetes.io/projected/5dd59851-340d-426d-a36c-389762b35830-kube-api-access-z2nbn\") pod \"perf-node-gather-daemonset-wsjgc\" (UID: \"5dd59851-340d-426d-a36c-389762b35830\") " pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.675588 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.675509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:31.827960 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.827924 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc"] May 26 15:41:31.995309 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.995227 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" event={"ID":"5dd59851-340d-426d-a36c-389762b35830","Type":"ContainerStarted","Data":"f23d5676172a583ab95235f4cd18a5e122a6bb34c16c018beafc1ee9ba8c3be0"} May 26 15:41:31.995309 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.995266 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" event={"ID":"5dd59851-340d-426d-a36c-389762b35830","Type":"ContainerStarted","Data":"4c3887bbb971d3174460d752026f32529b9d09fc171356eccd40ae5c564ef187"} May 26 15:41:31.995505 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:31.995309 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:32.011016 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:32.010964 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" podStartSLOduration=1.010949192 podStartE2EDuration="1.010949192s" podCreationTimestamp="2026-05-26 15:41:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:41:32.009935514 +0000 UTC m=+764.744591173" watchObservedRunningTime="2026-05-26 15:41:32.010949192 +0000 UTC m=+764.745604850" May 26 15:41:32.074553 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:32.074530 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4995x_2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d/dns/0.log" May 26 15:41:32.093089 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:32.093065 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4995x_2aad4a39-bdee-4d9b-bcf1-b45b14c95d3d/kube-rbac-proxy/0.log" May 26 15:41:32.202309 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:32.202283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wm7q_338ae3af-7cf2-41da-86c9-d28d710a36a0/dns-node-resolver/0.log" May 26 15:41:32.616504 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:32.616472 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d9b55f47f-sdmx2_457c5ea5-81d0-435e-aa4b-1a5125e47a11/registry/0.log" May 26 15:41:32.660160 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:32.660130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9v4q_34cc8901-133f-4094-aafb-488de9fc6e23/node-ca/0.log" May 26 15:41:33.318794 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:33.318762 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c9d85dfdd-h6bbx_41a523c4-f001-4d2e-9c1a-43a17ac173c4/router/0.log" May 26 15:41:33.696577 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:33.696509 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-htqpz_1e5016be-069f-4fb4-8e1b-2c5ecdd17ddd/serve-healthcheck-canary/0.log" May 26 15:41:34.170740 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:34.170715 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vws6g_d71a4fad-fea8-49d9-8ca7-fd389ab557a7/kube-rbac-proxy/0.log" May 26 15:41:34.188557 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:34.188535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vws6g_d71a4fad-fea8-49d9-8ca7-fd389ab557a7/exporter/0.log" May 26 15:41:34.207892 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:34.207871 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vws6g_d71a4fad-fea8-49d9-8ca7-fd389ab557a7/extractor/0.log" May 26 15:41:38.011308 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:38.011271 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4b79k/perf-node-gather-daemonset-wsjgc" May 26 15:41:40.545264 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.539518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/kube-multus-additional-cni-plugins/0.log" May 26 15:41:40.568991 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.568950 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/egress-router-binary-copy/0.log" May 26 15:41:40.589307 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.589273 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/cni-plugins/0.log" May 26 15:41:40.611389 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.611370 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/bond-cni-plugin/0.log" May 26 15:41:40.632408 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.632387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/routeoverride-cni/0.log" May 26 15:41:40.652301 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.652233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/whereabouts-cni-bincopy/0.log" May 26 15:41:40.672798 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.672699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-trlsj_b7e3906a-321e-467e-a2ff-cd54925e5c64/whereabouts-cni/0.log" May 26 15:41:40.705222 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.705190 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nlb2d_97a19529-425a-47ca-b36d-b2977ddda8d2/kube-multus/0.log" May 26 15:41:40.799792 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.799768 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9gwg9_7c784640-fa8b-467e-8a78-8c0fff9d85b2/network-metrics-daemon/0.log" May 26 15:41:40.821845 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:40.821822 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9gwg9_7c784640-fa8b-467e-8a78-8c0fff9d85b2/kube-rbac-proxy/0.log" May 26 15:41:41.799735 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.799705 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/ovn-controller/0.log" May 26 15:41:41.824932 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.824904 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/ovn-acl-logging/0.log" May 26 15:41:41.844761 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.844712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/kube-rbac-proxy-node/0.log" May 26 15:41:41.866681 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.866658 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/kube-rbac-proxy-ovn-metrics/0.log" May 26 15:41:41.883705 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.883679 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/northd/0.log" May 26 15:41:41.903063 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.903038 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/nbdb/0.log" May 26 15:41:41.924972 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:41.924946 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/sbdb/0.log" May 26 15:41:42.086690 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:42.086661 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpxlw_130c0d15-25e2-488e-9609-02abf35e90a1/ovnkube-controller/0.log" May 26 15:41:43.284954 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:43.284921 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-bc8sq_d39e2877-83c2-4cd1-b354-13559b6f1260/check-endpoints/0.log" May 26 15:41:43.329379 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:43.329352 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-r87th_3be7b7e9-1d71-45ba-b11d-3180a34eca24/network-check-target-container/0.log" May 26 15:41:44.209313 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:44.209281 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-94vxk_a56be5ad-651f-412a-a2de-d0b9818b17d9/iptables-alerter/0.log" May 26 15:41:44.979337 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:44.979307 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-t67fg_d498e202-7f95-4b83-aef8-acd8fe75ce8f/tuned/0.log" May 26 15:41:47.564953 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:47.564911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-bzmld_86f18de1-2bef-41df-9529-88e4a59976dc/service-ca-operator/1.log" May 26 15:41:47.566942 ip-10-0-133-138 kubenswrapper[2559]: I0526 15:41:47.566885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-bzmld_86f18de1-2bef-41df-9529-88e4a59976dc/service-ca-operator/0.log"