Jun 02 16:33:51.474266 ip-10-0-129-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 16:33:51.474278 ip-10-0-129-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 16:33:51.474285 ip-10-0-129-221 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 16:33:51.474524 ip-10-0-129-221 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 16:34:01.696082 ip-10-0-129-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 16:34:01.696098 ip-10-0-129-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot af7ba88c9b544111ab04fd480d0fde49 -- Jun 02 16:36:34.078194 ip-10-0-129-221 systemd[1]: Starting Kubernetes Kubelet... Jun 02 16:36:34.509578 ip-10-0-129-221 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:36:34.509578 ip-10-0-129-221 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 16:36:34.509578 ip-10-0-129-221 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:36:34.509578 ip-10-0-129-221 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 16:36:34.509578 ip-10-0-129-221 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:36:34.511133 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.511049 2548 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 16:36:34.515623 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515609 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:36:34.515623 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515622 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515627 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515630 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515633 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515636 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515639 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515642 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515644 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515647 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515650 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515652 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515655 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515663 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515666 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515669 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515672 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515675 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515677 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515680 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515682 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:36:34.515694 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515685 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515688 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515691 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515693 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515696 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515699 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515702 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515704 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515707 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515710 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515714 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515718 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515721 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515724 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515726 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515729 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515732 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515735 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515737 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:36:34.516181 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515740 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515742 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515747 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515750 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515753 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515756 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515759 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515761 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515764 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515767 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515770 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515772 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515775 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515778 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515781 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515784 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515787 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515789 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515792 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515795 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:36:34.516672 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515797 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515800 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515804 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515806 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515809 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515817 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515820 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515823 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515825 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515828 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515830 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515833 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515836 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515838 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515841 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515843 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515846 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515848 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515851 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:36:34.517169 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515853 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515856 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515858 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515861 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515864 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515866 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.515869 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516236 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516242 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516245 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516248 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516250 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516253 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516256 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516259 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516261 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516264 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516266 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516269 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:36:34.517624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516274 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516278 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516281 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516284 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516287 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516289 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516292 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516294 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516297 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516299 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516302 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516304 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516307 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516309 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516312 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516314 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516317 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516320 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516322 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516325 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:36:34.518086 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516327 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516331 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516333 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516336 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516339 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516341 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516344 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516347 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516350 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516353 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516355 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516358 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516360 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516363 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516366 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516368 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516370 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516373 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516376 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516378 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:36:34.518575 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516381 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516383 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516385 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516388 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516391 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516393 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516395 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516399 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516402 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516404 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516407 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516409 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516412 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516416 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516419 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516422 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516424 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516427 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516429 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516433 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:36:34.519078 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516435 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516438 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516440 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516443 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516446 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516449 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516455 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516458 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516461 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516464 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516466 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516469 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516471 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.516474 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516547 2548 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516563 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516573 2548 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516583 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516588 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516591 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 16:36:34.519598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516595 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516600 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516603 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516606 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516609 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516613 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516616 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516619 2548 flags.go:64] FLAG: --cgroup-root="" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516622 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516625 2548 flags.go:64] FLAG: --client-ca-file="" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516628 2548 flags.go:64] FLAG: --cloud-config="" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516631 2548 flags.go:64] FLAG: --cloud-provider="external" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516634 2548 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516638 2548 flags.go:64] FLAG: --cluster-domain="" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516641 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516644 2548 flags.go:64] FLAG: --config-dir="" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516647 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516650 2548 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516654 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516657 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516661 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516664 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516667 2548 flags.go:64] FLAG: --contention-profiling="false" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516670 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 16:36:34.520092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516673 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516677 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516679 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516683 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516686 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516689 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516692 2548 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516695 2548 flags.go:64] FLAG: --enable-server="true" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516698 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516703 2548 flags.go:64] FLAG: --event-burst="100" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516706 2548 flags.go:64] FLAG: --event-qps="50" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516709 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516712 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516715 2548 flags.go:64] FLAG: --eviction-hard="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516719 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516722 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516724 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516727 2548 flags.go:64] FLAG: --eviction-soft="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516730 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516733 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516735 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516738 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516741 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516744 2548 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516747 2548 flags.go:64] FLAG: --feature-gates="" Jun 02 16:36:34.520664 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516750 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516753 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516756 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516760 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516763 2548 flags.go:64] FLAG: --healthz-port="10248" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516766 2548 flags.go:64] FLAG: --help="false" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516769 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516772 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516774 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516777 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516781 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516785 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516788 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516791 2548 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516794 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516797 2548 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516800 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516803 2548 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516806 2548 flags.go:64] FLAG: --kube-reserved="" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516809 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516812 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516815 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516817 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516820 2548 flags.go:64] FLAG: --lock-file="" Jun 02 16:36:34.521283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516823 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516826 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516828 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516834 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516836 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516839 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516842 2548 flags.go:64] FLAG: --logging-format="text" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516845 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516848 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516851 2548 flags.go:64] FLAG: --manifest-url="" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516854 2548 flags.go:64] FLAG: --manifest-url-header="" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516858 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516862 2548 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516870 2548 flags.go:64] FLAG: --max-pods="110" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516873 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516876 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516879 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516882 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516885 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516888 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516891 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516897 2548 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516900 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516903 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 16:36:34.521865 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516906 2548 flags.go:64] FLAG: --pod-cidr="" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516909 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516928 2548 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516931 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516934 2548 flags.go:64] FLAG: --pods-per-core="0" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516937 2548 flags.go:64] FLAG: --port="10250" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516940 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516943 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ede625c47ad3ca1f" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516946 2548 flags.go:64] FLAG: --qos-reserved="" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516949 2548 flags.go:64] FLAG: --read-only-port="10255" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516952 2548 flags.go:64] FLAG: --register-node="true" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516955 2548 flags.go:64] FLAG: --register-schedulable="true" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516957 2548 flags.go:64] FLAG: --register-with-taints="" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516961 2548 flags.go:64] FLAG: --registry-burst="10" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516964 2548 flags.go:64] FLAG: --registry-qps="5" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516966 2548 flags.go:64] FLAG: --reserved-cpus="" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516969 2548 flags.go:64] FLAG: --reserved-memory="" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516973 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516976 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516979 2548 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516982 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516985 2548 flags.go:64] FLAG: --runonce="false" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516989 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516992 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516995 2548 flags.go:64] FLAG: --seccomp-default="false" Jun 02 16:36:34.522450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.516998 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517001 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517004 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517007 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517010 2548 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517013 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517016 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517019 2548 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517021 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517024 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517027 2548 flags.go:64] FLAG: --system-cgroups="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517030 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517036 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517038 2548 flags.go:64] FLAG: --tls-cert-file="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517041 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517045 2548 flags.go:64] FLAG: --tls-min-version="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517048 2548 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517050 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517053 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517056 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517058 2548 flags.go:64] FLAG: --v="2" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517062 2548 flags.go:64] FLAG: --version="false" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517066 2548 flags.go:64] FLAG: --vmodule="" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517070 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.517073 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 16:36:34.523057 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517163 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517167 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517169 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517172 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517177 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517180 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517183 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517186 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517190 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517194 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517197 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517200 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517202 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517205 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517208 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517211 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517213 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517216 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517218 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:36:34.523660 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517221 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517224 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517226 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517229 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517231 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517234 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517236 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517239 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517242 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517244 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517247 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517249 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517252 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517254 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517257 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517259 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517262 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517265 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517269 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517271 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:36:34.524219 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517274 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517276 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517279 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517282 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517284 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517287 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517289 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517292 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517295 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517298 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517300 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517302 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517305 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517308 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517310 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517313 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517315 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517318 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517320 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517322 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:36:34.524756 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517325 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517327 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517330 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517332 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517335 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517337 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517340 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517342 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517345 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517349 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517352 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517354 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517357 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517359 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517364 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517367 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517369 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517372 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517374 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517376 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:36:34.525280 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517379 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517382 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517385 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517387 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517390 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517394 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.517397 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.518064 2548 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.524151 2548 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.524167 2548 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524212 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524216 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524220 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524224 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524227 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:36:34.525777 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524230 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524232 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524235 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524238 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524241 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524244 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524246 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524249 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524252 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524256 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524259 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524262 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524265 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524267 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524270 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524272 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524275 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524277 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524280 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524282 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:36:34.526190 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524285 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524288 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524290 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524293 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524295 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524298 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524302 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524305 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524307 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524310 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524313 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524315 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524318 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524320 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524323 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524326 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524328 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524331 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524334 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524336 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:36:34.526700 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524339 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524341 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524343 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524346 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524349 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524351 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524354 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524356 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524358 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524361 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524363 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524366 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524368 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524371 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524374 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524376 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524379 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524381 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524385 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524388 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:36:34.527202 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524390 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524393 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524396 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524398 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524401 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524404 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524406 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524409 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524412 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524414 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524417 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524419 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524422 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524424 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524427 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524429 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524432 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524436 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524440 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:36:34.528515 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524443 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524446 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.524451 2548 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524560 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524565 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524568 2548 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524571 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524574 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524577 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524580 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524582 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524585 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524589 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524592 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524594 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524597 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:36:34.529005 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524600 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524602 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524605 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524607 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524610 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524612 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524615 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524617 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524620 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524622 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524625 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524627 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524630 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524632 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524635 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524637 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524640 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524642 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524645 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524647 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:36:34.529414 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524650 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524653 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524655 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524658 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524660 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524662 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524666 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524671 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524674 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524676 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524679 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524681 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524684 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524687 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524689 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524692 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524694 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524697 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524699 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524702 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:36:34.529904 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524704 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524707 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524709 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524712 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524714 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524718 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524721 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524724 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524727 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524730 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524733 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524735 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524737 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524740 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524742 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524745 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524747 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524750 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524752 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:36:34.530401 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524755 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524758 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524760 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524763 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524774 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524777 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524780 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524782 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524785 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524787 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524790 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524792 2548 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524794 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:34.524797 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.524801 2548 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:36:34.530852 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.525520 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 16:36:34.531250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.527348 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 16:36:34.531250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.528269 2548 server.go:1019] "Starting client certificate rotation" Jun 02 16:36:34.531250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.528364 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:36:34.531250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.529127 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:36:34.557490 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.557470 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:36:34.559471 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.559451 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:36:34.579611 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.579589 2548 log.go:25] "Validated CRI v1 runtime API" Jun 02 16:36:34.584110 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.584093 2548 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:36:34.585850 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.585838 2548 log.go:25] "Validated CRI v1 image API" Jun 02 16:36:34.587046 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.587033 2548 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 16:36:34.591478 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.591457 2548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 90e33718-f902-40b5-86ff-3f37f49fe9d3:/dev/nvme0n1p3 951b31f3-f6ae-467f-80b9-540d06cce5da:/dev/nvme0n1p4] Jun 02 16:36:34.591529 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.591479 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 16:36:34.595656 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.595554 2548 manager.go:217] Machine: {Timestamp:2026-06-02 16:36:34.595074533 +0000 UTC m=+0.402194525 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100191 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec237246818dd03aff2c8db4fad93729 SystemUUID:ec237246-818d-d03a-ff2c-8db4fad93729 BootID:af7ba88c-9b54-4111-ab04-fd480d0fde49 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:2b:99:ac:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:2b:99:ac:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:fc:3c:69:96:b2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 16:36:34.596254 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.596244 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 16:36:34.596328 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.596317 2548 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 16:36:34.597431 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.597409 2548 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 16:36:34.597551 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.597433 2548 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 16:36:34.597598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.597559 2548 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 16:36:34.597598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.597571 2548 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 16:36:34.597598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.597579 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:36:34.598290 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.598280 2548 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:36:34.600011 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.600001 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:36:34.600108 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.600099 2548 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 16:36:34.603601 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.603590 2548 kubelet.go:491] "Attempting to sync node with API server" Jun 02 16:36:34.603639 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.603611 2548 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 16:36:34.603639 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.603635 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 16:36:34.603690 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.603645 2548 kubelet.go:397] "Adding apiserver pod source" Jun 02 16:36:34.603690 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.603657 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 16:36:34.605208 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.605139 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:36:34.605313 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.605303 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:36:34.610135 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.610116 2548 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 16:36:34.611745 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.611728 2548 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 16:36:34.613321 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613303 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613329 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613339 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613348 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613360 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613370 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613380 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613390 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 16:36:34.613400 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613400 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 16:36:34.613672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613408 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 16:36:34.613672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613421 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 16:36:34.613672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.613430 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 16:36:34.614314 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.614299 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 16:36:34.614314 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.614313 2548 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 16:36:34.615050 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.615027 2548 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 16:36:34.615151 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.615027 2548 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 16:36:34.615999 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.615983 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ltln" Jun 02 16:36:34.617288 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.617274 2548 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 16:36:34.617325 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.617314 2548 server.go:1295] "Started kubelet" Jun 02 16:36:34.617396 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.617374 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 16:36:34.617457 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.617415 2548 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 16:36:34.617495 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.617474 2548 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 16:36:34.617950 ip-10-0-129-221 systemd[1]: Started Kubernetes Kubelet. Jun 02 16:36:34.618532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.618511 2548 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 16:36:34.620507 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.620490 2548 server.go:317] "Adding debug handlers to kubelet server" Jun 02 16:36:34.622163 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.622145 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ltln" Jun 02 16:36:34.622642 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.622624 2548 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 16:36:34.623358 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.623343 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 16:36:34.623718 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.622662 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-221.ec2.internal.18b550ea39ce464f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-221.ec2.internal,UID:ip-10-0-129-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-221.ec2.internal,},FirstTimestamp:2026-06-02 16:36:34.617288271 +0000 UTC m=+0.424408263,LastTimestamp:2026-06-02 16:36:34.617288271 +0000 UTC m=+0.424408263,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-221.ec2.internal,}" Jun 02 16:36:34.623848 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.623826 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 16:36:34.624071 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.624057 2548 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 16:36:34.624152 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.624116 2548 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 16:36:34.624262 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.624249 2548 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 16:36:34.624361 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.624345 2548 reconstruct.go:97] "Volume reconstruction finished" Jun 02 16:36:34.624361 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.624357 2548 reconciler.go:26] "Reconciler: start to sync state" Jun 02 16:36:34.624725 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.624705 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:34.625091 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.625053 2548 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 16:36:34.625187 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625127 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 16:36:34.625187 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625144 2548 factory.go:55] Registering systemd factory Jun 02 16:36:34.625187 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625151 2548 factory.go:223] Registration of the systemd container factory successfully Jun 02 16:36:34.625423 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625407 2548 factory.go:153] Registering CRI-O factory Jun 02 16:36:34.625423 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625426 2548 factory.go:223] Registration of the crio container factory successfully Jun 02 16:36:34.625557 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625444 2548 factory.go:103] Registering Raw factory Jun 02 16:36:34.625557 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.625457 2548 manager.go:1196] Started watching for new ooms in manager Jun 02 16:36:34.626090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.626073 2548 manager.go:319] Starting recovery of all containers Jun 02 16:36:34.630459 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.630435 2548 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:36:34.633314 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.633289 2548 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-221.ec2.internal\" not found" node="ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.637218 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.637203 2548 manager.go:324] Recovery completed Jun 02 16:36:34.641443 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.641346 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:36:34.643318 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.643303 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:36:34.643405 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.643337 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:36:34.643405 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.643348 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:36:34.643813 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.643801 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 16:36:34.643813 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.643811 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 16:36:34.643897 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.643827 2548 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:36:34.646409 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.646397 2548 policy_none.go:49] "None policy: Start" Jun 02 16:36:34.646449 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.646414 2548 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 16:36:34.646449 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.646424 2548 state_mem.go:35] "Initializing new in-memory state store" Jun 02 16:36:34.691458 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691443 2548 manager.go:341] "Starting Device Plugin manager" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.691477 2548 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691489 2548 server.go:85] "Starting device plugin registration server" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691695 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691706 2548 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691783 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691869 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.691883 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 16:36:34.692353 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.692351 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 16:36:34.692626 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.692388 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:34.777269 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.777219 2548 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 16:36:34.778352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.778337 2548 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 16:36:34.778443 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.778356 2548 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 16:36:34.778443 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.778373 2548 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 16:36:34.778443 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.778379 2548 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 16:36:34.778443 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.778421 2548 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 16:36:34.781739 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.781724 2548 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:36:34.792676 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.792651 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:36:34.793470 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.793453 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:36:34.793577 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.793482 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:36:34.793577 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.793493 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:36:34.793577 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.793517 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.801798 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.801782 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.801888 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.801804 2548 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-221.ec2.internal\": node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:34.823845 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.823829 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:34.879438 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.879416 2548 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal"] Jun 02 16:36:34.879499 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.879476 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:36:34.880304 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.880291 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:36:34.880375 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.880316 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:36:34.880375 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.880326 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:36:34.881699 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.881686 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:36:34.881854 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.881841 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.881903 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.881874 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:36:34.882413 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.882394 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:36:34.882475 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.882417 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:36:34.882475 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.882428 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:36:34.882475 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.882436 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:36:34.882475 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.882439 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:36:34.882475 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.882451 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:36:34.883780 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.883764 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.883830 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.883807 2548 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:36:34.884637 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.884613 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:36:34.884716 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.884649 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:36:34.884716 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.884665 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:36:34.908464 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.908445 2548 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-221.ec2.internal\" not found" node="ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.912755 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.912739 2548 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-221.ec2.internal\" not found" node="ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.924571 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:34.924556 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:34.926811 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.926751 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6408636c6c698e8f71f1840d6bd7ceae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal\" (UID: \"6408636c6c698e8f71f1840d6bd7ceae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.926866 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.926824 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6408636c6c698e8f71f1840d6bd7ceae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal\" (UID: \"6408636c6c698e8f71f1840d6bd7ceae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:34.926866 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:34.926840 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0821a616737b3cf9dfb29f3445b48368-config\") pod \"kube-apiserver-proxy-ip-10-0-129-221.ec2.internal\" (UID: \"0821a616737b3cf9dfb29f3445b48368\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.025006 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.024975 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:35.027174 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.027157 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0821a616737b3cf9dfb29f3445b48368-config\") pod \"kube-apiserver-proxy-ip-10-0-129-221.ec2.internal\" (UID: \"0821a616737b3cf9dfb29f3445b48368\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.027232 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.027179 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0821a616737b3cf9dfb29f3445b48368-config\") pod \"kube-apiserver-proxy-ip-10-0-129-221.ec2.internal\" (UID: \"0821a616737b3cf9dfb29f3445b48368\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.027232 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.027196 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6408636c6c698e8f71f1840d6bd7ceae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal\" (UID: \"6408636c6c698e8f71f1840d6bd7ceae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.027232 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.027222 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6408636c6c698e8f71f1840d6bd7ceae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal\" (UID: \"6408636c6c698e8f71f1840d6bd7ceae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.027348 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.027251 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6408636c6c698e8f71f1840d6bd7ceae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal\" (UID: \"6408636c6c698e8f71f1840d6bd7ceae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.027348 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.027282 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6408636c6c698e8f71f1840d6bd7ceae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal\" (UID: \"6408636c6c698e8f71f1840d6bd7ceae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.125624 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.125593 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:35.210924 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.210894 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.215837 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.215821 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.226578 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.226558 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:35.327205 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.327147 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:35.427603 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.427581 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:35.528184 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.528156 2548 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-221.ec2.internal\" not found" Jun 02 16:36:35.529260 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.529243 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 16:36:35.529399 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.529384 2548 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:36:35.529433 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.529401 2548 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:36:35.603564 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.603513 2548 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:36:35.604480 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.604452 2548 apiserver.go:52] "Watching apiserver" Jun 02 16:36:35.615536 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.615515 2548 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 16:36:35.615836 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.615818 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-d2h5q","openshift-network-diagnostics/network-check-target-7lngf","openshift-network-operator/iptables-alerter-qs5g9","openshift-ovn-kubernetes/ovnkube-node-w7dxv","kube-system/konnectivity-agent-9dhrt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7","openshift-cluster-node-tuning-operator/tuned-fl9hw","openshift-image-registry/node-ca-hr2pk","openshift-multus/multus-x5628","openshift-multus/network-metrics-daemon-lpdvk","openshift-dns/node-resolver-jpc2k"] Jun 02 16:36:35.617196 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.617183 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.618715 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.618648 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.619857 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.619835 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lkv9c\"" Jun 02 16:36:35.619988 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.619971 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.620607 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.620590 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.620704 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.620669 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 16:36:35.620704 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.620690 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.621072 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.621056 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 16:36:35.621131 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.621075 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 16:36:35.621263 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.621251 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-crhkr\"" Jun 02 16:36:35.621263 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.621259 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 16:36:35.621567 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.621554 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.621818 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.621804 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.623183 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.623166 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:35.623251 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.623232 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:35.623434 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.623422 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 16:36:35.623635 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.623622 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.624198 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624184 2548 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.624338 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624323 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.624565 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624544 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.624657 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624628 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.624713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624667 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.624788 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624774 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 16:36:35.624839 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624780 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pjxr6\"" Jun 02 16:36:35.624839 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624824 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 16:36:35.624839 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.624829 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6smbt\"" Jun 02 16:36:35.625067 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.625052 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 16:36:35.625126 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.625062 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 16:36:35.625126 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.625036 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 16:31:34 +0000 UTC" deadline="2027-12-30 05:35:32.368440836 +0000 UTC" Jun 02 16:36:35.625126 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.625099 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13812h58m56.743345218s" Jun 02 16:36:35.625126 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.625057 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.625506 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.625494 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.626754 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.626740 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.627558 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.627545 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 16:36:35.627771 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.627759 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.628674 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.628657 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-822mh\"" Jun 02 16:36:35.628783 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.628680 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.628783 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.628760 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 16:36:35.628893 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.628870 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.628992 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.628968 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 16:36:35.629070 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.629036 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.629070 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.629045 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4ngn9\"" Jun 02 16:36:35.629290 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.629266 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.629359 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.629274 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x5628" Jun 02 16:36:35.629466 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.629451 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8w5sf\"" Jun 02 16:36:35.630396 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630378 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f0f7184-7b77-4c96-84f1-c2afd6b31823-agent-certs\") pod \"konnectivity-agent-9dhrt\" (UID: \"8f0f7184-7b77-4c96-84f1-c2afd6b31823\") " pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.630396 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630395 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630401 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hv4\" (UniqueName: \"kubernetes.io/projected/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-kube-api-access-x5hv4\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630417 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-log-socket\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630433 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovnkube-config\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.630446 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630448 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-os-release\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630495 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f0f7184-7b77-4c96-84f1-c2afd6b31823-konnectivity-ca\") pod \"konnectivity-agent-9dhrt\" (UID: \"8f0f7184-7b77-4c96-84f1-c2afd6b31823\") " pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.630532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630530 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-socket-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630550 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-systemd-units\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630566 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovn-node-metrics-cert\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630607 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630621 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-registration-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630636 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfd66\" (UniqueName: \"kubernetes.io/projected/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-kube-api-access-jfd66\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630654 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-node-log\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630680 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-run-ovn-kubernetes\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630707 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-cni-bin\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630734 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-cni-netd\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630751 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630767 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630789 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-device-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630811 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-var-lib-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630836 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovnkube-script-lib\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.630935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630850 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c9efb83-321a-4253-8331-46bf5f49dfad-hosts-file\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630867 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-cnibin\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630900 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630935 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-etc-selinux\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630952 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-iptables-alerter-script\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630966 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-host-slash\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630979 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-env-overrides\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.630993 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpr5\" (UniqueName: \"kubernetes.io/projected/2c9efb83-321a-4253-8331-46bf5f49dfad-kube-api-access-nfpr5\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631024 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631056 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9k7x\" (UniqueName: \"kubernetes.io/projected/e009f8fe-9667-4418-80f7-ee32347895bd-kube-api-access-n9k7x\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631093 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-etc-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631117 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631139 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9efb83-321a-4253-8331-46bf5f49dfad-tmp-dir\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631164 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-system-cni-dir\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631185 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631187 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-sys-fs\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.631649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631220 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-kubelet\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631244 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-slash\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631268 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-run-netns\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631291 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-ovn\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631340 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbnwq\" (UniqueName: \"kubernetes.io/projected/8d8dfbd2-9d8b-4452-89cf-4052579e643a-kube-api-access-nbnwq\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631360 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-systemd\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631375 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.631526 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.632313 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.632355 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 16:36:35.632376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.632376 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xh685\"" Jun 02 16:36:35.632832 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.632355 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6r6sn\"" Jun 02 16:36:35.640486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.640470 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal"] Jun 02 16:36:35.640764 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.640750 2548 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:36:35.641117 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.641037 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:36:35.641202 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.641185 2548 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" Jun 02 16:36:35.655425 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.655409 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:36:35.655491 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.655445 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal"] Jun 02 16:36:35.673842 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.673822 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhjlm" Jun 02 16:36:35.683421 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.683406 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhjlm" Jun 02 16:36:35.725523 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.725504 2548 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 16:36:35.731483 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731467 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-run-netns\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.731563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731492 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysconfig\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.731563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731508 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysctl-conf\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.731563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731525 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-systemd\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.731563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731540 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731557 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-run-netns\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731566 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-cnibin\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731608 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-systemd\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731632 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-cni-binary-copy\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731650 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-socket-dir-parent\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731674 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-modprobe-d\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731689 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysctl-d\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731707 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hv4\" (UniqueName: \"kubernetes.io/projected/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-kube-api-access-x5hv4\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.731730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731724 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-kubelet\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731739 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8mth\" (UniqueName: \"kubernetes.io/projected/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-kube-api-access-s8mth\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731753 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-systemd\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731766 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-lib-modules\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-var-lib-kubelet\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731822 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-host\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731836 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92twt\" (UniqueName: \"kubernetes.io/projected/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-kube-api-access-92twt\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731857 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-systemd-units\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731884 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovn-node-metrics-cert\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731898 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731941 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-systemd-units\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731964 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-os-release\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.731991 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.732017 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732011 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-registration-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732026 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-node-log\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732043 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-run-ovn-kubernetes\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732067 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-cni-bin\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732071 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-registration-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732082 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovnkube-script-lib\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732071 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732127 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-node-log\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732111 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-run-ovn-kubernetes\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732144 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-cni-bin\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732162 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-kubernetes\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732174 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732185 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-sys\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732223 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-device-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732244 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-var-lib-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732259 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c9efb83-321a-4253-8331-46bf5f49dfad-hosts-file\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732273 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-cnibin\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.732440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732313 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-var-lib-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732317 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-serviceca\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732335 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c9efb83-321a-4253-8331-46bf5f49dfad-hosts-file\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732355 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-cnibin\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732367 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-device-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732394 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-iptables-alerter-script\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732513 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-host-slash\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732537 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-env-overrides\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732557 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732604 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-host-slash\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732638 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9k7x\" (UniqueName: \"kubernetes.io/projected/e009f8fe-9667-4418-80f7-ee32347895bd-kube-api-access-n9k7x\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732646 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovnkube-script-lib\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732668 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-cni-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732693 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-cni-bin\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732700 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732720 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-etc-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732744 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9efb83-321a-4253-8331-46bf5f49dfad-tmp-dir\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.733166 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732770 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-system-cni-dir\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732798 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-cni-multus\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732822 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-conf-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732845 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-etc-kubernetes\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5l46\" (UniqueName: \"kubernetes.io/projected/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-kube-api-access-n5l46\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732892 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5gb5\" (UniqueName: \"kubernetes.io/projected/b956c2a7-62d8-4c70-af6e-3193e8135558-kube-api-access-m5gb5\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732934 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-iptables-alerter-script\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732939 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-kubelet\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732973 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-kubelet\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.732974 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-ovn\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733005 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-ovn\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733005 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbnwq\" (UniqueName: \"kubernetes.io/projected/8d8dfbd2-9d8b-4452-89cf-4052579e643a-kube-api-access-nbnwq\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733045 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-system-cni-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733059 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-env-overrides\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733069 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-multus-certs\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733111 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f0f7184-7b77-4c96-84f1-c2afd6b31823-agent-certs\") pod \"konnectivity-agent-9dhrt\" (UID: \"8f0f7184-7b77-4c96-84f1-c2afd6b31823\") " pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733131 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9efb83-321a-4253-8331-46bf5f49dfad-tmp-dir\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.733945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733136 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-etc-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733166 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-netns\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733194 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-log-socket\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733196 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-system-cni-dir\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733237 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-log-socket\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733267 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovnkube-config\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733289 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-os-release\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733351 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733381 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f0f7184-7b77-4c96-84f1-c2afd6b31823-konnectivity-ca\") pod \"konnectivity-agent-9dhrt\" (UID: \"8f0f7184-7b77-4c96-84f1-c2afd6b31823\") " pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733417 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-os-release\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733455 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-host\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733478 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e009f8fe-9667-4418-80f7-ee32347895bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733586 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-socket-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733629 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-k8s-cni-cncf-io\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733656 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-daemon-config\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733705 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfd66\" (UniqueName: \"kubernetes.io/projected/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-kube-api-access-jfd66\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733713 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovnkube-config\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.734708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733734 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-cni-netd\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733776 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-cni-netd\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733777 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-socket-dir\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733793 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733933 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b956c2a7-62d8-4c70-af6e-3193e8135558-tmp\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733944 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.733994 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734022 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734053 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734087 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-etc-selinux\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734110 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpr5\" (UniqueName: \"kubernetes.io/projected/2c9efb83-321a-4253-8331-46bf5f49dfad-kube-api-access-nfpr5\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734150 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e009f8fe-9667-4418-80f7-ee32347895bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734204 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-etc-selinux\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734266 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734312 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-run-openvswitch\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734323 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f0f7184-7b77-4c96-84f1-c2afd6b31823-konnectivity-ca\") pod \"konnectivity-agent-9dhrt\" (UID: \"8f0f7184-7b77-4c96-84f1-c2afd6b31823\") " pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734329 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-hostroot\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.735492 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734355 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-run\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734382 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-tuned\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734398 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-sys-fs\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734422 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-slash\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734446 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-sys-fs\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.734476 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d8dfbd2-9d8b-4452-89cf-4052579e643a-host-slash\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.735608 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d8dfbd2-9d8b-4452-89cf-4052579e643a-ovn-node-metrics-cert\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.735966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.735717 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f0f7184-7b77-4c96-84f1-c2afd6b31823-agent-certs\") pod \"konnectivity-agent-9dhrt\" (UID: \"8f0f7184-7b77-4c96-84f1-c2afd6b31823\") " pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:35.739199 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.739178 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:36:35.739199 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.739202 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:36:35.739380 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.739216 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:35.739380 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.739292 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:36:36.239271459 +0000 UTC m=+2.046391460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:35.740036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.740014 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hv4\" (UniqueName: \"kubernetes.io/projected/d503b7d7-8c76-4d1d-b44e-79c59f58d5b3-kube-api-access-x5hv4\") pod \"iptables-alerter-qs5g9\" (UID: \"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3\") " pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.740603 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.740574 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9k7x\" (UniqueName: \"kubernetes.io/projected/e009f8fe-9667-4418-80f7-ee32347895bd-kube-api-access-n9k7x\") pod \"multus-additional-cni-plugins-d2h5q\" (UID: \"e009f8fe-9667-4418-80f7-ee32347895bd\") " pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:35.741038 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.741014 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbnwq\" (UniqueName: \"kubernetes.io/projected/8d8dfbd2-9d8b-4452-89cf-4052579e643a-kube-api-access-nbnwq\") pod \"ovnkube-node-w7dxv\" (UID: \"8d8dfbd2-9d8b-4452-89cf-4052579e643a\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.741360 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.741342 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfd66\" (UniqueName: \"kubernetes.io/projected/cb884eb1-0bd9-430a-aab3-64ee2f7eeb44-kube-api-access-jfd66\") pod \"aws-ebs-csi-driver-node-2c5k7\" (UID: \"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:35.741646 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.741629 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpr5\" (UniqueName: \"kubernetes.io/projected/2c9efb83-321a-4253-8331-46bf5f49dfad-kube-api-access-nfpr5\") pod \"node-resolver-jpc2k\" (UID: \"2c9efb83-321a-4253-8331-46bf5f49dfad\") " pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.834788 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834761 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834793 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-hostroot\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834809 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-run\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834823 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-tuned\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834839 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysconfig\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834854 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysctl-conf\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834875 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-cnibin\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834883 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-hostroot\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.834898 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834946 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysconfig\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834899 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-run\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.834896 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-cni-binary-copy\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.834993 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:35.834986 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:36:36.334965632 +0000 UTC m=+2.142085627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835002 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-cnibin\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835027 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-socket-dir-parent\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835056 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-modprobe-d\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835027 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysctl-conf\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835074 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-socket-dir-parent\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835098 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysctl-d\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835119 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-kubelet\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835135 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8mth\" (UniqueName: \"kubernetes.io/projected/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-kube-api-access-s8mth\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835152 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-systemd\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835156 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-modprobe-d\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835174 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-lib-modules\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835183 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-kubelet\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835201 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-var-lib-kubelet\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835225 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-host\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835225 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-systemd\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835253 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-sysctl-d\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835281 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-var-lib-kubelet\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.835537 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835299 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-host\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835359 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-lib-modules\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835370 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92twt\" (UniqueName: \"kubernetes.io/projected/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-kube-api-access-92twt\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835399 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-os-release\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835425 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-kubernetes\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835447 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-sys\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835472 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-serviceca\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835474 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-cni-binary-copy\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835490 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-cni-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835493 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-sys\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835507 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-cni-bin\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835532 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-cni-multus\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835551 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-conf-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835557 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-cni-bin\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835573 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-etc-kubernetes\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835495 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-kubernetes\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835495 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-os-release\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835609 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5l46\" (UniqueName: \"kubernetes.io/projected/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-kube-api-access-n5l46\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836352 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835619 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-var-lib-cni-multus\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835637 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5gb5\" (UniqueName: \"kubernetes.io/projected/b956c2a7-62d8-4c70-af6e-3193e8135558-kube-api-access-m5gb5\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835641 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-conf-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835665 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-system-cni-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835685 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-etc-kubernetes\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835691 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-multus-certs\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835724 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-netns\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835753 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-host\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835766 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-system-cni-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835726 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-multus-certs\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835778 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-cni-dir\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835788 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-k8s-cni-cncf-io\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835803 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-netns\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835811 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-daemon-config\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835843 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b956c2a7-62d8-4c70-af6e-3193e8135558-host\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835848 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-host-run-k8s-cni-cncf-io\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835888 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-serviceca\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.835891 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b956c2a7-62d8-4c70-af6e-3193e8135558-tmp\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.836878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.836187 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-multus-daemon-config\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.837769 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.837750 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b956c2a7-62d8-4c70-af6e-3193e8135558-etc-tuned\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.838126 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.838108 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b956c2a7-62d8-4c70-af6e-3193e8135558-tmp\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.844325 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.844297 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5gb5\" (UniqueName: \"kubernetes.io/projected/b956c2a7-62d8-4c70-af6e-3193e8135558-kube-api-access-m5gb5\") pod \"tuned-fl9hw\" (UID: \"b956c2a7-62d8-4c70-af6e-3193e8135558\") " pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:35.844610 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.844592 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5l46\" (UniqueName: \"kubernetes.io/projected/0c5f2b6e-351e-4a27-a4eb-7653239ed80b-kube-api-access-n5l46\") pod \"multus-x5628\" (UID: \"0c5f2b6e-351e-4a27-a4eb-7653239ed80b\") " pod="openshift-multus/multus-x5628" Jun 02 16:36:35.845163 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.845143 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8mth\" (UniqueName: \"kubernetes.io/projected/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-kube-api-access-s8mth\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:35.845391 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.845375 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92twt\" (UniqueName: \"kubernetes.io/projected/00eef5d0-511c-48ae-abf3-7e83e90b0c8a-kube-api-access-92twt\") pod \"node-ca-hr2pk\" (UID: \"00eef5d0-511c-48ae-abf3-7e83e90b0c8a\") " pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:35.855485 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:35.855437 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6408636c6c698e8f71f1840d6bd7ceae.slice/crio-6d62f1adc42eb25287efcbacfce1ee8120d2def70d033c262c7b4062fca020f8 WatchSource:0}: Error finding container 6d62f1adc42eb25287efcbacfce1ee8120d2def70d033c262c7b4062fca020f8: Status 404 returned error can't find the container with id 6d62f1adc42eb25287efcbacfce1ee8120d2def70d033c262c7b4062fca020f8 Jun 02 16:36:35.855638 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:35.855617 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0821a616737b3cf9dfb29f3445b48368.slice/crio-0cd20753f6f7c656fde5b84f814f9840cbe2c996a166f9fb56bd9eb749ec3837 WatchSource:0}: Error finding container 0cd20753f6f7c656fde5b84f814f9840cbe2c996a166f9fb56bd9eb749ec3837: Status 404 returned error can't find the container with id 0cd20753f6f7c656fde5b84f814f9840cbe2c996a166f9fb56bd9eb749ec3837 Jun 02 16:36:35.859748 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.859733 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:36:35.951165 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.951128 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs5g9" Jun 02 16:36:35.957112 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:35.957091 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd503b7d7_8c76_4d1d_b44e_79c59f58d5b3.slice/crio-017a12764e29c55fb1ef2601aadbe0260a3a9339fa9410f2453e9a1401b145d5 WatchSource:0}: Error finding container 017a12764e29c55fb1ef2601aadbe0260a3a9339fa9410f2453e9a1401b145d5: Status 404 returned error can't find the container with id 017a12764e29c55fb1ef2601aadbe0260a3a9339fa9410f2453e9a1401b145d5 Jun 02 16:36:35.964791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.964776 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:36:35.970207 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:35.970188 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8dfbd2_9d8b_4452_89cf_4052579e643a.slice/crio-d9f793598476cc72054f09d35345fdabb3c9008f25c9034acf3e692c15003703 WatchSource:0}: Error finding container d9f793598476cc72054f09d35345fdabb3c9008f25c9034acf3e692c15003703: Status 404 returned error can't find the container with id d9f793598476cc72054f09d35345fdabb3c9008f25c9034acf3e692c15003703 Jun 02 16:36:35.982805 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.982788 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpc2k" Jun 02 16:36:35.988510 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:35.988488 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9efb83_321a_4253_8331_46bf5f49dfad.slice/crio-f253238f3eaad77a7ea213596571e0b5da51bed51ec3147adee0ef93e4dea76d WatchSource:0}: Error finding container f253238f3eaad77a7ea213596571e0b5da51bed51ec3147adee0ef93e4dea76d: Status 404 returned error can't find the container with id f253238f3eaad77a7ea213596571e0b5da51bed51ec3147adee0ef93e4dea76d Jun 02 16:36:35.998592 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:35.998577 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" Jun 02 16:36:36.002099 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.002081 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:36.004709 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:36.004688 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode009f8fe_9667_4418_80f7_ee32347895bd.slice/crio-5a9b99c4230a03610d90a6e0c3bb86f5406eecb3c52b33c6fee499fb6af68758 WatchSource:0}: Error finding container 5a9b99c4230a03610d90a6e0c3bb86f5406eecb3c52b33c6fee499fb6af68758: Status 404 returned error can't find the container with id 5a9b99c4230a03610d90a6e0c3bb86f5406eecb3c52b33c6fee499fb6af68758 Jun 02 16:36:36.010013 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:36.009997 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0f7184_7b77_4c96_84f1_c2afd6b31823.slice/crio-efbb4a1eaa6aeb2d8e8bbac9952522e225dc6d71ac7effaac17b43d984abf2f9 WatchSource:0}: Error finding container efbb4a1eaa6aeb2d8e8bbac9952522e225dc6d71ac7effaac17b43d984abf2f9: Status 404 returned error can't find the container with id efbb4a1eaa6aeb2d8e8bbac9952522e225dc6d71ac7effaac17b43d984abf2f9 Jun 02 16:36:36.026718 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.026698 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" Jun 02 16:36:36.032205 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:36.032181 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb884eb1_0bd9_430a_aab3_64ee2f7eeb44.slice/crio-73a380a1c54131eba9f964e13e9eaad7d7264b877e5c6c052954cceec8a2601c WatchSource:0}: Error finding container 73a380a1c54131eba9f964e13e9eaad7d7264b877e5c6c052954cceec8a2601c: Status 404 returned error can't find the container with id 73a380a1c54131eba9f964e13e9eaad7d7264b877e5c6c052954cceec8a2601c Jun 02 16:36:36.051532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.051511 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" Jun 02 16:36:36.056893 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:36.056870 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb956c2a7_62d8_4c70_af6e_3193e8135558.slice/crio-80f11eeaa0cddc5f11e99b6aa0354e06c8a20f5bc1554e6c6c3266114171ae94 WatchSource:0}: Error finding container 80f11eeaa0cddc5f11e99b6aa0354e06c8a20f5bc1554e6c6c3266114171ae94: Status 404 returned error can't find the container with id 80f11eeaa0cddc5f11e99b6aa0354e06c8a20f5bc1554e6c6c3266114171ae94 Jun 02 16:36:36.067430 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.067415 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hr2pk" Jun 02 16:36:36.071988 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.071963 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x5628" Jun 02 16:36:36.072976 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:36.072956 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eef5d0_511c_48ae_abf3_7e83e90b0c8a.slice/crio-4bdb0d394de01407be231114c325963c1823966398d74af65e207209d3cf9a2a WatchSource:0}: Error finding container 4bdb0d394de01407be231114c325963c1823966398d74af65e207209d3cf9a2a: Status 404 returned error can't find the container with id 4bdb0d394de01407be231114c325963c1823966398d74af65e207209d3cf9a2a Jun 02 16:36:36.076393 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.076377 2548 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:36:36.077729 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:36:36.077710 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5f2b6e_351e_4a27_a4eb_7653239ed80b.slice/crio-020b90573f710e1d532d4ddb57b9e12de956d73691512c979842d09fef26a6f7 WatchSource:0}: Error finding container 020b90573f710e1d532d4ddb57b9e12de956d73691512c979842d09fef26a6f7: Status 404 returned error can't find the container with id 020b90573f710e1d532d4ddb57b9e12de956d73691512c979842d09fef26a6f7 Jun 02 16:36:36.339176 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.339140 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:36.339353 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.339196 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:36.339353 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.339315 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:36.339353 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.339318 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:36:36.339353 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.339346 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:36:36.339553 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.339359 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:36.339553 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.339380 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:36:37.339361331 +0000 UTC m=+3.146481311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:36.339553 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.339406 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:36:37.339394698 +0000 UTC m=+3.146514679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:36.685855 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.685816 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:31:35 +0000 UTC" deadline="2027-11-21 17:50:57.074841947 +0000 UTC" Jun 02 16:36:36.685855 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.685853 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12889h14m20.388992691s" Jun 02 16:36:36.791533 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.791300 2548 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:36:36.796657 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.796037 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:36.796657 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:36.796165 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:36.818387 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.818302 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerStarted","Data":"5a9b99c4230a03610d90a6e0c3bb86f5406eecb3c52b33c6fee499fb6af68758"} Jun 02 16:36:36.821349 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.820869 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpc2k" event={"ID":"2c9efb83-321a-4253-8331-46bf5f49dfad","Type":"ContainerStarted","Data":"f253238f3eaad77a7ea213596571e0b5da51bed51ec3147adee0ef93e4dea76d"} Jun 02 16:36:36.841089 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.841048 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x5628" event={"ID":"0c5f2b6e-351e-4a27-a4eb-7653239ed80b","Type":"ContainerStarted","Data":"020b90573f710e1d532d4ddb57b9e12de956d73691512c979842d09fef26a6f7"} Jun 02 16:36:36.851809 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.851785 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9dhrt" event={"ID":"8f0f7184-7b77-4c96-84f1-c2afd6b31823","Type":"ContainerStarted","Data":"efbb4a1eaa6aeb2d8e8bbac9952522e225dc6d71ac7effaac17b43d984abf2f9"} Jun 02 16:36:36.866841 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.866821 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"d9f793598476cc72054f09d35345fdabb3c9008f25c9034acf3e692c15003703"} Jun 02 16:36:36.893141 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.893116 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs5g9" event={"ID":"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3","Type":"ContainerStarted","Data":"017a12764e29c55fb1ef2601aadbe0260a3a9339fa9410f2453e9a1401b145d5"} Jun 02 16:36:36.915992 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.915968 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" event={"ID":"6408636c6c698e8f71f1840d6bd7ceae","Type":"ContainerStarted","Data":"6d62f1adc42eb25287efcbacfce1ee8120d2def70d033c262c7b4062fca020f8"} Jun 02 16:36:36.927409 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.927364 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" event={"ID":"0821a616737b3cf9dfb29f3445b48368","Type":"ContainerStarted","Data":"0cd20753f6f7c656fde5b84f814f9840cbe2c996a166f9fb56bd9eb749ec3837"} Jun 02 16:36:36.944369 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.944308 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hr2pk" event={"ID":"00eef5d0-511c-48ae-abf3-7e83e90b0c8a","Type":"ContainerStarted","Data":"4bdb0d394de01407be231114c325963c1823966398d74af65e207209d3cf9a2a"} Jun 02 16:36:36.953031 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.953007 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" event={"ID":"b956c2a7-62d8-4c70-af6e-3193e8135558","Type":"ContainerStarted","Data":"80f11eeaa0cddc5f11e99b6aa0354e06c8a20f5bc1554e6c6c3266114171ae94"} Jun 02 16:36:36.980613 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:36.980564 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" event={"ID":"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44","Type":"ContainerStarted","Data":"73a380a1c54131eba9f964e13e9eaad7d7264b877e5c6c052954cceec8a2601c"} Jun 02 16:36:37.023512 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:37.023482 2548 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:36:37.347101 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:37.346906 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:37.347817 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.347384 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:37.347817 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.347456 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:36:39.347435019 +0000 UTC m=+5.154555001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:37.348386 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:37.347982 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:37.348386 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.348165 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:36:37.348386 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.348184 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:36:37.348386 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.348201 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:37.348386 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.348247 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:36:39.348232972 +0000 UTC m=+5.155352960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:37.686177 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:37.686054 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:31:35 +0000 UTC" deadline="2027-12-24 07:49:28.701489534 +0000 UTC" Jun 02 16:36:37.686177 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:37.686092 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13671h12m51.015400902s" Jun 02 16:36:37.779535 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:37.779066 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:37.779535 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:37.779180 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:38.783868 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:38.783401 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:38.783868 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:38.783533 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:39.364420 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:39.364464 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.364600 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.364660 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:36:43.364640898 +0000 UTC m=+9.171760883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.364737 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.364751 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.364764 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:39.364866 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.364813 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:36:43.364800824 +0000 UTC m=+9.171920809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:39.779087 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:39.779000 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:39.779261 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:39.779112 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:40.779547 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:40.779511 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:40.780032 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:40.779657 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:41.778973 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:41.778941 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:41.779159 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:41.779069 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:42.778931 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:42.778891 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:42.779267 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:42.779015 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:43.396593 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:43.396554 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:43.396772 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:43.396609 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:43.396772 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.396731 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:36:43.396772 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.396758 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:36:43.396772 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.396762 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:43.396772 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.396770 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:43.397093 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.396849 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:36:51.396804692 +0000 UTC m=+17.203924675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:43.397093 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.396869 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:36:51.396857994 +0000 UTC m=+17.203977980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:43.778632 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:43.778553 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:43.778784 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:43.778679 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:44.779655 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:44.779541 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:44.780962 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:44.780635 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:45.779313 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:45.779276 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:45.779563 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:45.779409 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:46.778754 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:46.778681 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:46.779189 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:46.778813 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:47.779580 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:47.779362 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:47.779580 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:47.779482 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:48.778992 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:48.778955 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:48.779169 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:48.779080 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:49.778689 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:49.778659 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:49.779112 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:49.778764 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:50.779632 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:50.779595 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:50.780063 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:50.779739 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:51.456941 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:51.456892 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:51.457155 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:51.456952 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:51.457155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.457033 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:36:51.457155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.457062 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:36:51.457155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.457075 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:51.457155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.457119 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:51.457155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.457143 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:37:07.457126511 +0000 UTC m=+33.264246492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:36:51.457449 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.457179 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:37:07.457161739 +0000 UTC m=+33.264281721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:36:51.779151 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:51.779071 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:51.779393 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:51.779192 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:52.779792 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:52.779546 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:52.780267 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:52.779904 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:53.779224 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:53.779193 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:53.779421 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:53.779317 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:54.780214 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:54.780193 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:54.780607 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:54.780307 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:55.030708 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.030299 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" event={"ID":"b956c2a7-62d8-4c70-af6e-3193e8135558","Type":"ContainerStarted","Data":"ad454bd2edcbe71f59f4235c39dc19a5ceba2314ba18d000d751d16f4d75840e"} Jun 02 16:36:55.036193 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.035816 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x5628" event={"ID":"0c5f2b6e-351e-4a27-a4eb-7653239ed80b","Type":"ContainerStarted","Data":"2eaaf303dc8aae151c1c7f62e9df066a3ccceaa76c6bd9f0c8831a0ac0ed74a2"} Jun 02 16:36:55.050613 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.049362 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fl9hw" podStartSLOduration=1.7141246350000001 podStartE2EDuration="20.04932418s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:36:36.058259111 +0000 UTC m=+1.865379091" lastFinishedPulling="2026-06-02 16:36:54.39345865 +0000 UTC m=+20.200578636" observedRunningTime="2026-06-02 16:36:55.049046157 +0000 UTC m=+20.856166159" watchObservedRunningTime="2026-06-02 16:36:55.04932418 +0000 UTC m=+20.856444184" Jun 02 16:36:55.054747 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.054724 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:36:55.055213 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.055185 2548 generic.go:358] "Generic (PLEG): container finished" podID="8d8dfbd2-9d8b-4452-89cf-4052579e643a" containerID="b8e17461375a8a390944d9556e6f107bcbbda2f297109b20ed0dfd67d296ef8a" exitCode=1 Jun 02 16:36:55.055291 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.055265 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"6b65f28786eeaf1119d0be2388d79be275817f17304a3088daa648e3e5df0b02"} Jun 02 16:36:55.055291 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.055287 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"e4745ac4c7f208b5936a182fb2a3d54ba8c110db3ac3e6c830fd0c2947651d3a"} Jun 02 16:36:55.055365 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.055301 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"47375e0938a1440abe0dd174ca359c274d2abc733cf402231aaef0fe1d46b857"} Jun 02 16:36:55.055365 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.055315 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerDied","Data":"b8e17461375a8a390944d9556e6f107bcbbda2f297109b20ed0dfd67d296ef8a"} Jun 02 16:36:55.055365 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.055337 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"af8c774a4b329cd3c50fa4b244d630709752b359a8a41ecf0211f28fcd0ceece"} Jun 02 16:36:55.066559 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.066138 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" event={"ID":"0821a616737b3cf9dfb29f3445b48368","Type":"ContainerStarted","Data":"7c620cefa964e72b01354a2a57b04dc534b7ba081a3776256685bb00a8095134"} Jun 02 16:36:55.080584 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.080545 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-x5628" podStartSLOduration=1.328983091 podStartE2EDuration="20.080531534s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:36:36.079150686 +0000 UTC m=+1.886270665" lastFinishedPulling="2026-06-02 16:36:54.830699128 +0000 UTC m=+20.637819108" observedRunningTime="2026-06-02 16:36:55.067985273 +0000 UTC m=+20.875105280" watchObservedRunningTime="2026-06-02 16:36:55.080531534 +0000 UTC m=+20.887651537" Jun 02 16:36:55.080709 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.080679 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-221.ec2.internal" podStartSLOduration=20.080672901 podStartE2EDuration="20.080672901s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:36:55.0803778 +0000 UTC m=+20.887497805" watchObservedRunningTime="2026-06-02 16:36:55.080672901 +0000 UTC m=+20.887792904" Jun 02 16:36:55.778949 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:55.778771 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:55.779076 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:55.779037 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:56.068868 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.068789 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs5g9" event={"ID":"d503b7d7-8c76-4d1d-b44e-79c59f58d5b3","Type":"ContainerStarted","Data":"e50616f059dc53a92651f1108bbd9eda4b9b96176ec143de4d1752104e979408"} Jun 02 16:36:56.070188 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.070167 2548 generic.go:358] "Generic (PLEG): container finished" podID="6408636c6c698e8f71f1840d6bd7ceae" containerID="0f2217f852e58a29d1df3ae1ceddd83094269747bc094064f6d98ce2b1574cb1" exitCode=0 Jun 02 16:36:56.070247 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.070231 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" event={"ID":"6408636c6c698e8f71f1840d6bd7ceae","Type":"ContainerDied","Data":"0f2217f852e58a29d1df3ae1ceddd83094269747bc094064f6d98ce2b1574cb1"} Jun 02 16:36:56.071445 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.071424 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hr2pk" event={"ID":"00eef5d0-511c-48ae-abf3-7e83e90b0c8a","Type":"ContainerStarted","Data":"cb8ec09998f229e4c54ce79f8be1f077ee14641ef3cf42a31d721292aad3a124"} Jun 02 16:36:56.072632 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.072610 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" event={"ID":"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44","Type":"ContainerStarted","Data":"ea29e60eb9d1ce76850ddfe6285eaa2497ef780c6bff1de8472e3972de42f099"} Jun 02 16:36:56.073877 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.073856 2548 generic.go:358] "Generic (PLEG): container finished" podID="e009f8fe-9667-4418-80f7-ee32347895bd" containerID="9cb4b231929f480d4b912686a29c9d74b3e5e7514c16874c94e8499cce08e30a" exitCode=0 Jun 02 16:36:56.073966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.073934 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerDied","Data":"9cb4b231929f480d4b912686a29c9d74b3e5e7514c16874c94e8499cce08e30a"} Jun 02 16:36:56.075105 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.075009 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpc2k" event={"ID":"2c9efb83-321a-4253-8331-46bf5f49dfad","Type":"ContainerStarted","Data":"0da489fa21583a782902a17d0e9c38aa00d0a963dc8dc678158a6e6c51b58652"} Jun 02 16:36:56.076273 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.076250 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9dhrt" event={"ID":"8f0f7184-7b77-4c96-84f1-c2afd6b31823","Type":"ContainerStarted","Data":"c52c0caacbbe9c826bf0c967219fdc4d62c9973ef53aa0a1a9e9b6e2688a9bf8"} Jun 02 16:36:56.078561 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.078546 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:36:56.078814 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.078798 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"b441fa72c720c5d3a33bce8c4284827522a0fb093ee61cc6488f05c8cae77ba3"} Jun 02 16:36:56.085690 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.085650 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qs5g9" podStartSLOduration=3.666696912 podStartE2EDuration="22.085615474s" podCreationTimestamp="2026-06-02 16:36:34 +0000 UTC" firstStartedPulling="2026-06-02 16:36:35.958547308 +0000 UTC m=+1.765667288" lastFinishedPulling="2026-06-02 16:36:54.37746587 +0000 UTC m=+20.184585850" observedRunningTime="2026-06-02 16:36:56.085213181 +0000 UTC m=+21.892333177" watchObservedRunningTime="2026-06-02 16:36:56.085615474 +0000 UTC m=+21.892735476" Jun 02 16:36:56.117746 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.117712 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hr2pk" podStartSLOduration=2.831498926 podStartE2EDuration="21.117698108s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:36:36.074935329 +0000 UTC m=+1.882055309" lastFinishedPulling="2026-06-02 16:36:54.361134508 +0000 UTC m=+20.168254491" observedRunningTime="2026-06-02 16:36:56.102356289 +0000 UTC m=+21.909476296" watchObservedRunningTime="2026-06-02 16:36:56.117698108 +0000 UTC m=+21.924818115" Jun 02 16:36:56.168888 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.168849 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jpc2k" podStartSLOduration=3.797422644 podStartE2EDuration="22.16883915s" podCreationTimestamp="2026-06-02 16:36:34 +0000 UTC" firstStartedPulling="2026-06-02 16:36:35.989732552 +0000 UTC m=+1.796852535" lastFinishedPulling="2026-06-02 16:36:54.361149046 +0000 UTC m=+20.168269041" observedRunningTime="2026-06-02 16:36:56.155334663 +0000 UTC m=+21.962454648" watchObservedRunningTime="2026-06-02 16:36:56.16883915 +0000 UTC m=+21.975959152" Jun 02 16:36:56.169198 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.169171 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9dhrt" podStartSLOduration=2.804059533 podStartE2EDuration="21.169165163s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:36:36.012368643 +0000 UTC m=+1.819488626" lastFinishedPulling="2026-06-02 16:36:54.377474265 +0000 UTC m=+20.184594256" observedRunningTime="2026-06-02 16:36:56.168628329 +0000 UTC m=+21.975748331" watchObservedRunningTime="2026-06-02 16:36:56.169165163 +0000 UTC m=+21.976285164" Jun 02 16:36:56.261972 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.261952 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 16:36:56.703092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.703002 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T16:36:56.2619679Z","UUID":"9f899bab-ac0d-4843-887d-8101ade1889c","Handler":null,"Name":"","Endpoint":""} Jun 02 16:36:56.706538 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.706265 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 16:36:56.706538 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.706291 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 16:36:56.779563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:56.779537 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:56.779703 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:56.779670 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:57.081779 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:57.081707 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" event={"ID":"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44","Type":"ContainerStarted","Data":"fe80de87a15621dde14c422d772273b21c5a63c963b7c4a6b15c989eba92eaf0"} Jun 02 16:36:57.083269 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:57.083245 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" event={"ID":"6408636c6c698e8f71f1840d6bd7ceae","Type":"ContainerStarted","Data":"0c30013ae9f9488317135c65f5894d3957eace33e00f0eaf9b402dbce4b4c3a5"} Jun 02 16:36:57.100028 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:57.099986 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-221.ec2.internal" podStartSLOduration=22.099970782 podStartE2EDuration="22.099970782s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:36:57.099442687 +0000 UTC m=+22.906562688" watchObservedRunningTime="2026-06-02 16:36:57.099970782 +0000 UTC m=+22.907090785" Jun 02 16:36:57.779360 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:57.779315 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:57.779533 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:57.779430 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:36:57.783487 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:57.783464 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:57.784479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:57.784462 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:36:58.086891 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:58.086814 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" event={"ID":"cb884eb1-0bd9-430a-aab3-64ee2f7eeb44","Type":"ContainerStarted","Data":"37d53ca4581b830d123562ccc18ce7f749198a9dc33820632718d40405491049"} Jun 02 16:36:58.089209 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:58.089190 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:36:58.089552 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:58.089532 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"21f9200d2dbff0c808b659e9fe9de0c8e614425637feb65eb9286c1629336b55"} Jun 02 16:36:58.106183 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:58.104598 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2c5k7" podStartSLOduration=2.029680451 podStartE2EDuration="23.104579536s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:36:36.033644274 +0000 UTC m=+1.840764255" lastFinishedPulling="2026-06-02 16:36:57.108543352 +0000 UTC m=+22.915663340" observedRunningTime="2026-06-02 16:36:58.103989058 +0000 UTC m=+23.911109057" watchObservedRunningTime="2026-06-02 16:36:58.104579536 +0000 UTC m=+23.911699539" Jun 02 16:36:58.779119 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:58.779088 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:36:58.779295 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:58.779215 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:36:58.856430 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:58.856409 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpc2k_2c9efb83-321a-4253-8331-46bf5f49dfad/dns-node-resolver/0.log" Jun 02 16:36:59.091039 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:59.090841 2548 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:36:59.467089 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:59.467063 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hr2pk_00eef5d0-511c-48ae-abf3-7e83e90b0c8a/node-ca/0.log" Jun 02 16:36:59.779656 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:36:59.779574 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:36:59.779880 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:36:59.779695 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:00.094858 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.094788 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:37:00.095720 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.095081 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"02a79b9610adeb154c69e65db27cbe520d953cf710c4c593e5c15a3ba99e6cd3"} Jun 02 16:37:00.095720 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.095401 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:37:00.095720 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.095507 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:37:00.095720 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.095531 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:37:00.095720 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.095631 2548 scope.go:117] "RemoveContainer" containerID="b8e17461375a8a390944d9556e6f107bcbbda2f297109b20ed0dfd67d296ef8a" Jun 02 16:37:00.111186 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.111166 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:37:00.112129 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.112113 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:37:00.778909 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:00.778731 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:00.779088 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:00.779033 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:01.101004 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.100970 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:37:01.101423 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.101399 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" event={"ID":"8d8dfbd2-9d8b-4452-89cf-4052579e643a","Type":"ContainerStarted","Data":"e0fdb849489bc25c7fdfc0efd2d3b578e8cbba7f6e26fbeadc0bf54565cbdf36"} Jun 02 16:37:01.234641 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.234580 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" podStartSLOduration=8.768783391 podStartE2EDuration="27.234559238s" podCreationTimestamp="2026-06-02 16:36:34 +0000 UTC" firstStartedPulling="2026-06-02 16:36:35.971648139 +0000 UTC m=+1.778768119" lastFinishedPulling="2026-06-02 16:36:54.437423986 +0000 UTC m=+20.244543966" observedRunningTime="2026-06-02 16:37:01.132449725 +0000 UTC m=+26.939569727" watchObservedRunningTime="2026-06-02 16:37:01.234559238 +0000 UTC m=+27.041679253" Jun 02 16:37:01.235667 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.235500 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lngf"] Jun 02 16:37:01.235667 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.235636 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:01.235999 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:01.235731 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:01.236303 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.236276 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lpdvk"] Jun 02 16:37:01.236422 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:01.236384 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:01.236507 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:01.236487 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:02.778884 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:02.778854 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:02.779258 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:02.778859 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:02.779258 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:02.778997 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:02.779258 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:02.779031 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:02.873364 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:02.873338 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:37:02.873490 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:02.873457 2548 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:37:02.874013 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:02.873997 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9dhrt" Jun 02 16:37:03.107230 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:03.107148 2548 generic.go:358] "Generic (PLEG): container finished" podID="e009f8fe-9667-4418-80f7-ee32347895bd" containerID="89338a4ae1c71d847d6ca8911a5fb49123d45d79adb7e31548d03eef341c7b2a" exitCode=0 Jun 02 16:37:03.107367 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:03.107234 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerDied","Data":"89338a4ae1c71d847d6ca8911a5fb49123d45d79adb7e31548d03eef341c7b2a"} Jun 02 16:37:04.110672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:04.110600 2548 generic.go:358] "Generic (PLEG): container finished" podID="e009f8fe-9667-4418-80f7-ee32347895bd" containerID="18df6fe46bc3d13871bfc55da83d39a8fee83d0fe475134d1fec6d6663dfa838" exitCode=0 Jun 02 16:37:04.110672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:04.110665 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerDied","Data":"18df6fe46bc3d13871bfc55da83d39a8fee83d0fe475134d1fec6d6663dfa838"} Jun 02 16:37:04.780032 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:04.780005 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:04.780209 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:04.780097 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:04.780209 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:04.780133 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:04.780209 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:04.780189 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:05.114553 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:05.114525 2548 generic.go:358] "Generic (PLEG): container finished" podID="e009f8fe-9667-4418-80f7-ee32347895bd" containerID="e8867f1a939d7cab688c0d2fe81d77568b1e13406405858112a14bfd9c8223e6" exitCode=0 Jun 02 16:37:05.114975 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:05.114580 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerDied","Data":"e8867f1a939d7cab688c0d2fe81d77568b1e13406405858112a14bfd9c8223e6"} Jun 02 16:37:06.778597 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:06.778564 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:06.778597 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:06.778602 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:06.779072 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:06.778688 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:06.779072 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:06.778791 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:07.483564 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:07.483532 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:07.483564 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:07.483568 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:07.483761 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:07.483691 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:37:07.483761 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:07.483710 2548 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:37:07.483761 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:07.483720 2548 projected.go:194] Error preparing data for projected volume kube-api-access-w5dld for pod openshift-network-diagnostics/network-check-target-7lngf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:37:07.483761 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:07.483722 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:37:07.483874 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:07.483770 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs podName:3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1 nodeName:}" failed. No retries permitted until 2026-06-02 16:37:39.483756455 +0000 UTC m=+65.290876435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs") pod "network-metrics-daemon-lpdvk" (UID: "3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:37:07.483874 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:07.483784 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld podName:e735f456-faa7-4b7d-913d-847d1a4eb70e nodeName:}" failed. No retries permitted until 2026-06-02 16:37:39.483777557 +0000 UTC m=+65.290897537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5dld" (UniqueName: "kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld") pod "network-check-target-7lngf" (UID: "e735f456-faa7-4b7d-913d-847d1a4eb70e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:37:08.779028 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:08.779003 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:08.779392 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:08.779089 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:08.779392 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:08.779180 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:08.779392 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:08.779298 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:10.779601 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:10.779567 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:10.779601 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:10.779590 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:10.780413 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:10.779691 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:10.780413 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:10.779844 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:12.130151 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:12.130117 2548 generic.go:358] "Generic (PLEG): container finished" podID="e009f8fe-9667-4418-80f7-ee32347895bd" containerID="323e2ee59b59910c5d089f3d03ceb5ef0825def179c83a0424608a3fe624b84e" exitCode=0 Jun 02 16:37:12.130521 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:12.130184 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerDied","Data":"323e2ee59b59910c5d089f3d03ceb5ef0825def179c83a0424608a3fe624b84e"} Jun 02 16:37:12.778973 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:12.778946 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:12.778973 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:12.778962 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:12.779155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:12.779036 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:12.779155 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:12.779106 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:13.135861 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:13.135770 2548 generic.go:358] "Generic (PLEG): container finished" podID="e009f8fe-9667-4418-80f7-ee32347895bd" containerID="eab9c75d9d843117a04ca401bd14cb65f4efbfd8ef9b791f7d13824bd2697531" exitCode=0 Jun 02 16:37:13.135861 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:13.135830 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerDied","Data":"eab9c75d9d843117a04ca401bd14cb65f4efbfd8ef9b791f7d13824bd2697531"} Jun 02 16:37:14.141523 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:14.141490 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" event={"ID":"e009f8fe-9667-4418-80f7-ee32347895bd","Type":"ContainerStarted","Data":"7d40a999893e0ccbfe49a6a80a39a03a08cbe914381489a734351a6d1b383005"} Jun 02 16:37:14.779988 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:14.779958 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:14.780156 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:14.780031 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:14.780156 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:14.779959 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:14.780283 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:14.780157 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:16.779587 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:16.779556 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:16.780045 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:16.779556 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:16.780045 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:16.779702 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:16.780045 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:16.779738 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:18.778770 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:18.778738 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:18.779150 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:18.778744 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:18.779150 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:18.778831 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpdvk" podUID="3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1" Jun 02 16:37:18.779150 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:18.778907 2548 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lngf" podUID="e735f456-faa7-4b7d-913d-847d1a4eb70e" Jun 02 16:37:20.485222 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.485199 2548 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-221.ec2.internal" event="NodeReady" Jun 02 16:37:20.485554 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.485301 2548 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 16:37:20.533843 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.533797 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d2h5q" podStartSLOduration=10.447821638 podStartE2EDuration="45.533784388s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:36:36.008278226 +0000 UTC m=+1.815398205" lastFinishedPulling="2026-06-02 16:37:11.094240967 +0000 UTC m=+36.901360955" observedRunningTime="2026-06-02 16:37:14.163219319 +0000 UTC m=+39.970339320" watchObservedRunningTime="2026-06-02 16:37:20.533784388 +0000 UTC m=+46.340904390" Jun 02 16:37:20.534505 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.534435 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4gcpd"] Jun 02 16:37:20.584686 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.584657 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jphqf"] Jun 02 16:37:20.584821 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.584806 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.586926 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.586891 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cf2c\" (UniqueName: \"kubernetes.io/projected/bbf6b027-67b7-4160-87f5-b48459036201-kube-api-access-4cf2c\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.587036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.586906 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 16:37:20.587036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.586953 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf6b027-67b7-4160-87f5-b48459036201-metrics-tls\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.587036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.586986 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf6b027-67b7-4160-87f5-b48459036201-config-volume\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.587036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.587008 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbf6b027-67b7-4160-87f5-b48459036201-tmp-dir\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.587170 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.587069 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 16:37:20.587214 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.587200 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mggqp\"" Jun 02 16:37:20.598045 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.598031 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4gcpd"] Jun 02 16:37:20.598119 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.598051 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jphqf"] Jun 02 16:37:20.598155 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.598134 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.600686 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.600642 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 16:37:20.600862 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.600685 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 16:37:20.600862 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.600793 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 16:37:20.601124 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.601104 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 16:37:20.601219 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.601184 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wgvsj\"" Jun 02 16:37:20.638934 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.638892 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kp9qm"] Jun 02 16:37:20.660372 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.660348 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kp9qm"] Jun 02 16:37:20.660462 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.660437 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.663711 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.663690 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 16:37:20.663844 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.663813 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 16:37:20.663964 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.663949 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gvcdv\"" Jun 02 16:37:20.664249 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.664235 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 16:37:20.687878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.687857 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf6b027-67b7-4160-87f5-b48459036201-config-volume\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.687989 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.687886 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbf6b027-67b7-4160-87f5-b48459036201-tmp-dir\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.687989 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.687943 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cf2c\" (UniqueName: \"kubernetes.io/projected/bbf6b027-67b7-4160-87f5-b48459036201-kube-api-access-4cf2c\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.687989 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.687972 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf6b027-67b7-4160-87f5-b48459036201-metrics-tls\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.688274 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.688256 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbf6b027-67b7-4160-87f5-b48459036201-tmp-dir\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.688343 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.688326 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf6b027-67b7-4160-87f5-b48459036201-config-volume\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.691569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.691554 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf6b027-67b7-4160-87f5-b48459036201-metrics-tls\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.696562 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.696539 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cf2c\" (UniqueName: \"kubernetes.io/projected/bbf6b027-67b7-4160-87f5-b48459036201-kube-api-access-4cf2c\") pod \"dns-default-4gcpd\" (UID: \"bbf6b027-67b7-4160-87f5-b48459036201\") " pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.778990 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.778958 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:20.779101 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.778993 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:20.781376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.781353 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:37:20.781376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.781353 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6zch7\"" Jun 02 16:37:20.781548 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.781379 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:37:20.781548 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.781446 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dncvr\"" Jun 02 16:37:20.781701 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.781686 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:37:20.788623 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788605 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccf0fc42-7d80-4b74-ab2f-5daadddfdecb-cert\") pod \"ingress-canary-kp9qm\" (UID: \"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb\") " pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.788739 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788665 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7704113d-8f4e-4022-ad34-56efc7f69bcc-data-volume\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.788739 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788693 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7704113d-8f4e-4022-ad34-56efc7f69bcc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.788739 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788718 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtxw\" (UniqueName: \"kubernetes.io/projected/7704113d-8f4e-4022-ad34-56efc7f69bcc-kube-api-access-vjtxw\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.788867 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788742 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7704113d-8f4e-4022-ad34-56efc7f69bcc-crio-socket\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.788867 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788786 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g4m4\" (UniqueName: \"kubernetes.io/projected/ccf0fc42-7d80-4b74-ab2f-5daadddfdecb-kube-api-access-5g4m4\") pod \"ingress-canary-kp9qm\" (UID: \"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb\") " pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.788867 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.788835 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7704113d-8f4e-4022-ad34-56efc7f69bcc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.889756 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889731 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7704113d-8f4e-4022-ad34-56efc7f69bcc-data-volume\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.889756 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889756 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7704113d-8f4e-4022-ad34-56efc7f69bcc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.889959 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889774 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtxw\" (UniqueName: \"kubernetes.io/projected/7704113d-8f4e-4022-ad34-56efc7f69bcc-kube-api-access-vjtxw\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.889959 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889794 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7704113d-8f4e-4022-ad34-56efc7f69bcc-crio-socket\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.889959 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889821 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5g4m4\" (UniqueName: \"kubernetes.io/projected/ccf0fc42-7d80-4b74-ab2f-5daadddfdecb-kube-api-access-5g4m4\") pod \"ingress-canary-kp9qm\" (UID: \"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb\") " pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.889959 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889907 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7704113d-8f4e-4022-ad34-56efc7f69bcc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.890248 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.889971 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccf0fc42-7d80-4b74-ab2f-5daadddfdecb-cert\") pod \"ingress-canary-kp9qm\" (UID: \"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb\") " pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.890248 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.890154 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7704113d-8f4e-4022-ad34-56efc7f69bcc-crio-socket\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.890351 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.890257 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7704113d-8f4e-4022-ad34-56efc7f69bcc-data-volume\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.890505 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.890486 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7704113d-8f4e-4022-ad34-56efc7f69bcc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.892161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.892134 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7704113d-8f4e-4022-ad34-56efc7f69bcc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.892254 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.892208 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccf0fc42-7d80-4b74-ab2f-5daadddfdecb-cert\") pod \"ingress-canary-kp9qm\" (UID: \"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb\") " pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.894058 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.894042 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:20.901597 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.901578 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtxw\" (UniqueName: \"kubernetes.io/projected/7704113d-8f4e-4022-ad34-56efc7f69bcc-kube-api-access-vjtxw\") pod \"insights-runtime-extractor-jphqf\" (UID: \"7704113d-8f4e-4022-ad34-56efc7f69bcc\") " pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.901959 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.901943 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g4m4\" (UniqueName: \"kubernetes.io/projected/ccf0fc42-7d80-4b74-ab2f-5daadddfdecb-kube-api-access-5g4m4\") pod \"ingress-canary-kp9qm\" (UID: \"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb\") " pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:20.905720 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.905697 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jphqf" Jun 02 16:37:20.968375 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:20.968336 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kp9qm" Jun 02 16:37:21.089514 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:21.089468 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jphqf"] Jun 02 16:37:21.094862 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:21.094837 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7704113d_8f4e_4022_ad34_56efc7f69bcc.slice/crio-87bff8a5021a540fd26a5fb65a686a46bb815e2057077dc5cfc97fee3c9fb5dc WatchSource:0}: Error finding container 87bff8a5021a540fd26a5fb65a686a46bb815e2057077dc5cfc97fee3c9fb5dc: Status 404 returned error can't find the container with id 87bff8a5021a540fd26a5fb65a686a46bb815e2057077dc5cfc97fee3c9fb5dc Jun 02 16:37:21.096812 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:21.096788 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4gcpd"] Jun 02 16:37:21.100433 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:21.100410 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf6b027_67b7_4160_87f5_b48459036201.slice/crio-a62dae42553fa1e7fda879ac587be997c941e92dba7f1a752428ac483c709a0b WatchSource:0}: Error finding container a62dae42553fa1e7fda879ac587be997c941e92dba7f1a752428ac483c709a0b: Status 404 returned error can't find the container with id a62dae42553fa1e7fda879ac587be997c941e92dba7f1a752428ac483c709a0b Jun 02 16:37:21.130289 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:21.130250 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kp9qm"] Jun 02 16:37:21.134537 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:21.134511 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf0fc42_7d80_4b74_ab2f_5daadddfdecb.slice/crio-27c1c24a9308280674c1c87015dbfca4fbc8bc8de2e1c4a87d3a32282011be33 WatchSource:0}: Error finding container 27c1c24a9308280674c1c87015dbfca4fbc8bc8de2e1c4a87d3a32282011be33: Status 404 returned error can't find the container with id 27c1c24a9308280674c1c87015dbfca4fbc8bc8de2e1c4a87d3a32282011be33 Jun 02 16:37:21.154644 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:21.154612 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jphqf" event={"ID":"7704113d-8f4e-4022-ad34-56efc7f69bcc","Type":"ContainerStarted","Data":"87bff8a5021a540fd26a5fb65a686a46bb815e2057077dc5cfc97fee3c9fb5dc"} Jun 02 16:37:21.155595 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:21.155573 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gcpd" event={"ID":"bbf6b027-67b7-4160-87f5-b48459036201","Type":"ContainerStarted","Data":"a62dae42553fa1e7fda879ac587be997c941e92dba7f1a752428ac483c709a0b"} Jun 02 16:37:21.156534 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:21.156516 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kp9qm" event={"ID":"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb","Type":"ContainerStarted","Data":"27c1c24a9308280674c1c87015dbfca4fbc8bc8de2e1c4a87d3a32282011be33"} Jun 02 16:37:22.163381 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:22.163344 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jphqf" event={"ID":"7704113d-8f4e-4022-ad34-56efc7f69bcc","Type":"ContainerStarted","Data":"545839054fd6c4ba0931cd4fc2e0097a54c63e1895ade9aa523fd139406d96c7"} Jun 02 16:37:24.169986 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.169950 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gcpd" event={"ID":"bbf6b027-67b7-4160-87f5-b48459036201","Type":"ContainerStarted","Data":"a88cb58fc28a155b3ac8cd0c96e50c2b02ad1455a4558fb30821497e6a8834e4"} Jun 02 16:37:24.169986 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.169984 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gcpd" event={"ID":"bbf6b027-67b7-4160-87f5-b48459036201","Type":"ContainerStarted","Data":"f417a141f9c9096e4f18a28fcf57f1909791e13900b18e00c5a83af659c7cdce"} Jun 02 16:37:24.170482 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.170061 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:24.171473 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.171440 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kp9qm" event={"ID":"ccf0fc42-7d80-4b74-ab2f-5daadddfdecb","Type":"ContainerStarted","Data":"164625ecf61baf8cb26cf6e1bfcdceaadb1216b0f7cb3aff5ac75db82db8c609"} Jun 02 16:37:24.173110 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.173084 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jphqf" event={"ID":"7704113d-8f4e-4022-ad34-56efc7f69bcc","Type":"ContainerStarted","Data":"f99e476de49f547c8454d359ef2c6b3e1af85da558894f4889bb85a5144531a1"} Jun 02 16:37:24.187490 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.187448 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4gcpd" podStartSLOduration=1.824560397 podStartE2EDuration="4.187431913s" podCreationTimestamp="2026-06-02 16:37:20 +0000 UTC" firstStartedPulling="2026-06-02 16:37:21.102162079 +0000 UTC m=+46.909282067" lastFinishedPulling="2026-06-02 16:37:23.465033591 +0000 UTC m=+49.272153583" observedRunningTime="2026-06-02 16:37:24.186176329 +0000 UTC m=+49.993296330" watchObservedRunningTime="2026-06-02 16:37:24.187431913 +0000 UTC m=+49.994551916" Jun 02 16:37:24.200345 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:24.200311 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kp9qm" podStartSLOduration=1.86745104 podStartE2EDuration="4.200295569s" podCreationTimestamp="2026-06-02 16:37:20 +0000 UTC" firstStartedPulling="2026-06-02 16:37:21.136479595 +0000 UTC m=+46.943599579" lastFinishedPulling="2026-06-02 16:37:23.469324128 +0000 UTC m=+49.276444108" observedRunningTime="2026-06-02 16:37:24.199585983 +0000 UTC m=+50.006705985" watchObservedRunningTime="2026-06-02 16:37:24.200295569 +0000 UTC m=+50.007415572" Jun 02 16:37:26.179930 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:26.179892 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jphqf" event={"ID":"7704113d-8f4e-4022-ad34-56efc7f69bcc","Type":"ContainerStarted","Data":"546c5ad9a1afb3e369c210abd2884933c2ccda39ea798248bc1fa0207054ddef"} Jun 02 16:37:26.195771 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:26.195727 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jphqf" podStartSLOduration=2.063947883 podStartE2EDuration="6.195713842s" podCreationTimestamp="2026-06-02 16:37:20 +0000 UTC" firstStartedPulling="2026-06-02 16:37:21.190968707 +0000 UTC m=+46.998088704" lastFinishedPulling="2026-06-02 16:37:25.322734684 +0000 UTC m=+51.129854663" observedRunningTime="2026-06-02 16:37:26.195469288 +0000 UTC m=+52.002589302" watchObservedRunningTime="2026-06-02 16:37:26.195713842 +0000 UTC m=+52.002833844" Jun 02 16:37:32.115355 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:32.115301 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7dxv" Jun 02 16:37:34.177691 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:34.177657 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4gcpd" Jun 02 16:37:39.501089 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.501048 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:39.501089 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.501087 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:39.504071 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.504050 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:37:39.504531 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.504514 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:37:39.513448 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.513420 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:37:39.513628 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.513607 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1-metrics-certs\") pod \"network-metrics-daemon-lpdvk\" (UID: \"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1\") " pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:39.523802 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.523774 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dld\" (UniqueName: \"kubernetes.io/projected/e735f456-faa7-4b7d-913d-847d1a4eb70e-kube-api-access-w5dld\") pod \"network-check-target-7lngf\" (UID: \"e735f456-faa7-4b7d-913d-847d1a4eb70e\") " pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:39.690514 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.690489 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6zch7\"" Jun 02 16:37:39.695481 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.695464 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dncvr\"" Jun 02 16:37:39.699279 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.699267 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:39.704348 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.704332 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpdvk" Jun 02 16:37:39.836215 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.836190 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lngf"] Jun 02 16:37:39.839089 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:39.839061 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode735f456_faa7_4b7d_913d_847d1a4eb70e.slice/crio-8533c2aed73c2b186167eccbaf88bccbfc3130e003c545af58e5576eefaf9d7b WatchSource:0}: Error finding container 8533c2aed73c2b186167eccbaf88bccbfc3130e003c545af58e5576eefaf9d7b: Status 404 returned error can't find the container with id 8533c2aed73c2b186167eccbaf88bccbfc3130e003c545af58e5576eefaf9d7b Jun 02 16:37:39.853281 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:39.853257 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lpdvk"] Jun 02 16:37:39.856166 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:39.856142 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6d2c4d_a143_4b51_b8ff_473e5b82f2d1.slice/crio-da5cd02aceaee63360fe578b876abe2d763f8848e56696f79edcf75a8ad9266d WatchSource:0}: Error finding container da5cd02aceaee63360fe578b876abe2d763f8848e56696f79edcf75a8ad9266d: Status 404 returned error can't find the container with id da5cd02aceaee63360fe578b876abe2d763f8848e56696f79edcf75a8ad9266d Jun 02 16:37:40.217636 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:40.217606 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lngf" event={"ID":"e735f456-faa7-4b7d-913d-847d1a4eb70e","Type":"ContainerStarted","Data":"8533c2aed73c2b186167eccbaf88bccbfc3130e003c545af58e5576eefaf9d7b"} Jun 02 16:37:40.218573 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:40.218553 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpdvk" event={"ID":"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1","Type":"ContainerStarted","Data":"da5cd02aceaee63360fe578b876abe2d763f8848e56696f79edcf75a8ad9266d"} Jun 02 16:37:41.986603 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:41.986581 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9c6b6f95-sq55d"] Jun 02 16:37:42.009533 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.009453 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9c6b6f95-sq55d"] Jun 02 16:37:42.009663 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.009647 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.015942 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.015846 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 16:37:42.017106 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.016594 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 16:37:42.019360 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.018676 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 16:37:42.019360 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.018972 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pq9w9\"" Jun 02 16:37:42.020789 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.020131 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 16:37:42.020789 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.020700 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 16:37:42.021171 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.021148 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 16:37:42.021906 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.021645 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 16:37:42.120122 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.120094 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-console-config\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.120228 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.120124 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-service-ca\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.120228 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.120144 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7dv\" (UniqueName: \"kubernetes.io/projected/7b10dc35-9e45-4227-b585-1460767fcf15-kube-api-access-zd7dv\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.120309 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.120243 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-serving-cert\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.120309 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.120278 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-oauth-config\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.120382 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.120306 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-oauth-serving-cert\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.221651 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.221613 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-serving-cert\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.221651 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.221656 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-oauth-config\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.221885 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.221679 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-oauth-serving-cert\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.221885 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.221710 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-console-config\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.221885 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.221731 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-service-ca\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.221885 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.221754 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7dv\" (UniqueName: \"kubernetes.io/projected/7b10dc35-9e45-4227-b585-1460767fcf15-kube-api-access-zd7dv\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.222651 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.222613 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-oauth-serving-cert\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.222651 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.222620 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-console-config\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.222827 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.222707 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-service-ca\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.224468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.224443 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-oauth-config\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.224789 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.224647 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-serving-cert\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.227044 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.227016 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpdvk" event={"ID":"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1","Type":"ContainerStarted","Data":"7cbd7d6da2748ab165ff404ea79da361d0b9065913d29e20a9dc57c00780afba"} Jun 02 16:37:42.232570 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.232546 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7dv\" (UniqueName: \"kubernetes.io/projected/7b10dc35-9e45-4227-b585-1460767fcf15-kube-api-access-zd7dv\") pod \"console-5f9c6b6f95-sq55d\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:42.332159 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:42.332129 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:43.231074 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:43.231035 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpdvk" event={"ID":"3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1","Type":"ContainerStarted","Data":"34ec80dcf0e2d322d787d329c8b8bb7bf2556e876d68ade365c7bc39d72d20bd"} Jun 02 16:37:43.232557 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:43.232534 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lngf" event={"ID":"e735f456-faa7-4b7d-913d-847d1a4eb70e","Type":"ContainerStarted","Data":"87e96822990e2ea903da21cee0a8b85986b49e2238b6abd7c139f53702479d1a"} Jun 02 16:37:43.232882 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:43.232861 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:37:43.237600 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:43.237580 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9c6b6f95-sq55d"] Jun 02 16:37:43.240070 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:43.240049 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b10dc35_9e45_4227_b585_1460767fcf15.slice/crio-297327a412dd27f86289aa6f45116ba1e5cf9655d5c2c986b9796d612825abcc WatchSource:0}: Error finding container 297327a412dd27f86289aa6f45116ba1e5cf9655d5c2c986b9796d612825abcc: Status 404 returned error can't find the container with id 297327a412dd27f86289aa6f45116ba1e5cf9655d5c2c986b9796d612825abcc Jun 02 16:37:43.250300 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:43.250259 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lpdvk" podStartSLOduration=66.131885484 podStartE2EDuration="1m8.250248335s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:37:39.858303282 +0000 UTC m=+65.665423261" lastFinishedPulling="2026-06-02 16:37:41.976666133 +0000 UTC m=+67.783786112" observedRunningTime="2026-06-02 16:37:43.249707696 +0000 UTC m=+69.056827701" watchObservedRunningTime="2026-06-02 16:37:43.250248335 +0000 UTC m=+69.057368336" Jun 02 16:37:43.266686 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:43.266653 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7lngf" podStartSLOduration=64.971230739 podStartE2EDuration="1m8.266643885s" podCreationTimestamp="2026-06-02 16:36:35 +0000 UTC" firstStartedPulling="2026-06-02 16:37:39.841186894 +0000 UTC m=+65.648306885" lastFinishedPulling="2026-06-02 16:37:43.136600045 +0000 UTC m=+68.943720031" observedRunningTime="2026-06-02 16:37:43.265809628 +0000 UTC m=+69.072929631" watchObservedRunningTime="2026-06-02 16:37:43.266643885 +0000 UTC m=+69.073763886" Jun 02 16:37:44.040243 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.040209 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f46cf45f8-d6kcs"] Jun 02 16:37:44.041984 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.041965 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.051079 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.051060 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 16:37:44.063461 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.063441 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f46cf45f8-d6kcs"] Jun 02 16:37:44.134167 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134144 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-serving-cert\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.134295 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134176 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-oauth-config\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.134295 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134203 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-service-ca\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.134295 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134275 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7ss\" (UniqueName: \"kubernetes.io/projected/18af9953-1a91-4535-925f-e8507721ef18-kube-api-access-bv7ss\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.134453 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134314 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-trusted-ca-bundle\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.134453 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134349 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-console-config\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.134562 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.134478 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-oauth-serving-cert\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235068 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235042 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-oauth-serving-cert\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235458 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235092 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-serving-cert\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235458 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235189 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-oauth-config\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235458 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235211 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-service-ca\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235458 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235226 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7ss\" (UniqueName: \"kubernetes.io/projected/18af9953-1a91-4535-925f-e8507721ef18-kube-api-access-bv7ss\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235458 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235249 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-trusted-ca-bundle\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235710 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235597 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-console-config\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235831 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235803 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-oauth-serving-cert\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.235962 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.235816 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-service-ca\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.236237 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.236085 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-trusted-ca-bundle\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.236379 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.236325 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-console-config\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.237312 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.237285 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9c6b6f95-sq55d" event={"ID":"7b10dc35-9e45-4227-b585-1460767fcf15","Type":"ContainerStarted","Data":"297327a412dd27f86289aa6f45116ba1e5cf9655d5c2c986b9796d612825abcc"} Jun 02 16:37:44.238155 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.238130 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-serving-cert\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.238258 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.238197 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-oauth-config\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.247742 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.247718 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7ss\" (UniqueName: \"kubernetes.io/projected/18af9953-1a91-4535-925f-e8507721ef18-kube-api-access-bv7ss\") pod \"console-7f46cf45f8-d6kcs\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.273851 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.273830 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj"] Jun 02 16:37:44.276147 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.276129 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:44.278472 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.278447 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 16:37:44.278567 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.278450 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-csc2q\"" Jun 02 16:37:44.286927 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.286892 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj"] Jun 02 16:37:44.336769 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.336707 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d4d0de3-5f05-4a42-87a7-58a5256fdf4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zzfdj\" (UID: \"7d4d0de3-5f05-4a42-87a7-58a5256fdf4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:44.351765 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.351747 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:44.437852 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.437823 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d4d0de3-5f05-4a42-87a7-58a5256fdf4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zzfdj\" (UID: \"7d4d0de3-5f05-4a42-87a7-58a5256fdf4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:44.442481 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.442456 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d4d0de3-5f05-4a42-87a7-58a5256fdf4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zzfdj\" (UID: \"7d4d0de3-5f05-4a42-87a7-58a5256fdf4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:44.493814 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.493784 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f46cf45f8-d6kcs"] Jun 02 16:37:44.496543 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:44.496513 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18af9953_1a91_4535_925f_e8507721ef18.slice/crio-d4c7d1a2de3b2bd074efbb9571551ac938c7e7ef8904ef8e731f6d76950fa4f7 WatchSource:0}: Error finding container d4c7d1a2de3b2bd074efbb9571551ac938c7e7ef8904ef8e731f6d76950fa4f7: Status 404 returned error can't find the container with id d4c7d1a2de3b2bd074efbb9571551ac938c7e7ef8904ef8e731f6d76950fa4f7 Jun 02 16:37:44.586521 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.586502 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:44.734472 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:44.734448 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj"] Jun 02 16:37:44.736624 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:44.736598 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4d0de3_5f05_4a42_87a7_58a5256fdf4a.slice/crio-724054baa334fcfad6069e90533fafd5b7b8825505fe9b781190c2ed7383de47 WatchSource:0}: Error finding container 724054baa334fcfad6069e90533fafd5b7b8825505fe9b781190c2ed7383de47: Status 404 returned error can't find the container with id 724054baa334fcfad6069e90533fafd5b7b8825505fe9b781190c2ed7383de47 Jun 02 16:37:45.242377 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:45.242322 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" event={"ID":"7d4d0de3-5f05-4a42-87a7-58a5256fdf4a","Type":"ContainerStarted","Data":"724054baa334fcfad6069e90533fafd5b7b8825505fe9b781190c2ed7383de47"} Jun 02 16:37:45.243766 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:45.243734 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f46cf45f8-d6kcs" event={"ID":"18af9953-1a91-4535-925f-e8507721ef18","Type":"ContainerStarted","Data":"d4c7d1a2de3b2bd074efbb9571551ac938c7e7ef8904ef8e731f6d76950fa4f7"} Jun 02 16:37:47.250193 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.250162 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9c6b6f95-sq55d" event={"ID":"7b10dc35-9e45-4227-b585-1460767fcf15","Type":"ContainerStarted","Data":"8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8"} Jun 02 16:37:47.251611 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.251583 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f46cf45f8-d6kcs" event={"ID":"18af9953-1a91-4535-925f-e8507721ef18","Type":"ContainerStarted","Data":"60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c"} Jun 02 16:37:47.252832 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.252810 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" event={"ID":"7d4d0de3-5f05-4a42-87a7-58a5256fdf4a","Type":"ContainerStarted","Data":"0406d318f3ad0fcdb6c8ce2a6852786f6ba3c1ac954317092a1d455589c89eea"} Jun 02 16:37:47.253036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.253007 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:47.257287 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.257269 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" Jun 02 16:37:47.281713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.281676 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f9c6b6f95-sq55d" podStartSLOduration=2.444532914 podStartE2EDuration="6.281664685s" podCreationTimestamp="2026-06-02 16:37:41 +0000 UTC" firstStartedPulling="2026-06-02 16:37:43.241746475 +0000 UTC m=+69.048866454" lastFinishedPulling="2026-06-02 16:37:47.078878245 +0000 UTC m=+72.885998225" observedRunningTime="2026-06-02 16:37:47.281344271 +0000 UTC m=+73.088464287" watchObservedRunningTime="2026-06-02 16:37:47.281664685 +0000 UTC m=+73.088784749" Jun 02 16:37:47.317391 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.317349 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f46cf45f8-d6kcs" podStartSLOduration=1.733828469 podStartE2EDuration="4.317339099s" podCreationTimestamp="2026-06-02 16:37:43 +0000 UTC" firstStartedPulling="2026-06-02 16:37:44.498673664 +0000 UTC m=+70.305793644" lastFinishedPulling="2026-06-02 16:37:47.082184293 +0000 UTC m=+72.889304274" observedRunningTime="2026-06-02 16:37:47.316827178 +0000 UTC m=+73.123947181" watchObservedRunningTime="2026-06-02 16:37:47.317339099 +0000 UTC m=+73.124459101" Jun 02 16:37:47.343704 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:47.343634 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zzfdj" podStartSLOduration=1.005924215 podStartE2EDuration="3.343621091s" podCreationTimestamp="2026-06-02 16:37:44 +0000 UTC" firstStartedPulling="2026-06-02 16:37:44.7383417 +0000 UTC m=+70.545461680" lastFinishedPulling="2026-06-02 16:37:47.076038564 +0000 UTC m=+72.883158556" observedRunningTime="2026-06-02 16:37:47.343530662 +0000 UTC m=+73.150650664" watchObservedRunningTime="2026-06-02 16:37:47.343621091 +0000 UTC m=+73.150741093" Jun 02 16:37:48.352555 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.352521 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44"] Jun 02 16:37:48.354419 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.354402 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.358172 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.358131 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 16:37:48.358172 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.358159 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 16:37:48.358376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.358159 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 16:37:48.358376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.358230 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 16:37:48.358376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.358266 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 16:37:48.358376 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.358267 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xjlj6\"" Jun 02 16:37:48.364469 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.364446 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44"] Jun 02 16:37:48.469680 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.469657 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmlp\" (UniqueName: \"kubernetes.io/projected/9646e327-cd1a-435f-8aa7-f6489dad7c9d-kube-api-access-pwmlp\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.469779 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.469688 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9646e327-cd1a-435f-8aa7-f6489dad7c9d-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.469779 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.469712 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9646e327-cd1a-435f-8aa7-f6489dad7c9d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.469889 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.469773 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9646e327-cd1a-435f-8aa7-f6489dad7c9d-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.570122 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.570096 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmlp\" (UniqueName: \"kubernetes.io/projected/9646e327-cd1a-435f-8aa7-f6489dad7c9d-kube-api-access-pwmlp\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.570218 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.570127 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9646e327-cd1a-435f-8aa7-f6489dad7c9d-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.570218 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.570146 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9646e327-cd1a-435f-8aa7-f6489dad7c9d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.570218 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.570177 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9646e327-cd1a-435f-8aa7-f6489dad7c9d-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.570814 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.570796 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9646e327-cd1a-435f-8aa7-f6489dad7c9d-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.572532 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.572514 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9646e327-cd1a-435f-8aa7-f6489dad7c9d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.572625 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.572608 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9646e327-cd1a-435f-8aa7-f6489dad7c9d-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.578606 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.578584 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmlp\" (UniqueName: \"kubernetes.io/projected/9646e327-cd1a-435f-8aa7-f6489dad7c9d-kube-api-access-pwmlp\") pod \"prometheus-operator-658bcd8bdf-dwr44\" (UID: \"9646e327-cd1a-435f-8aa7-f6489dad7c9d\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.663690 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.663637 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" Jun 02 16:37:48.782734 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:48.782709 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44"] Jun 02 16:37:48.785591 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:48.785565 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9646e327_cd1a_435f_8aa7_f6489dad7c9d.slice/crio-d5970ab15af8fd79887b595dd0c588051ca04104aee1a756aa6baa6acc78185f WatchSource:0}: Error finding container d5970ab15af8fd79887b595dd0c588051ca04104aee1a756aa6baa6acc78185f: Status 404 returned error can't find the container with id d5970ab15af8fd79887b595dd0c588051ca04104aee1a756aa6baa6acc78185f Jun 02 16:37:49.259357 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:49.259324 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" event={"ID":"9646e327-cd1a-435f-8aa7-f6489dad7c9d","Type":"ContainerStarted","Data":"d5970ab15af8fd79887b595dd0c588051ca04104aee1a756aa6baa6acc78185f"} Jun 02 16:37:50.264585 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:50.264541 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" event={"ID":"9646e327-cd1a-435f-8aa7-f6489dad7c9d","Type":"ContainerStarted","Data":"f7ea1092e647eaf10b627477565121aa3a14769edd226236a054f59778929f61"} Jun 02 16:37:50.264585 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:50.264586 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" event={"ID":"9646e327-cd1a-435f-8aa7-f6489dad7c9d","Type":"ContainerStarted","Data":"bc0842d2c15053b89f2f8c55326dceff952700d8623a7b6336c23de6644e68e5"} Jun 02 16:37:50.283015 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:50.282930 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dwr44" podStartSLOduration=1.051312401 podStartE2EDuration="2.28290086s" podCreationTimestamp="2026-06-02 16:37:48 +0000 UTC" firstStartedPulling="2026-06-02 16:37:48.787429787 +0000 UTC m=+74.594549767" lastFinishedPulling="2026-06-02 16:37:50.019018246 +0000 UTC m=+75.826138226" observedRunningTime="2026-06-02 16:37:50.281661536 +0000 UTC m=+76.088781537" watchObservedRunningTime="2026-06-02 16:37:50.28290086 +0000 UTC m=+76.090020862" Jun 02 16:37:51.769867 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.769834 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf"] Jun 02 16:37:51.773802 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.772953 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.776983 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.776959 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 16:37:51.776983 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.776977 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mhgdx\"" Jun 02 16:37:51.777195 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.776996 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 16:37:51.777629 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.777609 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 16:37:51.778476 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.778458 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-szzj9"] Jun 02 16:37:51.780490 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.780471 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.782842 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.782827 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 16:37:51.782996 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.782978 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 16:37:51.783143 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.783127 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5m2rs\"" Jun 02 16:37:51.783214 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.783133 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 16:37:51.789576 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.789556 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf"] Jun 02 16:37:51.896188 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896163 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.896305 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896191 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.896305 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896212 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896305 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896264 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-root\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896326 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-textfile\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896366 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.896468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896400 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896429 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-sys\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896458 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.896702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896488 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jck4g\" (UniqueName: \"kubernetes.io/projected/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-api-access-jck4g\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.896702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896521 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-wtmp\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896547 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.896702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896571 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d80146e-7876-41a6-aaa1-be47b4cf48f2-metrics-client-ca\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896607 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-tls\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.896702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.896637 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gjp\" (UniqueName: \"kubernetes.io/projected/0d80146e-7876-41a6-aaa1-be47b4cf48f2-kube-api-access-79gjp\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.996864 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.996841 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-textfile\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.996972 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.996869 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.996972 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.996893 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.996972 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.996940 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-sys\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.996972 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.996966 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.996992 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jck4g\" (UniqueName: \"kubernetes.io/projected/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-api-access-jck4g\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997007 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-sys\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997022 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-wtmp\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997049 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997075 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d80146e-7876-41a6-aaa1-be47b4cf48f2-metrics-client-ca\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997119 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-tls\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997145 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gjp\" (UniqueName: \"kubernetes.io/projected/0d80146e-7876-41a6-aaa1-be47b4cf48f2-kube-api-access-79gjp\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997176 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-wtmp\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997181 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997242 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997248 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-textfile\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997295 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997325 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-root\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997402 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d80146e-7876-41a6-aaa1-be47b4cf48f2-root\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997824 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:51.997550 2548 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 16:37:51.997824 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:51.997620 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-tls podName:9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41 nodeName:}" failed. No retries permitted until 2026-06-02 16:37:52.497601898 +0000 UTC m=+78.304721881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-8c6bf" (UID: "9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41") : secret "kube-state-metrics-tls" not found Jun 02 16:37:51.997824 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997665 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997824 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997678 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.997824 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997700 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d80146e-7876-41a6-aaa1-be47b4cf48f2-metrics-client-ca\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.997824 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997819 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.998133 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.997931 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:51.999759 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.999736 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.999827 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.999789 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d80146e-7876-41a6-aaa1-be47b4cf48f2-node-exporter-tls\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:51.999861 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:51.999843 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:52.006006 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.005980 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jck4g\" (UniqueName: \"kubernetes.io/projected/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-api-access-jck4g\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:52.006209 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.006190 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gjp\" (UniqueName: \"kubernetes.io/projected/0d80146e-7876-41a6-aaa1-be47b4cf48f2-kube-api-access-79gjp\") pod \"node-exporter-szzj9\" (UID: \"0d80146e-7876-41a6-aaa1-be47b4cf48f2\") " pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:52.089062 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.089016 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-szzj9" Jun 02 16:37:52.097303 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:52.097280 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d80146e_7876_41a6_aaa1_be47b4cf48f2.slice/crio-f1066c88d6e42fd14001a8a189c4fa18bb1e95a3914b25bebc293767f42beffc WatchSource:0}: Error finding container f1066c88d6e42fd14001a8a189c4fa18bb1e95a3914b25bebc293767f42beffc: Status 404 returned error can't find the container with id f1066c88d6e42fd14001a8a189c4fa18bb1e95a3914b25bebc293767f42beffc Jun 02 16:37:52.270791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.270757 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szzj9" event={"ID":"0d80146e-7876-41a6-aaa1-be47b4cf48f2","Type":"ContainerStarted","Data":"f1066c88d6e42fd14001a8a189c4fa18bb1e95a3914b25bebc293767f42beffc"} Jun 02 16:37:52.332791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.332767 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:52.332909 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.332806 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:52.337560 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.337538 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:52.501536 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.501478 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:52.503732 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.503712 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8c6bf\" (UID: \"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:52.682286 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.682259 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" Jun 02 16:37:52.813849 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.813818 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf"] Jun 02 16:37:52.817126 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:52.817073 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a68b1cd_0a80_4bfb_b44c_d2d9a4163c41.slice/crio-85fc93e44d4e7d529916b99b6e9f8be9b6d3016602b1a0cd2bc0f67d34c7eb79 WatchSource:0}: Error finding container 85fc93e44d4e7d529916b99b6e9f8be9b6d3016602b1a0cd2bc0f67d34c7eb79: Status 404 returned error can't find the container with id 85fc93e44d4e7d529916b99b6e9f8be9b6d3016602b1a0cd2bc0f67d34c7eb79 Jun 02 16:37:52.859446 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.859417 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:37:52.862728 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.862709 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.867530 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.867457 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 16:37:52.867530 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.867457 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 16:37:52.867834 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.867748 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 16:37:52.867834 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.867769 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 16:37:52.868027 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.868008 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 16:37:52.868403 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.868289 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 16:37:52.868403 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.868301 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sjth5\"" Jun 02 16:37:52.868403 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.868305 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 16:37:52.868403 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.868306 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 16:37:52.870779 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.870639 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 16:37:52.879225 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.879200 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:37:52.903973 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.903942 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904129 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.903984 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904129 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904032 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904129 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904070 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-config-volume\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904129 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904094 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-web-config\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904152 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904185 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904219 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-config-out\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904249 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904280 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904303 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904660 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904365 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:52.904660 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:52.904402 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4vcj\" (UniqueName: \"kubernetes.io/projected/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-kube-api-access-v4vcj\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005366 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005330 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005511 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005372 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4vcj\" (UniqueName: \"kubernetes.io/projected/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-kube-api-access-v4vcj\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005511 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005414 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005511 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005438 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005511 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005478 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:53.005503 2548 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005519 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-config-volume\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005546 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-web-config\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:37:53.005584 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-main-tls podName:2492d4f3-7c2a-4c67-bb07-00b6c9349fb0 nodeName:}" failed. No retries permitted until 2026-06-02 16:37:53.50556226 +0000 UTC m=+79.312682240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2492d4f3-7c2a-4c67-bb07-00b6c9349fb0") : secret "alertmanager-main-tls" not found Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005611 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005643 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005678 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-config-out\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.005713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005707 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.006131 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005743 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.006131 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.005771 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.006849 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.006545 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.007736 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.007601 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.008286 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.008156 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.008648 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.008558 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-web-config\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.009327 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.009264 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.010407 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.010383 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.010551 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.010478 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.011161 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.011095 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-config-out\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.011526 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.011433 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.011803 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.011729 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-config-volume\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.012221 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.012187 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.014024 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.013899 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4vcj\" (UniqueName: \"kubernetes.io/projected/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-kube-api-access-v4vcj\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.274457 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.274424 2548 generic.go:358] "Generic (PLEG): container finished" podID="0d80146e-7876-41a6-aaa1-be47b4cf48f2" containerID="ca5a1f375a329e8b81586be34d6b57a2645ef5e4c6694b7edd17f5f46448dde3" exitCode=0 Jun 02 16:37:53.274563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.274503 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szzj9" event={"ID":"0d80146e-7876-41a6-aaa1-be47b4cf48f2","Type":"ContainerDied","Data":"ca5a1f375a329e8b81586be34d6b57a2645ef5e4c6694b7edd17f5f46448dde3"} Jun 02 16:37:53.275595 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.275575 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" event={"ID":"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41","Type":"ContainerStarted","Data":"85fc93e44d4e7d529916b99b6e9f8be9b6d3016602b1a0cd2bc0f67d34c7eb79"} Jun 02 16:37:53.279494 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.279474 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:37:53.511421 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.511389 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.513960 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.513934 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2492d4f3-7c2a-4c67-bb07-00b6c9349fb0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.774823 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.774790 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 16:37:53.947431 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:53.947399 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 16:37:54.145165 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:54.145095 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2492d4f3_7c2a_4c67_bb07_00b6c9349fb0.slice/crio-8292120b019af4d5aa82bf44c52d928b84f5a9e3f889846a7930b17aa24f8222 WatchSource:0}: Error finding container 8292120b019af4d5aa82bf44c52d928b84f5a9e3f889846a7930b17aa24f8222: Status 404 returned error can't find the container with id 8292120b019af4d5aa82bf44c52d928b84f5a9e3f889846a7930b17aa24f8222 Jun 02 16:37:54.280348 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.280324 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szzj9" event={"ID":"0d80146e-7876-41a6-aaa1-be47b4cf48f2","Type":"ContainerStarted","Data":"8c6d566edab552b24bdb845d4c73e890ca1ea73fd58a7341ed581ac3db0c5c38"} Jun 02 16:37:54.280444 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.280360 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-szzj9" event={"ID":"0d80146e-7876-41a6-aaa1-be47b4cf48f2","Type":"ContainerStarted","Data":"14d6a21380a5a4f9b24958b56f521f72de57c32a3413da0b427b552776f196ef"} Jun 02 16:37:54.281765 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.281714 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" event={"ID":"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41","Type":"ContainerStarted","Data":"40bbd84f0c0ee521b8732bb3f78cd881e77fe65c549b0b90cc69201d3d48722b"} Jun 02 16:37:54.282685 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.282668 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"8292120b019af4d5aa82bf44c52d928b84f5a9e3f889846a7930b17aa24f8222"} Jun 02 16:37:54.302449 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.301329 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-szzj9" podStartSLOduration=2.267321848 podStartE2EDuration="3.301312416s" podCreationTimestamp="2026-06-02 16:37:51 +0000 UTC" firstStartedPulling="2026-06-02 16:37:52.099458226 +0000 UTC m=+77.906578206" lastFinishedPulling="2026-06-02 16:37:53.133448793 +0000 UTC m=+78.940568774" observedRunningTime="2026-06-02 16:37:54.30039822 +0000 UTC m=+80.107518222" watchObservedRunningTime="2026-06-02 16:37:54.301312416 +0000 UTC m=+80.108432422" Jun 02 16:37:54.353205 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.352041 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:54.353205 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.352883 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:54.358208 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.358187 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:54.861316 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.861288 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-579c85b85-2d8nz"] Jun 02 16:37:54.863680 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.863662 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.865989 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.865959 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46jng\"" Jun 02 16:37:54.866104 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.866082 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 16:37:54.867378 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.867358 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 16:37:54.867558 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.867533 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9c7q5cphepdp6\"" Jun 02 16:37:54.867730 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.867703 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 16:37:54.868253 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.868228 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 16:37:54.868440 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.868426 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 16:37:54.877360 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.877335 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579c85b85-2d8nz"] Jun 02 16:37:54.923713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923685 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-tls\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.923816 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923736 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.923816 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923774 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-grpc-tls\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.923900 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923871 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.923900 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923894 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8xfm\" (UniqueName: \"kubernetes.io/projected/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-kube-api-access-m8xfm\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.923999 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923910 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.923999 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.923947 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-metrics-client-ca\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:54.924076 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:54.924010 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025068 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025043 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-tls\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025085 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025106 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-grpc-tls\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025174 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025204 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8xfm\" (UniqueName: \"kubernetes.io/projected/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-kube-api-access-m8xfm\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025228 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025252 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-metrics-client-ca\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.025442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.025288 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.026146 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.026118 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-metrics-client-ca\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.027699 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.027659 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.027896 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.027876 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.028137 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.028117 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.028395 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.028371 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-grpc-tls\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.028557 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.028540 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-tls\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.028758 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.028738 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.034334 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.034310 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8xfm\" (UniqueName: \"kubernetes.io/projected/1a91821c-5df8-4f5e-acb6-7d9cb20b9d57-kube-api-access-m8xfm\") pod \"thanos-querier-579c85b85-2d8nz\" (UID: \"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57\") " pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.173311 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.173243 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:37:55.287633 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.287597 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" event={"ID":"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41","Type":"ContainerStarted","Data":"d3c3dfd09646f2a0a36e9d1a96a89f3e2dad64b0b933636cccf0a6e14dd0aa7b"} Jun 02 16:37:55.287787 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.287644 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" event={"ID":"9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41","Type":"ContainerStarted","Data":"a19b784241f132428c014b4bab8edb5b60772f0717f6b9e7cf5b04b5603557f0"} Jun 02 16:37:55.291951 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.291925 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:37:55.306462 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.306416 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8c6bf" podStartSLOduration=2.954947819 podStartE2EDuration="4.306397836s" podCreationTimestamp="2026-06-02 16:37:51 +0000 UTC" firstStartedPulling="2026-06-02 16:37:52.819616341 +0000 UTC m=+78.626736321" lastFinishedPulling="2026-06-02 16:37:54.171066355 +0000 UTC m=+79.978186338" observedRunningTime="2026-06-02 16:37:55.305068411 +0000 UTC m=+81.112188414" watchObservedRunningTime="2026-06-02 16:37:55.306397836 +0000 UTC m=+81.113517840" Jun 02 16:37:55.360997 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.358518 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9c6b6f95-sq55d"] Jun 02 16:37:55.407981 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:55.407951 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579c85b85-2d8nz"] Jun 02 16:37:55.434678 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:55.434610 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a91821c_5df8_4f5e_acb6_7d9cb20b9d57.slice/crio-43da33fe4bc6ac23724b54dfe98f877b940c51b986ad5634f2b57dd2f6decf87 WatchSource:0}: Error finding container 43da33fe4bc6ac23724b54dfe98f877b940c51b986ad5634f2b57dd2f6decf87: Status 404 returned error can't find the container with id 43da33fe4bc6ac23724b54dfe98f877b940c51b986ad5634f2b57dd2f6decf87 Jun 02 16:37:56.291621 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.291584 2548 generic.go:358] "Generic (PLEG): container finished" podID="2492d4f3-7c2a-4c67-bb07-00b6c9349fb0" containerID="26b8db581e4e71cc27754636ecd081a613f579bdb8155381a616e37d22a79824" exitCode=0 Jun 02 16:37:56.292080 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.291688 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerDied","Data":"26b8db581e4e71cc27754636ecd081a613f579bdb8155381a616e37d22a79824"} Jun 02 16:37:56.293171 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.293118 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"43da33fe4bc6ac23724b54dfe98f877b940c51b986ad5634f2b57dd2f6decf87"} Jun 02 16:37:56.305275 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.305172 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-777cb697d6-8qv78"] Jun 02 16:37:56.307604 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.307588 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.311359 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.311179 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b7l6p\"" Jun 02 16:37:56.311359 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.311200 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 16:37:56.311359 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.311242 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 16:37:56.311359 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.311335 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 16:37:56.311648 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.311497 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 16:37:56.311648 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.311558 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cog9lfl8vdgbj\"" Jun 02 16:37:56.325416 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.325390 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-777cb697d6-8qv78"] Jun 02 16:37:56.437484 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437457 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-audit-log\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.437484 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437486 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-metrics-server-audit-profiles\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.437634 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437511 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-client-ca-bundle\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.437634 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437554 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-secret-metrics-server-client-certs\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.437634 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437588 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.437634 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437607 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-secret-metrics-server-tls\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.437748 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.437652 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvq4\" (UniqueName: \"kubernetes.io/projected/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-kube-api-access-tsvq4\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538541 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538515 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538679 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538552 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-secret-metrics-server-tls\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538679 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538571 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvq4\" (UniqueName: \"kubernetes.io/projected/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-kube-api-access-tsvq4\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538679 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538599 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-audit-log\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538679 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538625 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-metrics-server-audit-profiles\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538679 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538666 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-client-ca-bundle\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.538957 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.538699 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-secret-metrics-server-client-certs\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.539035 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.539015 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-audit-log\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.539561 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.539534 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.539969 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.539898 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-metrics-server-audit-profiles\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.541611 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.541587 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-secret-metrics-server-client-certs\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.541713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.541616 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-secret-metrics-server-tls\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.542037 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.542018 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-client-ca-bundle\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.549555 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.549535 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvq4\" (UniqueName: \"kubernetes.io/projected/08cce9d5-250e-4bcf-bc85-fda47dd55d7c-kube-api-access-tsvq4\") pod \"metrics-server-777cb697d6-8qv78\" (UID: \"08cce9d5-250e-4bcf-bc85-fda47dd55d7c\") " pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.619027 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.619002 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:37:56.753769 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:56.753735 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-777cb697d6-8qv78"] Jun 02 16:37:56.756685 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:37:56.756656 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cce9d5_250e_4bcf_bc85_fda47dd55d7c.slice/crio-a9dac0b9c4bd96ac7b6e6b791905ce5ff00d540224d5bb78ee9b2a1f3fbf8dc4 WatchSource:0}: Error finding container a9dac0b9c4bd96ac7b6e6b791905ce5ff00d540224d5bb78ee9b2a1f3fbf8dc4: Status 404 returned error can't find the container with id a9dac0b9c4bd96ac7b6e6b791905ce5ff00d540224d5bb78ee9b2a1f3fbf8dc4 Jun 02 16:37:57.299616 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.299561 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" event={"ID":"08cce9d5-250e-4bcf-bc85-fda47dd55d7c","Type":"ContainerStarted","Data":"a9dac0b9c4bd96ac7b6e6b791905ce5ff00d540224d5bb78ee9b2a1f3fbf8dc4"} Jun 02 16:37:57.625317 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.625244 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-78fccb978d-5lpsp"] Jun 02 16:37:57.627542 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.627522 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.638863 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.638842 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fccb978d-5lpsp"] Jun 02 16:37:57.751616 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751577 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-oauth-config\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.751782 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751644 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-oauth-serving-cert\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.751782 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751679 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzzl\" (UniqueName: \"kubernetes.io/projected/5cbc1e73-71ca-4ffa-968a-270784eaa938-kube-api-access-zxzzl\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.751782 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751750 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-trusted-ca-bundle\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.751998 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751790 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-config\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.751998 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751818 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-serving-cert\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.751998 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.751873 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-service-ca\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853222 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853183 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-service-ca\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853394 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853247 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-oauth-config\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853394 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853288 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-oauth-serving-cert\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853394 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853312 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzzl\" (UniqueName: \"kubernetes.io/projected/5cbc1e73-71ca-4ffa-968a-270784eaa938-kube-api-access-zxzzl\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853394 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853353 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-trusted-ca-bundle\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853394 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853393 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-config\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.853641 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.853425 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-serving-cert\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.854672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.854004 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-service-ca\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.854672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.854516 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-oauth-serving-cert\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.854672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.854624 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-config\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.854890 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.854810 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-trusted-ca-bundle\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.856891 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.856815 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-oauth-config\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.857026 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.856964 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-serving-cert\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.863294 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.863269 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzzl\" (UniqueName: \"kubernetes.io/projected/5cbc1e73-71ca-4ffa-968a-270784eaa938-kube-api-access-zxzzl\") pod \"console-78fccb978d-5lpsp\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:57.938141 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:57.938055 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:37:58.134053 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.133764 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fccb978d-5lpsp"] Jun 02 16:37:58.306235 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.306206 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"0c0f683b07d7314b37761a037d138758702c17780e91a9c092dfddd944564195"} Jun 02 16:37:58.306576 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.306244 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"0f8bd6c2bb9adfbd91c3233a081bb56a1fe9215d1827b159238a80120f279f6f"} Jun 02 16:37:58.306576 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.306260 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"5e5bce33713d9b7e4afc8e6aa30f1d57694be0ea3be8389ffb888cd1913886fe"} Jun 02 16:37:58.308282 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.308255 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"71366110dfc9a4a39ae47e1101a4a033a0355ac6ee4c08ee639fb53040e53e5b"} Jun 02 16:37:58.308362 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.308292 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"88cc59dfbba4c64ed5189e5ab5a735a6b09912cdd2f46d0c55e6df8ee9f895f3"} Jun 02 16:37:58.308362 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.308305 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"b533ac7686a4625cb97bac033a932c47119452e00f9a1f23a46903897eb817a9"} Jun 02 16:37:58.310134 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.309550 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fccb978d-5lpsp" event={"ID":"5cbc1e73-71ca-4ffa-968a-270784eaa938","Type":"ContainerStarted","Data":"4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf"} Jun 02 16:37:58.310134 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.309579 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fccb978d-5lpsp" event={"ID":"5cbc1e73-71ca-4ffa-968a-270784eaa938","Type":"ContainerStarted","Data":"8642d6b3c5c9901d06429fd6d91b20be4d8e31470a15af35c45e285bd293e1e4"} Jun 02 16:37:58.329188 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:58.329133 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-78fccb978d-5lpsp" podStartSLOduration=1.329117729 podStartE2EDuration="1.329117729s" podCreationTimestamp="2026-06-02 16:37:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:37:58.327410059 +0000 UTC m=+84.134530052" watchObservedRunningTime="2026-06-02 16:37:58.329117729 +0000 UTC m=+84.136237734" Jun 02 16:37:59.317149 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:59.317114 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" event={"ID":"08cce9d5-250e-4bcf-bc85-fda47dd55d7c","Type":"ContainerStarted","Data":"744590c8c67199ff888a6cf9539ec817aeafd96a168ba59ecd7aa4f421453974"} Jun 02 16:37:59.319767 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:59.319745 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"3ca2479d7c340d9cdecfcf065f5506e147ee38ece5c0ae947c8e61d8e15ff873"} Jun 02 16:37:59.319881 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:59.319774 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"48ab93a23304d6396b21955221552028d11dbcb5e4b6594f033d1d50a3334e90"} Jun 02 16:37:59.334307 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:37:59.334262 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" podStartSLOduration=1.187572655 podStartE2EDuration="3.334246491s" podCreationTimestamp="2026-06-02 16:37:56 +0000 UTC" firstStartedPulling="2026-06-02 16:37:56.758706066 +0000 UTC m=+82.565826046" lastFinishedPulling="2026-06-02 16:37:58.905379895 +0000 UTC m=+84.712499882" observedRunningTime="2026-06-02 16:37:59.332783555 +0000 UTC m=+85.139903557" watchObservedRunningTime="2026-06-02 16:37:59.334246491 +0000 UTC m=+85.141366497" Jun 02 16:38:00.326049 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:00.326011 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2492d4f3-7c2a-4c67-bb07-00b6c9349fb0","Type":"ContainerStarted","Data":"5cd0794fac31a154fd0d6cc4c9b03ca1439d5f7147ac1cbcc5c5346f08e7d5af"} Jun 02 16:38:00.328663 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:00.328636 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"89c67615b4088a8cc2e2cf29a4aa821431072cb08a8888e88eb857f931e36e65"} Jun 02 16:38:00.328779 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:00.328670 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"ceb1cb992ee8bfbd5fae9ab1d0bccf9d9391be8950c69c522c3ca634543638dc"} Jun 02 16:38:00.328779 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:00.328681 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" event={"ID":"1a91821c-5df8-4f5e-acb6-7d9cb20b9d57","Type":"ContainerStarted","Data":"495f12f75bb6252ab39789d3276fe338189fe05ee4e0ec0ee85f983718584d1d"} Jun 02 16:38:00.352202 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:00.352152 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.136399548 podStartE2EDuration="8.352136248s" podCreationTimestamp="2026-06-02 16:37:52 +0000 UTC" firstStartedPulling="2026-06-02 16:37:54.147195791 +0000 UTC m=+79.954315771" lastFinishedPulling="2026-06-02 16:37:59.362932481 +0000 UTC m=+85.170052471" observedRunningTime="2026-06-02 16:38:00.350542101 +0000 UTC m=+86.157662103" watchObservedRunningTime="2026-06-02 16:38:00.352136248 +0000 UTC m=+86.159256250" Jun 02 16:38:00.374789 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:00.373940 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" podStartSLOduration=2.445916618 podStartE2EDuration="6.373907834s" podCreationTimestamp="2026-06-02 16:37:54 +0000 UTC" firstStartedPulling="2026-06-02 16:37:55.436565244 +0000 UTC m=+81.243685238" lastFinishedPulling="2026-06-02 16:37:59.364556468 +0000 UTC m=+85.171676454" observedRunningTime="2026-06-02 16:38:00.372467351 +0000 UTC m=+86.179587376" watchObservedRunningTime="2026-06-02 16:38:00.373907834 +0000 UTC m=+86.181027837" Jun 02 16:38:01.333212 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:01.333181 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:38:07.342008 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:07.341978 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-579c85b85-2d8nz" Jun 02 16:38:07.939060 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:07.939020 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:38:07.939759 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:07.939732 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:38:07.943718 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:07.943694 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:38:08.357258 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:08.357231 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:38:08.405870 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:08.405835 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f46cf45f8-d6kcs"] Jun 02 16:38:15.246603 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:15.246572 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7lngf" Jun 02 16:38:16.619656 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:16.619625 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:38:16.620030 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:16.619696 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:38:20.385632 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.385594 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f9c6b6f95-sq55d" podUID="7b10dc35-9e45-4227-b585-1460767fcf15" containerName="console" containerID="cri-o://8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8" gracePeriod=15 Jun 02 16:38:20.628484 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.628464 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9c6b6f95-sq55d_7b10dc35-9e45-4227-b585-1460767fcf15/console/0.log" Jun 02 16:38:20.628587 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.628534 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:38:20.734520 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734463 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-oauth-config\") pod \"7b10dc35-9e45-4227-b585-1460767fcf15\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " Jun 02 16:38:20.734520 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734503 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-oauth-serving-cert\") pod \"7b10dc35-9e45-4227-b585-1460767fcf15\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " Jun 02 16:38:20.734689 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734543 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-serving-cert\") pod \"7b10dc35-9e45-4227-b585-1460767fcf15\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " Jun 02 16:38:20.734689 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734565 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-service-ca\") pod \"7b10dc35-9e45-4227-b585-1460767fcf15\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " Jun 02 16:38:20.734689 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734589 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-console-config\") pod \"7b10dc35-9e45-4227-b585-1460767fcf15\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " Jun 02 16:38:20.734689 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734623 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd7dv\" (UniqueName: \"kubernetes.io/projected/7b10dc35-9e45-4227-b585-1460767fcf15-kube-api-access-zd7dv\") pod \"7b10dc35-9e45-4227-b585-1460767fcf15\" (UID: \"7b10dc35-9e45-4227-b585-1460767fcf15\") " Jun 02 16:38:20.735021 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.734990 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7b10dc35-9e45-4227-b585-1460767fcf15" (UID: "7b10dc35-9e45-4227-b585-1460767fcf15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:20.735021 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.735009 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-service-ca" (OuterVolumeSpecName: "service-ca") pod "7b10dc35-9e45-4227-b585-1460767fcf15" (UID: "7b10dc35-9e45-4227-b585-1460767fcf15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:20.735160 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.735013 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-console-config" (OuterVolumeSpecName: "console-config") pod "7b10dc35-9e45-4227-b585-1460767fcf15" (UID: "7b10dc35-9e45-4227-b585-1460767fcf15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:20.736659 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.736632 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7b10dc35-9e45-4227-b585-1460767fcf15" (UID: "7b10dc35-9e45-4227-b585-1460767fcf15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:38:20.736725 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.736682 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7b10dc35-9e45-4227-b585-1460767fcf15" (UID: "7b10dc35-9e45-4227-b585-1460767fcf15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:38:20.736725 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.736683 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b10dc35-9e45-4227-b585-1460767fcf15-kube-api-access-zd7dv" (OuterVolumeSpecName: "kube-api-access-zd7dv") pod "7b10dc35-9e45-4227-b585-1460767fcf15" (UID: "7b10dc35-9e45-4227-b585-1460767fcf15"). InnerVolumeSpecName "kube-api-access-zd7dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:38:20.835638 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.835613 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-oauth-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:20.835736 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.835634 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:20.835736 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.835659 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-service-ca\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:20.835736 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.835669 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b10dc35-9e45-4227-b585-1460767fcf15-console-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:20.835736 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.835677 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd7dv\" (UniqueName: \"kubernetes.io/projected/7b10dc35-9e45-4227-b585-1460767fcf15-kube-api-access-zd7dv\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:20.835736 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:20.835687 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b10dc35-9e45-4227-b585-1460767fcf15-console-oauth-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:21.392220 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.392189 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9c6b6f95-sq55d_7b10dc35-9e45-4227-b585-1460767fcf15/console/0.log" Jun 02 16:38:21.392608 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.392228 2548 generic.go:358] "Generic (PLEG): container finished" podID="7b10dc35-9e45-4227-b585-1460767fcf15" containerID="8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8" exitCode=2 Jun 02 16:38:21.392608 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.392263 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9c6b6f95-sq55d" event={"ID":"7b10dc35-9e45-4227-b585-1460767fcf15","Type":"ContainerDied","Data":"8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8"} Jun 02 16:38:21.392608 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.392309 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9c6b6f95-sq55d" event={"ID":"7b10dc35-9e45-4227-b585-1460767fcf15","Type":"ContainerDied","Data":"297327a412dd27f86289aa6f45116ba1e5cf9655d5c2c986b9796d612825abcc"} Jun 02 16:38:21.392608 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.392314 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9c6b6f95-sq55d" Jun 02 16:38:21.392608 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.392324 2548 scope.go:117] "RemoveContainer" containerID="8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8" Jun 02 16:38:21.400563 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.400548 2548 scope.go:117] "RemoveContainer" containerID="8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8" Jun 02 16:38:21.400814 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:38:21.400795 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8\": container with ID starting with 8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8 not found: ID does not exist" containerID="8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8" Jun 02 16:38:21.400859 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.400822 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8"} err="failed to get container status \"8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8\": rpc error: code = NotFound desc = could not find container \"8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8\": container with ID starting with 8de0e65105bc8d41e317211ddbc9fb9682e64d5196954f8f02be419020fd20e8 not found: ID does not exist" Jun 02 16:38:21.425374 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.425346 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9c6b6f95-sq55d"] Jun 02 16:38:21.430300 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:21.430277 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f9c6b6f95-sq55d"] Jun 02 16:38:22.782698 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:22.782670 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b10dc35-9e45-4227-b585-1460767fcf15" path="/var/lib/kubelet/pods/7b10dc35-9e45-4227-b585-1460767fcf15/volumes" Jun 02 16:38:33.425292 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.425229 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f46cf45f8-d6kcs" podUID="18af9953-1a91-4535-925f-e8507721ef18" containerName="console" containerID="cri-o://60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c" gracePeriod=15 Jun 02 16:38:33.657902 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.657881 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f46cf45f8-d6kcs_18af9953-1a91-4535-925f-e8507721ef18/console/0.log" Jun 02 16:38:33.658052 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.657964 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:38:33.733616 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733558 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-oauth-config\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.733616 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733599 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-service-ca\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.733747 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733622 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-console-config\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.733747 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733637 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-oauth-serving-cert\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.733747 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733681 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv7ss\" (UniqueName: \"kubernetes.io/projected/18af9953-1a91-4535-925f-e8507721ef18-kube-api-access-bv7ss\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.733747 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733702 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-serving-cert\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.733747 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733740 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-trusted-ca-bundle\") pod \"18af9953-1a91-4535-925f-e8507721ef18\" (UID: \"18af9953-1a91-4535-925f-e8507721ef18\") " Jun 02 16:38:33.734093 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.734050 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-console-config" (OuterVolumeSpecName: "console-config") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:33.734183 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.733990 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-service-ca" (OuterVolumeSpecName: "service-ca") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:33.734240 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.734177 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:33.734240 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.734215 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:38:33.735728 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.735708 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:38:33.735889 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.735863 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18af9953-1a91-4535-925f-e8507721ef18-kube-api-access-bv7ss" (OuterVolumeSpecName: "kube-api-access-bv7ss") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "kube-api-access-bv7ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:38:33.736040 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.735895 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18af9953-1a91-4535-925f-e8507721ef18" (UID: "18af9953-1a91-4535-925f-e8507721ef18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:38:33.834229 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834207 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv7ss\" (UniqueName: \"kubernetes.io/projected/18af9953-1a91-4535-925f-e8507721ef18-kube-api-access-bv7ss\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:33.834229 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834227 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:33.834347 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834237 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-trusted-ca-bundle\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:33.834347 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834245 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18af9953-1a91-4535-925f-e8507721ef18-console-oauth-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:33.834347 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834255 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-service-ca\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:33.834347 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834264 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-console-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:33.834347 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:33.834273 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18af9953-1a91-4535-925f-e8507721ef18-oauth-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:38:34.433222 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.433196 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f46cf45f8-d6kcs_18af9953-1a91-4535-925f-e8507721ef18/console/0.log" Jun 02 16:38:34.433590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.433234 2548 generic.go:358] "Generic (PLEG): container finished" podID="18af9953-1a91-4535-925f-e8507721ef18" containerID="60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c" exitCode=2 Jun 02 16:38:34.433590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.433264 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f46cf45f8-d6kcs" event={"ID":"18af9953-1a91-4535-925f-e8507721ef18","Type":"ContainerDied","Data":"60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c"} Jun 02 16:38:34.433590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.433295 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f46cf45f8-d6kcs" Jun 02 16:38:34.433590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.433303 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f46cf45f8-d6kcs" event={"ID":"18af9953-1a91-4535-925f-e8507721ef18","Type":"ContainerDied","Data":"d4c7d1a2de3b2bd074efbb9571551ac938c7e7ef8904ef8e731f6d76950fa4f7"} Jun 02 16:38:34.433590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.433319 2548 scope.go:117] "RemoveContainer" containerID="60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c" Jun 02 16:38:34.441438 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.441418 2548 scope.go:117] "RemoveContainer" containerID="60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c" Jun 02 16:38:34.441680 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:38:34.441662 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c\": container with ID starting with 60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c not found: ID does not exist" containerID="60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c" Jun 02 16:38:34.441744 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.441692 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c"} err="failed to get container status \"60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c\": rpc error: code = NotFound desc = could not find container \"60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c\": container with ID starting with 60cf7cb0091efbe6de6a82ca899432b937cea44746824e1d4528cc6c496ee31c not found: ID does not exist" Jun 02 16:38:34.453005 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.452982 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f46cf45f8-d6kcs"] Jun 02 16:38:34.458949 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.458904 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f46cf45f8-d6kcs"] Jun 02 16:38:34.782476 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:34.782439 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18af9953-1a91-4535-925f-e8507721ef18" path="/var/lib/kubelet/pods/18af9953-1a91-4535-925f-e8507721ef18/volumes" Jun 02 16:38:36.624771 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:36.624739 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:38:36.628694 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:38:36.628665 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-777cb697d6-8qv78" Jun 02 16:39:16.147096 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147059 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fb454dfdf-rtglz"] Jun 02 16:39:16.147650 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147411 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b10dc35-9e45-4227-b585-1460767fcf15" containerName="console" Jun 02 16:39:16.147650 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147428 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b10dc35-9e45-4227-b585-1460767fcf15" containerName="console" Jun 02 16:39:16.147650 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147453 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18af9953-1a91-4535-925f-e8507721ef18" containerName="console" Jun 02 16:39:16.147650 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147461 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="18af9953-1a91-4535-925f-e8507721ef18" containerName="console" Jun 02 16:39:16.147650 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147536 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="18af9953-1a91-4535-925f-e8507721ef18" containerName="console" Jun 02 16:39:16.147650 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.147548 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b10dc35-9e45-4227-b585-1460767fcf15" containerName="console" Jun 02 16:39:16.151310 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.151288 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.153878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.153852 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 16:39:16.154012 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.153880 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 16:39:16.154012 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.153881 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 16:39:16.154012 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.153880 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 16:39:16.154012 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.153965 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7hzw2\"" Jun 02 16:39:16.154627 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.154606 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 16:39:16.160834 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.160752 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 16:39:16.163998 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.161397 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb454dfdf-rtglz"] Jun 02 16:39:16.245290 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245262 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245503 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245299 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-secret-telemeter-client\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245503 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245324 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-telemeter-client-tls\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245503 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245411 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-serving-certs-ca-bundle\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245503 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245449 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-federate-client-tls\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245503 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245478 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdl4v\" (UniqueName: \"kubernetes.io/projected/e055beba-4302-4b05-b1b3-97f20e4e5dc8-kube-api-access-fdl4v\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245658 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245503 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.245658 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.245529 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-metrics-client-ca\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346560 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346529 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-federate-client-tls\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346560 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346562 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdl4v\" (UniqueName: \"kubernetes.io/projected/e055beba-4302-4b05-b1b3-97f20e4e5dc8-kube-api-access-fdl4v\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346764 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346586 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346764 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346714 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-metrics-client-ca\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346834 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346778 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346834 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346815 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-secret-telemeter-client\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.346945 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346862 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-telemeter-client-tls\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.347004 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.346964 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-serving-certs-ca-bundle\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.347402 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.347377 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-metrics-client-ca\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.347523 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.347459 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.347579 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.347519 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e055beba-4302-4b05-b1b3-97f20e4e5dc8-serving-certs-ca-bundle\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.349326 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.349305 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-federate-client-tls\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.349437 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.349356 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-secret-telemeter-client\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.349704 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.349686 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.349762 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.349695 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e055beba-4302-4b05-b1b3-97f20e4e5dc8-telemeter-client-tls\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.354667 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.354647 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdl4v\" (UniqueName: \"kubernetes.io/projected/e055beba-4302-4b05-b1b3-97f20e4e5dc8-kube-api-access-fdl4v\") pod \"telemeter-client-5fb454dfdf-rtglz\" (UID: \"e055beba-4302-4b05-b1b3-97f20e4e5dc8\") " pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.469331 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.469282 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" Jun 02 16:39:16.622470 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:16.622443 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb454dfdf-rtglz"] Jun 02 16:39:16.625387 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:39:16.625359 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode055beba_4302_4b05_b1b3_97f20e4e5dc8.slice/crio-78e9317318b9d9c732616f30ff5d7e7ceba754b0b40050637000d551b261d423 WatchSource:0}: Error finding container 78e9317318b9d9c732616f30ff5d7e7ceba754b0b40050637000d551b261d423: Status 404 returned error can't find the container with id 78e9317318b9d9c732616f30ff5d7e7ceba754b0b40050637000d551b261d423 Jun 02 16:39:17.555173 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:17.555140 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" event={"ID":"e055beba-4302-4b05-b1b3-97f20e4e5dc8","Type":"ContainerStarted","Data":"78e9317318b9d9c732616f30ff5d7e7ceba754b0b40050637000d551b261d423"} Jun 02 16:39:19.562896 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:19.562857 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" event={"ID":"e055beba-4302-4b05-b1b3-97f20e4e5dc8","Type":"ContainerStarted","Data":"5158e9ca153a67aee15d70c282dbd48e04a8f5c349a33db9d0e5bc066be47fd3"} Jun 02 16:39:19.562896 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:19.562899 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" event={"ID":"e055beba-4302-4b05-b1b3-97f20e4e5dc8","Type":"ContainerStarted","Data":"8a5c0305b19ba1ae80167e6e28fe64a1efdca703604dcae87af0afa9766a9d98"} Jun 02 16:39:19.563296 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:19.562910 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" event={"ID":"e055beba-4302-4b05-b1b3-97f20e4e5dc8","Type":"ContainerStarted","Data":"b86e7e1f4b0f710493b2c2a96de8101242994d51ab199067c0cbc52a8650b5a2"} Jun 02 16:39:19.587162 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:19.587114 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fb454dfdf-rtglz" podStartSLOduration=1.290668842 podStartE2EDuration="3.587097111s" podCreationTimestamp="2026-06-02 16:39:16 +0000 UTC" firstStartedPulling="2026-06-02 16:39:16.627357942 +0000 UTC m=+162.434477922" lastFinishedPulling="2026-06-02 16:39:18.923786208 +0000 UTC m=+164.730906191" observedRunningTime="2026-06-02 16:39:19.58670985 +0000 UTC m=+165.393829867" watchObservedRunningTime="2026-06-02 16:39:19.587097111 +0000 UTC m=+165.394217114" Jun 02 16:39:20.505774 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.505736 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f4674c8d4-w5gt8"] Jun 02 16:39:20.507938 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.507901 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.524977 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.524951 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4674c8d4-w5gt8"] Jun 02 16:39:20.579952 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.579905 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-config\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.580261 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.579959 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-oauth-serving-cert\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.580261 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.580006 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-oauth-config\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.580261 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.580030 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-service-ca\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.580261 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.580088 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-trusted-ca-bundle\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.580261 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.580109 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xngpg\" (UniqueName: \"kubernetes.io/projected/ea073787-4260-4ff3-a659-a0ccfb20a0d7-kube-api-access-xngpg\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.580261 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.580154 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-serving-cert\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.681350 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.681312 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-service-ca\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.681538 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.681511 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-trusted-ca-bundle\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.681594 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.681577 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xngpg\" (UniqueName: \"kubernetes.io/projected/ea073787-4260-4ff3-a659-a0ccfb20a0d7-kube-api-access-xngpg\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.681721 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.681705 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-serving-cert\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.681843 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.681817 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-config\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.681962 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.681940 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-oauth-serving-cert\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.682028 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.682006 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-oauth-config\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.682101 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.682081 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-service-ca\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.682389 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.682366 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-trusted-ca-bundle\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.682477 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.682425 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-config\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.682599 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.682578 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-oauth-serving-cert\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.684312 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.684288 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-serving-cert\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.684390 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.684341 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-oauth-config\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.689702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.689678 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xngpg\" (UniqueName: \"kubernetes.io/projected/ea073787-4260-4ff3-a659-a0ccfb20a0d7-kube-api-access-xngpg\") pod \"console-7f4674c8d4-w5gt8\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.816932 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.816894 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:20.941070 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:20.941037 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4674c8d4-w5gt8"] Jun 02 16:39:20.944228 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:39:20.944203 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea073787_4260_4ff3_a659_a0ccfb20a0d7.slice/crio-196d211f980119d934109bf9a9c74a4f1bf047350feeaa1cc13d9cd7117db827 WatchSource:0}: Error finding container 196d211f980119d934109bf9a9c74a4f1bf047350feeaa1cc13d9cd7117db827: Status 404 returned error can't find the container with id 196d211f980119d934109bf9a9c74a4f1bf047350feeaa1cc13d9cd7117db827 Jun 02 16:39:21.570019 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:21.569982 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4674c8d4-w5gt8" event={"ID":"ea073787-4260-4ff3-a659-a0ccfb20a0d7","Type":"ContainerStarted","Data":"e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7"} Jun 02 16:39:21.570019 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:21.570022 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4674c8d4-w5gt8" event={"ID":"ea073787-4260-4ff3-a659-a0ccfb20a0d7","Type":"ContainerStarted","Data":"196d211f980119d934109bf9a9c74a4f1bf047350feeaa1cc13d9cd7117db827"} Jun 02 16:39:21.588175 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:21.588130 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f4674c8d4-w5gt8" podStartSLOduration=1.588116974 podStartE2EDuration="1.588116974s" podCreationTimestamp="2026-06-02 16:39:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:39:21.586549731 +0000 UTC m=+167.393669758" watchObservedRunningTime="2026-06-02 16:39:21.588116974 +0000 UTC m=+167.395236976" Jun 02 16:39:30.817816 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:30.817738 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:30.817816 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:30.817770 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:30.822625 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:30.822604 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:31.602355 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.602326 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:39:31.646447 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.646415 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78fccb978d-5lpsp"] Jun 02 16:39:31.714019 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.713982 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f9664c55-8m77v"] Jun 02 16:39:31.716154 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.716132 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.734323 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.734303 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f9664c55-8m77v"] Jun 02 16:39:31.864724 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864666 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-trusted-ca-bundle\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.864724 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864699 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-service-ca\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.865090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864729 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-config\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.865090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864821 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-oauth-config\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.865090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864863 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-oauth-serving-cert\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.865090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864961 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-serving-cert\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.865090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.864988 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjpr\" (UniqueName: \"kubernetes.io/projected/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-kube-api-access-qqjpr\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966056 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966032 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-config\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966150 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966063 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-oauth-config\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966150 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966081 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-oauth-serving-cert\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966150 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966120 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-serving-cert\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966150 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966136 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjpr\" (UniqueName: \"kubernetes.io/projected/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-kube-api-access-qqjpr\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966340 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966242 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-trusted-ca-bundle\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966340 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966269 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-service-ca\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966837 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966778 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-config\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.966837 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.966788 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-oauth-serving-cert\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.967032 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.967010 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-service-ca\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.967143 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.967129 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-trusted-ca-bundle\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.968474 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.968457 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-oauth-config\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.968573 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.968555 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-serving-cert\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:31.973335 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:31.973306 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjpr\" (UniqueName: \"kubernetes.io/projected/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-kube-api-access-qqjpr\") pod \"console-79f9664c55-8m77v\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:32.025702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:32.025670 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:32.142767 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:32.142744 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f9664c55-8m77v"] Jun 02 16:39:32.144499 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:39:32.144474 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aabfab8_0afe_42ea_b0cf_03d554b93cb4.slice/crio-4220cd4ceabdec4f2bfe08dc6c23432313068eee800398090465696a068c90cd WatchSource:0}: Error finding container 4220cd4ceabdec4f2bfe08dc6c23432313068eee800398090465696a068c90cd: Status 404 returned error can't find the container with id 4220cd4ceabdec4f2bfe08dc6c23432313068eee800398090465696a068c90cd Jun 02 16:39:32.601799 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:32.601765 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9664c55-8m77v" event={"ID":"0aabfab8-0afe-42ea-b0cf-03d554b93cb4","Type":"ContainerStarted","Data":"a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2"} Jun 02 16:39:32.601974 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:32.601804 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9664c55-8m77v" event={"ID":"0aabfab8-0afe-42ea-b0cf-03d554b93cb4","Type":"ContainerStarted","Data":"4220cd4ceabdec4f2bfe08dc6c23432313068eee800398090465696a068c90cd"} Jun 02 16:39:32.617842 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:32.617789 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79f9664c55-8m77v" podStartSLOduration=1.617773441 podStartE2EDuration="1.617773441s" podCreationTimestamp="2026-06-02 16:39:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:39:32.617381165 +0000 UTC m=+178.424501167" watchObservedRunningTime="2026-06-02 16:39:32.617773441 +0000 UTC m=+178.424893458" Jun 02 16:39:42.026550 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:42.026519 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:42.026550 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:42.026558 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:42.031055 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:42.031034 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:42.633605 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:42.633580 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:39:42.690953 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:42.690893 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4674c8d4-w5gt8"] Jun 02 16:39:56.667820 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.667761 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-78fccb978d-5lpsp" podUID="5cbc1e73-71ca-4ffa-968a-270784eaa938" containerName="console" containerID="cri-o://4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf" gracePeriod=15 Jun 02 16:39:56.900090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.900068 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78fccb978d-5lpsp_5cbc1e73-71ca-4ffa-968a-270784eaa938/console/0.log" Jun 02 16:39:56.900200 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.900124 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:39:56.955604 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955547 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzzl\" (UniqueName: \"kubernetes.io/projected/5cbc1e73-71ca-4ffa-968a-270784eaa938-kube-api-access-zxzzl\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.955604 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955591 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-trusted-ca-bundle\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.955742 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955616 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-config\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.955742 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955722 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-serving-cert\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.955844 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955764 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-oauth-serving-cert\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.955844 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955807 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-oauth-config\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.955844 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955830 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-service-ca\") pod \"5cbc1e73-71ca-4ffa-968a-270784eaa938\" (UID: \"5cbc1e73-71ca-4ffa-968a-270784eaa938\") " Jun 02 16:39:56.956024 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955983 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:39:56.956024 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.955990 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-config" (OuterVolumeSpecName: "console-config") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:39:56.956240 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.956213 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:39:56.956318 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.956274 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-trusted-ca-bundle\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:56.956318 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.956287 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:56.956318 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.956296 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-service-ca" (OuterVolumeSpecName: "service-ca") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:39:56.957801 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.957777 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:39:56.957884 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.957835 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbc1e73-71ca-4ffa-968a-270784eaa938-kube-api-access-zxzzl" (OuterVolumeSpecName: "kube-api-access-zxzzl") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "kube-api-access-zxzzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:39:56.957943 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:56.957880 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5cbc1e73-71ca-4ffa-968a-270784eaa938" (UID: "5cbc1e73-71ca-4ffa-968a-270784eaa938"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:39:57.057612 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.057584 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-oauth-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:57.057612 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.057608 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-service-ca\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:57.057743 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.057617 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzzl\" (UniqueName: \"kubernetes.io/projected/5cbc1e73-71ca-4ffa-968a-270784eaa938-kube-api-access-zxzzl\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:57.057743 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.057626 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cbc1e73-71ca-4ffa-968a-270784eaa938-console-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:57.057743 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.057636 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cbc1e73-71ca-4ffa-968a-270784eaa938-oauth-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:39:57.674036 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.674010 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78fccb978d-5lpsp_5cbc1e73-71ca-4ffa-968a-270784eaa938/console/0.log" Jun 02 16:39:57.674399 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.674048 2548 generic.go:358] "Generic (PLEG): container finished" podID="5cbc1e73-71ca-4ffa-968a-270784eaa938" containerID="4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf" exitCode=2 Jun 02 16:39:57.674399 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.674080 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fccb978d-5lpsp" event={"ID":"5cbc1e73-71ca-4ffa-968a-270784eaa938","Type":"ContainerDied","Data":"4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf"} Jun 02 16:39:57.674399 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.674118 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fccb978d-5lpsp" event={"ID":"5cbc1e73-71ca-4ffa-968a-270784eaa938","Type":"ContainerDied","Data":"8642d6b3c5c9901d06429fd6d91b20be4d8e31470a15af35c45e285bd293e1e4"} Jun 02 16:39:57.674399 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.674132 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fccb978d-5lpsp" Jun 02 16:39:57.674399 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.674137 2548 scope.go:117] "RemoveContainer" containerID="4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf" Jun 02 16:39:57.682240 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.682226 2548 scope.go:117] "RemoveContainer" containerID="4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf" Jun 02 16:39:57.682479 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:39:57.682461 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf\": container with ID starting with 4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf not found: ID does not exist" containerID="4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf" Jun 02 16:39:57.682547 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.682486 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf"} err="failed to get container status \"4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf\": rpc error: code = NotFound desc = could not find container \"4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf\": container with ID starting with 4b0fcfcfe51fbcae3bb0dadcd8450aff57d5d8d07e5a027fc9a8a1a0d6e74bcf not found: ID does not exist" Jun 02 16:39:57.695368 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.695349 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78fccb978d-5lpsp"] Jun 02 16:39:57.699117 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:57.699094 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78fccb978d-5lpsp"] Jun 02 16:39:58.782580 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:39:58.782547 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cbc1e73-71ca-4ffa-968a-270784eaa938" path="/var/lib/kubelet/pods/5cbc1e73-71ca-4ffa-968a-270784eaa938/volumes" Jun 02 16:40:02.030245 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.030209 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-99bsf"] Jun 02 16:40:02.030702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.030542 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbc1e73-71ca-4ffa-968a-270784eaa938" containerName="console" Jun 02 16:40:02.030702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.030554 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbc1e73-71ca-4ffa-968a-270784eaa938" containerName="console" Jun 02 16:40:02.030702 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.030619 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cbc1e73-71ca-4ffa-968a-270784eaa938" containerName="console" Jun 02 16:40:02.033329 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.033311 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.035898 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.035875 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 16:40:02.041544 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.041523 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-99bsf"] Jun 02 16:40:02.092566 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.092538 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-original-pull-secret\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.092642 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.092596 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-dbus\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.092689 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.092676 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-kubelet-config\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.193293 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.193267 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-dbus\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.193389 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.193310 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-kubelet-config\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.193389 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.193328 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-original-pull-secret\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.193475 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.193409 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-kubelet-config\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.193575 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.193555 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-dbus\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.195486 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.195469 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98f4109e-185b-43de-ba4b-4aa9b0fe76e7-original-pull-secret\") pod \"global-pull-secret-syncer-99bsf\" (UID: \"98f4109e-185b-43de-ba4b-4aa9b0fe76e7\") " pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.343437 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.343368 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99bsf" Jun 02 16:40:02.462323 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.462299 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-99bsf"] Jun 02 16:40:02.464698 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:40:02.464672 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f4109e_185b_43de_ba4b_4aa9b0fe76e7.slice/crio-31d9803f3b4bbdfa1e52b9cac7aca96d182159382d0d374d93f951e3810174f3 WatchSource:0}: Error finding container 31d9803f3b4bbdfa1e52b9cac7aca96d182159382d0d374d93f951e3810174f3: Status 404 returned error can't find the container with id 31d9803f3b4bbdfa1e52b9cac7aca96d182159382d0d374d93f951e3810174f3 Jun 02 16:40:02.688941 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:02.688862 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-99bsf" event={"ID":"98f4109e-185b-43de-ba4b-4aa9b0fe76e7","Type":"ContainerStarted","Data":"31d9803f3b4bbdfa1e52b9cac7aca96d182159382d0d374d93f951e3810174f3"} Jun 02 16:40:07.706252 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:07.706222 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-99bsf" event={"ID":"98f4109e-185b-43de-ba4b-4aa9b0fe76e7","Type":"ContainerStarted","Data":"a376b007407bed8b0f23955748ce369f9369203a36dddd55da19fd95da90963d"} Jun 02 16:40:07.712250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:07.712224 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f4674c8d4-w5gt8" podUID="ea073787-4260-4ff3-a659-a0ccfb20a0d7" containerName="console" containerID="cri-o://e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7" gracePeriod=15 Jun 02 16:40:07.723442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:07.723392 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-99bsf" podStartSLOduration=1.098737978 podStartE2EDuration="5.723379036s" podCreationTimestamp="2026-06-02 16:40:02 +0000 UTC" firstStartedPulling="2026-06-02 16:40:02.466257733 +0000 UTC m=+208.273377713" lastFinishedPulling="2026-06-02 16:40:07.090898791 +0000 UTC m=+212.898018771" observedRunningTime="2026-06-02 16:40:07.721566286 +0000 UTC m=+213.528686291" watchObservedRunningTime="2026-06-02 16:40:07.723379036 +0000 UTC m=+213.530499037" Jun 02 16:40:07.947991 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:07.947966 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f4674c8d4-w5gt8_ea073787-4260-4ff3-a659-a0ccfb20a0d7/console/0.log" Jun 02 16:40:07.948082 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:07.948036 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:40:08.043930 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.043894 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-config\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044056 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.043948 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-oauth-config\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044056 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.043979 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xngpg\" (UniqueName: \"kubernetes.io/projected/ea073787-4260-4ff3-a659-a0ccfb20a0d7-kube-api-access-xngpg\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044056 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044013 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-trusted-ca-bundle\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044056 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044036 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-oauth-serving-cert\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044248 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044058 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-serving-cert\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044248 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044086 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-service-ca\") pod \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\" (UID: \"ea073787-4260-4ff3-a659-a0ccfb20a0d7\") " Jun 02 16:40:08.044425 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044380 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-config" (OuterVolumeSpecName: "console-config") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:40:08.044539 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044498 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:40:08.044591 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044538 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:40:08.044591 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.044538 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:40:08.046190 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.046165 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea073787-4260-4ff3-a659-a0ccfb20a0d7-kube-api-access-xngpg" (OuterVolumeSpecName: "kube-api-access-xngpg") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "kube-api-access-xngpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:40:08.046275 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.046199 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:40:08.046324 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.046268 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea073787-4260-4ff3-a659-a0ccfb20a0d7" (UID: "ea073787-4260-4ff3-a659-a0ccfb20a0d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:40:08.144838 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144811 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.144838 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144836 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-oauth-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.145003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144852 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xngpg\" (UniqueName: \"kubernetes.io/projected/ea073787-4260-4ff3-a659-a0ccfb20a0d7-kube-api-access-xngpg\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.145003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144865 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-trusted-ca-bundle\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.145003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144878 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-oauth-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.145003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144891 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea073787-4260-4ff3-a659-a0ccfb20a0d7-console-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.145003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.144906 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea073787-4260-4ff3-a659-a0ccfb20a0d7-service-ca\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:40:08.711021 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.710995 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f4674c8d4-w5gt8_ea073787-4260-4ff3-a659-a0ccfb20a0d7/console/0.log" Jun 02 16:40:08.711422 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.711037 2548 generic.go:358] "Generic (PLEG): container finished" podID="ea073787-4260-4ff3-a659-a0ccfb20a0d7" containerID="e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7" exitCode=2 Jun 02 16:40:08.711422 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.711099 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4674c8d4-w5gt8" Jun 02 16:40:08.711422 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.711129 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4674c8d4-w5gt8" event={"ID":"ea073787-4260-4ff3-a659-a0ccfb20a0d7","Type":"ContainerDied","Data":"e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7"} Jun 02 16:40:08.711422 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.711168 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4674c8d4-w5gt8" event={"ID":"ea073787-4260-4ff3-a659-a0ccfb20a0d7","Type":"ContainerDied","Data":"196d211f980119d934109bf9a9c74a4f1bf047350feeaa1cc13d9cd7117db827"} Jun 02 16:40:08.711422 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.711183 2548 scope.go:117] "RemoveContainer" containerID="e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7" Jun 02 16:40:08.719470 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.719454 2548 scope.go:117] "RemoveContainer" containerID="e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7" Jun 02 16:40:08.719697 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:40:08.719679 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7\": container with ID starting with e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7 not found: ID does not exist" containerID="e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7" Jun 02 16:40:08.719757 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.719711 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7"} err="failed to get container status \"e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7\": rpc error: code = NotFound desc = could not find container \"e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7\": container with ID starting with e41d4785da297915f3841db34b55116d424ebf2a796badf8c1edd08cf0573ae7 not found: ID does not exist" Jun 02 16:40:08.731883 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.731722 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4674c8d4-w5gt8"] Jun 02 16:40:08.733151 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.733129 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f4674c8d4-w5gt8"] Jun 02 16:40:08.783010 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:08.782988 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea073787-4260-4ff3-a659-a0ccfb20a0d7" path="/var/lib/kubelet/pods/ea073787-4260-4ff3-a659-a0ccfb20a0d7/volumes" Jun 02 16:40:40.476516 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.476479 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh"] Jun 02 16:40:40.476902 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.476794 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea073787-4260-4ff3-a659-a0ccfb20a0d7" containerName="console" Jun 02 16:40:40.476902 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.476807 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea073787-4260-4ff3-a659-a0ccfb20a0d7" containerName="console" Jun 02 16:40:40.476902 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.476866 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea073787-4260-4ff3-a659-a0ccfb20a0d7" containerName="console" Jun 02 16:40:40.525602 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.525577 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh"] Jun 02 16:40:40.525756 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.525679 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.527942 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.527906 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:40:40.528100 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.528031 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jmqr8\"" Jun 02 16:40:40.528100 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.528083 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:40:40.687152 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.687125 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.687257 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.687166 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.687257 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.687195 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9745\" (UniqueName: \"kubernetes.io/projected/d53eb057-6332-4502-a23d-0c97a6c24f71-kube-api-access-f9745\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.787799 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.787770 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9745\" (UniqueName: \"kubernetes.io/projected/d53eb057-6332-4502-a23d-0c97a6c24f71-kube-api-access-f9745\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.787896 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.787825 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.787896 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.787871 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.788224 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.788205 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.788262 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.788242 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.795410 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.795388 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9745\" (UniqueName: \"kubernetes.io/projected/d53eb057-6332-4502-a23d-0c97a6c24f71-kube-api-access-f9745\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.835088 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.835065 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:40:40.956684 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:40.956655 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh"] Jun 02 16:40:40.959562 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:40:40.959528 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53eb057_6332_4502_a23d_0c97a6c24f71.slice/crio-07c55eeea7ca19a8e03cfa4165f071a20770ad25d4ca9fe4d7b3ab23c21c951f WatchSource:0}: Error finding container 07c55eeea7ca19a8e03cfa4165f071a20770ad25d4ca9fe4d7b3ab23c21c951f: Status 404 returned error can't find the container with id 07c55eeea7ca19a8e03cfa4165f071a20770ad25d4ca9fe4d7b3ab23c21c951f Jun 02 16:40:41.806043 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:41.805997 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" event={"ID":"d53eb057-6332-4502-a23d-0c97a6c24f71","Type":"ContainerStarted","Data":"07c55eeea7ca19a8e03cfa4165f071a20770ad25d4ca9fe4d7b3ab23c21c951f"} Jun 02 16:40:48.828672 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:48.828631 2548 generic.go:358] "Generic (PLEG): container finished" podID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerID="a1debef4624ebb48fbb16cee57bef8d72a83cb604bd161b06b4ed87c6ffb5a60" exitCode=0 Jun 02 16:40:48.829063 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:48.828717 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" event={"ID":"d53eb057-6332-4502-a23d-0c97a6c24f71","Type":"ContainerDied","Data":"a1debef4624ebb48fbb16cee57bef8d72a83cb604bd161b06b4ed87c6ffb5a60"} Jun 02 16:40:51.841450 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:51.841418 2548 generic.go:358] "Generic (PLEG): container finished" podID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerID="c5d89f3e365257e2f7fc6f337b440074dbfec3b2c64ebdf6cfc11c95e2c02989" exitCode=0 Jun 02 16:40:51.841837 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:40:51.841455 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" event={"ID":"d53eb057-6332-4502-a23d-0c97a6c24f71","Type":"ContainerDied","Data":"c5d89f3e365257e2f7fc6f337b440074dbfec3b2c64ebdf6cfc11c95e2c02989"} Jun 02 16:41:00.868700 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:00.868669 2548 generic.go:358] "Generic (PLEG): container finished" podID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerID="5825801fecabb7a53aa327e4f5a97b4db6ee68b4e5dae8afb4a3e4b3486153e5" exitCode=0 Jun 02 16:41:00.869062 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:00.868752 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" event={"ID":"d53eb057-6332-4502-a23d-0c97a6c24f71","Type":"ContainerDied","Data":"5825801fecabb7a53aa327e4f5a97b4db6ee68b4e5dae8afb4a3e4b3486153e5"} Jun 02 16:41:01.991995 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:01.991973 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:41:02.064808 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.064780 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9745\" (UniqueName: \"kubernetes.io/projected/d53eb057-6332-4502-a23d-0c97a6c24f71-kube-api-access-f9745\") pod \"d53eb057-6332-4502-a23d-0c97a6c24f71\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " Jun 02 16:41:02.064930 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.064824 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-util\") pod \"d53eb057-6332-4502-a23d-0c97a6c24f71\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " Jun 02 16:41:02.064930 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.064851 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-bundle\") pod \"d53eb057-6332-4502-a23d-0c97a6c24f71\" (UID: \"d53eb057-6332-4502-a23d-0c97a6c24f71\") " Jun 02 16:41:02.065538 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.065512 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-bundle" (OuterVolumeSpecName: "bundle") pod "d53eb057-6332-4502-a23d-0c97a6c24f71" (UID: "d53eb057-6332-4502-a23d-0c97a6c24f71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:41:02.066841 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.066812 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53eb057-6332-4502-a23d-0c97a6c24f71-kube-api-access-f9745" (OuterVolumeSpecName: "kube-api-access-f9745") pod "d53eb057-6332-4502-a23d-0c97a6c24f71" (UID: "d53eb057-6332-4502-a23d-0c97a6c24f71"). InnerVolumeSpecName "kube-api-access-f9745". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:41:02.068808 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.068787 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-util" (OuterVolumeSpecName: "util") pod "d53eb057-6332-4502-a23d-0c97a6c24f71" (UID: "d53eb057-6332-4502-a23d-0c97a6c24f71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:41:02.166003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.165947 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-util\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:41:02.166003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.165966 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d53eb057-6332-4502-a23d-0c97a6c24f71-bundle\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:41:02.166003 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.165976 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9745\" (UniqueName: \"kubernetes.io/projected/d53eb057-6332-4502-a23d-0c97a6c24f71-kube-api-access-f9745\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:41:02.879237 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.879202 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" event={"ID":"d53eb057-6332-4502-a23d-0c97a6c24f71","Type":"ContainerDied","Data":"07c55eeea7ca19a8e03cfa4165f071a20770ad25d4ca9fe4d7b3ab23c21c951f"} Jun 02 16:41:02.879237 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.879227 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm5tnh" Jun 02 16:41:02.879237 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:02.879240 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07c55eeea7ca19a8e03cfa4165f071a20770ad25d4ca9fe4d7b3ab23c21c951f" Jun 02 16:41:08.502608 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.502575 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd"] Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.502993 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="extract" Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.503010 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="extract" Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.503023 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="util" Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.503030 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="util" Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.503046 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="pull" Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.503053 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="pull" Jun 02 16:41:08.503132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.503102 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="d53eb057-6332-4502-a23d-0c97a6c24f71" containerName="extract" Jun 02 16:41:08.546092 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.546067 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd"] Jun 02 16:41:08.546227 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.546175 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.548582 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.548554 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:08.548718 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.548631 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:08.548718 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.548637 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-76wzs\"" Jun 02 16:41:08.610957 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.610927 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpbch\" (UniqueName: \"kubernetes.io/projected/e5b388a2-764f-4eb3-b500-649d2ca2b1c9-kube-api-access-dpbch\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-bnbmd\" (UID: \"e5b388a2-764f-4eb3-b500-649d2ca2b1c9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.611077 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.610971 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b388a2-764f-4eb3-b500-649d2ca2b1c9-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-bnbmd\" (UID: \"e5b388a2-764f-4eb3-b500-649d2ca2b1c9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.711697 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.711667 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpbch\" (UniqueName: \"kubernetes.io/projected/e5b388a2-764f-4eb3-b500-649d2ca2b1c9-kube-api-access-dpbch\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-bnbmd\" (UID: \"e5b388a2-764f-4eb3-b500-649d2ca2b1c9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.711813 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.711706 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b388a2-764f-4eb3-b500-649d2ca2b1c9-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-bnbmd\" (UID: \"e5b388a2-764f-4eb3-b500-649d2ca2b1c9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.712072 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.712057 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5b388a2-764f-4eb3-b500-649d2ca2b1c9-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-bnbmd\" (UID: \"e5b388a2-764f-4eb3-b500-649d2ca2b1c9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.720522 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.720501 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpbch\" (UniqueName: \"kubernetes.io/projected/e5b388a2-764f-4eb3-b500-649d2ca2b1c9-kube-api-access-dpbch\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-bnbmd\" (UID: \"e5b388a2-764f-4eb3-b500-649d2ca2b1c9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.855005 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.854979 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" Jun 02 16:41:08.990359 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:08.990339 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd"] Jun 02 16:41:08.992902 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:41:08.992872 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b388a2_764f_4eb3_b500_649d2ca2b1c9.slice/crio-79aa3dc540f9bcd4b814f9e15159d47a08c610b09e9c71c79bdfeafa0006c57c WatchSource:0}: Error finding container 79aa3dc540f9bcd4b814f9e15159d47a08c610b09e9c71c79bdfeafa0006c57c: Status 404 returned error can't find the container with id 79aa3dc540f9bcd4b814f9e15159d47a08c610b09e9c71c79bdfeafa0006c57c Jun 02 16:41:09.902016 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:09.901982 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" event={"ID":"e5b388a2-764f-4eb3-b500-649d2ca2b1c9","Type":"ContainerStarted","Data":"79aa3dc540f9bcd4b814f9e15159d47a08c610b09e9c71c79bdfeafa0006c57c"} Jun 02 16:41:12.912574 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:12.912541 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" event={"ID":"e5b388a2-764f-4eb3-b500-649d2ca2b1c9","Type":"ContainerStarted","Data":"af268d4551adb24f814871cc95485478e7396d165ba121a7227e2a1c94490fa4"} Jun 02 16:41:12.931381 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:12.931329 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-bnbmd" podStartSLOduration=2.029243335 podStartE2EDuration="4.931312944s" podCreationTimestamp="2026-06-02 16:41:08 +0000 UTC" firstStartedPulling="2026-06-02 16:41:08.995258863 +0000 UTC m=+274.802378844" lastFinishedPulling="2026-06-02 16:41:11.897328473 +0000 UTC m=+277.704448453" observedRunningTime="2026-06-02 16:41:12.931047176 +0000 UTC m=+278.738167178" watchObservedRunningTime="2026-06-02 16:41:12.931312944 +0000 UTC m=+278.738432947" Jun 02 16:41:15.226127 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.226086 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-n6c62"] Jun 02 16:41:15.261777 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.261745 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-n6c62"] Jun 02 16:41:15.261937 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.261858 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.264590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.264567 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tc624\"" Jun 02 16:41:15.264590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.264579 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 16:41:15.264590 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.264585 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 16:41:15.368688 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.368652 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9298e28-ac1b-4ac5-a4ec-61a47301b24c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-n6c62\" (UID: \"d9298e28-ac1b-4ac5-a4ec-61a47301b24c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.368849 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.368695 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xm8f\" (UniqueName: \"kubernetes.io/projected/d9298e28-ac1b-4ac5-a4ec-61a47301b24c-kube-api-access-5xm8f\") pod \"cert-manager-webhook-587ccfb98-n6c62\" (UID: \"d9298e28-ac1b-4ac5-a4ec-61a47301b24c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.470022 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.469987 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9298e28-ac1b-4ac5-a4ec-61a47301b24c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-n6c62\" (UID: \"d9298e28-ac1b-4ac5-a4ec-61a47301b24c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.470180 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.470030 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xm8f\" (UniqueName: \"kubernetes.io/projected/d9298e28-ac1b-4ac5-a4ec-61a47301b24c-kube-api-access-5xm8f\") pod \"cert-manager-webhook-587ccfb98-n6c62\" (UID: \"d9298e28-ac1b-4ac5-a4ec-61a47301b24c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.478362 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.478295 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xm8f\" (UniqueName: \"kubernetes.io/projected/d9298e28-ac1b-4ac5-a4ec-61a47301b24c-kube-api-access-5xm8f\") pod \"cert-manager-webhook-587ccfb98-n6c62\" (UID: \"d9298e28-ac1b-4ac5-a4ec-61a47301b24c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.478485 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.478450 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9298e28-ac1b-4ac5-a4ec-61a47301b24c-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-n6c62\" (UID: \"d9298e28-ac1b-4ac5-a4ec-61a47301b24c\") " pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.584753 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.584723 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:15.706744 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.706611 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-n6c62"] Jun 02 16:41:15.709498 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:41:15.709472 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9298e28_ac1b_4ac5_a4ec_61a47301b24c.slice/crio-ca33bab095dc9418f5ae81d9bb48b2551a12abe382e4cd1a6d716af1e9be392b WatchSource:0}: Error finding container ca33bab095dc9418f5ae81d9bb48b2551a12abe382e4cd1a6d716af1e9be392b: Status 404 returned error can't find the container with id ca33bab095dc9418f5ae81d9bb48b2551a12abe382e4cd1a6d716af1e9be392b Jun 02 16:41:15.922493 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:15.922453 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" event={"ID":"d9298e28-ac1b-4ac5-a4ec-61a47301b24c","Type":"ContainerStarted","Data":"ca33bab095dc9418f5ae81d9bb48b2551a12abe382e4cd1a6d716af1e9be392b"} Jun 02 16:41:18.074955 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.074907 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-r5858"] Jun 02 16:41:18.109897 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.109871 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-r5858"] Jun 02 16:41:18.110063 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.109991 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.113453 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.113432 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p869r\"" Jun 02 16:41:18.191933 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.191894 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5bxt\" (UniqueName: \"kubernetes.io/projected/db5b10f4-26dd-484c-a6db-cb8a083d79d8-kube-api-access-x5bxt\") pod \"cert-manager-cainjector-68b757865b-r5858\" (UID: \"db5b10f4-26dd-484c-a6db-cb8a083d79d8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.192084 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.192053 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db5b10f4-26dd-484c-a6db-cb8a083d79d8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-r5858\" (UID: \"db5b10f4-26dd-484c-a6db-cb8a083d79d8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.293221 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.293183 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db5b10f4-26dd-484c-a6db-cb8a083d79d8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-r5858\" (UID: \"db5b10f4-26dd-484c-a6db-cb8a083d79d8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.293377 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.293259 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5bxt\" (UniqueName: \"kubernetes.io/projected/db5b10f4-26dd-484c-a6db-cb8a083d79d8-kube-api-access-x5bxt\") pod \"cert-manager-cainjector-68b757865b-r5858\" (UID: \"db5b10f4-26dd-484c-a6db-cb8a083d79d8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.304241 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.304213 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db5b10f4-26dd-484c-a6db-cb8a083d79d8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-r5858\" (UID: \"db5b10f4-26dd-484c-a6db-cb8a083d79d8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.304374 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.304354 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5bxt\" (UniqueName: \"kubernetes.io/projected/db5b10f4-26dd-484c-a6db-cb8a083d79d8-kube-api-access-x5bxt\") pod \"cert-manager-cainjector-68b757865b-r5858\" (UID: \"db5b10f4-26dd-484c-a6db-cb8a083d79d8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.421771 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.421700 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" Jun 02 16:41:18.919464 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.919411 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-r5858"] Jun 02 16:41:18.923069 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:41:18.923040 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb5b10f4_26dd_484c_a6db_cb8a083d79d8.slice/crio-92759d8a63ecc79fa3071705af99c2243df9a72700739bf30b5a2017726aa064 WatchSource:0}: Error finding container 92759d8a63ecc79fa3071705af99c2243df9a72700739bf30b5a2017726aa064: Status 404 returned error can't find the container with id 92759d8a63ecc79fa3071705af99c2243df9a72700739bf30b5a2017726aa064 Jun 02 16:41:18.933330 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:18.933305 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" event={"ID":"db5b10f4-26dd-484c-a6db-cb8a083d79d8","Type":"ContainerStarted","Data":"92759d8a63ecc79fa3071705af99c2243df9a72700739bf30b5a2017726aa064"} Jun 02 16:41:19.938364 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:19.938274 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" event={"ID":"d9298e28-ac1b-4ac5-a4ec-61a47301b24c","Type":"ContainerStarted","Data":"dcf21969aa861b1bca50ef9bf880f9b4ced3786826844099730359b24abd738e"} Jun 02 16:41:19.938828 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:19.938389 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:19.939759 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:19.939738 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" event={"ID":"db5b10f4-26dd-484c-a6db-cb8a083d79d8","Type":"ContainerStarted","Data":"97ab307e744fb9bfe8d93dc80bbd9761914552d7d69ca226cae35dd56e70edd0"} Jun 02 16:41:19.953509 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:19.953460 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" podStartSLOduration=1.302724738 podStartE2EDuration="4.953446129s" podCreationTimestamp="2026-06-02 16:41:15 +0000 UTC" firstStartedPulling="2026-06-02 16:41:15.711393807 +0000 UTC m=+281.518513786" lastFinishedPulling="2026-06-02 16:41:19.362115193 +0000 UTC m=+285.169235177" observedRunningTime="2026-06-02 16:41:19.951276328 +0000 UTC m=+285.758396330" watchObservedRunningTime="2026-06-02 16:41:19.953446129 +0000 UTC m=+285.760566132" Jun 02 16:41:19.965448 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:19.965412 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-r5858" podStartSLOduration=1.335577379 podStartE2EDuration="1.965402014s" podCreationTimestamp="2026-06-02 16:41:18 +0000 UTC" firstStartedPulling="2026-06-02 16:41:18.924885985 +0000 UTC m=+284.732005969" lastFinishedPulling="2026-06-02 16:41:19.554710623 +0000 UTC m=+285.361830604" observedRunningTime="2026-06-02 16:41:19.963868425 +0000 UTC m=+285.770988428" watchObservedRunningTime="2026-06-02 16:41:19.965402014 +0000 UTC m=+285.772522016" Jun 02 16:41:25.439322 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.439284 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-75f7r"] Jun 02 16:41:25.441828 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.441802 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.444064 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.444039 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zrmfp\"" Jun 02 16:41:25.453564 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.453542 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-75f7r"] Jun 02 16:41:25.549680 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.549652 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e5b10fe-fcad-404c-83e5-ba4e47b94f61-bound-sa-token\") pod \"cert-manager-79c8d999ff-75f7r\" (UID: \"0e5b10fe-fcad-404c-83e5-ba4e47b94f61\") " pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.549822 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.549723 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqpq\" (UniqueName: \"kubernetes.io/projected/0e5b10fe-fcad-404c-83e5-ba4e47b94f61-kube-api-access-jxqpq\") pod \"cert-manager-79c8d999ff-75f7r\" (UID: \"0e5b10fe-fcad-404c-83e5-ba4e47b94f61\") " pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.651104 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.651076 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e5b10fe-fcad-404c-83e5-ba4e47b94f61-bound-sa-token\") pod \"cert-manager-79c8d999ff-75f7r\" (UID: \"0e5b10fe-fcad-404c-83e5-ba4e47b94f61\") " pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.651225 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.651119 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqpq\" (UniqueName: \"kubernetes.io/projected/0e5b10fe-fcad-404c-83e5-ba4e47b94f61-kube-api-access-jxqpq\") pod \"cert-manager-79c8d999ff-75f7r\" (UID: \"0e5b10fe-fcad-404c-83e5-ba4e47b94f61\") " pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.659031 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.659001 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e5b10fe-fcad-404c-83e5-ba4e47b94f61-bound-sa-token\") pod \"cert-manager-79c8d999ff-75f7r\" (UID: \"0e5b10fe-fcad-404c-83e5-ba4e47b94f61\") " pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.659139 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.659124 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqpq\" (UniqueName: \"kubernetes.io/projected/0e5b10fe-fcad-404c-83e5-ba4e47b94f61-kube-api-access-jxqpq\") pod \"cert-manager-79c8d999ff-75f7r\" (UID: \"0e5b10fe-fcad-404c-83e5-ba4e47b94f61\") " pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.751000 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.750941 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-75f7r" Jun 02 16:41:25.869715 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.869692 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-75f7r"] Jun 02 16:41:25.872647 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:41:25.872620 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e5b10fe_fcad_404c_83e5_ba4e47b94f61.slice/crio-e04b50348d01c86d5eaf8509e602f1c52dc0c6c8bbe8de0c55bd7146e5931f8e WatchSource:0}: Error finding container e04b50348d01c86d5eaf8509e602f1c52dc0c6c8bbe8de0c55bd7146e5931f8e: Status 404 returned error can't find the container with id e04b50348d01c86d5eaf8509e602f1c52dc0c6c8bbe8de0c55bd7146e5931f8e Jun 02 16:41:25.945182 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.945156 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-n6c62" Jun 02 16:41:25.958494 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.958160 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-75f7r" event={"ID":"0e5b10fe-fcad-404c-83e5-ba4e47b94f61","Type":"ContainerStarted","Data":"b88236509209aaa2b1da03cffe5d122807faa36ffc2d70bd540b568c42cf669e"} Jun 02 16:41:25.958494 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.958198 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-75f7r" event={"ID":"0e5b10fe-fcad-404c-83e5-ba4e47b94f61","Type":"ContainerStarted","Data":"e04b50348d01c86d5eaf8509e602f1c52dc0c6c8bbe8de0c55bd7146e5931f8e"} Jun 02 16:41:25.973443 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:25.973381 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-75f7r" podStartSLOduration=0.973367042 podStartE2EDuration="973.367042ms" podCreationTimestamp="2026-06-02 16:41:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:25.972088796 +0000 UTC m=+291.779208799" watchObservedRunningTime="2026-06-02 16:41:25.973367042 +0000 UTC m=+291.780487043" Jun 02 16:41:27.321042 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.321005 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf"] Jun 02 16:41:27.323559 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.323542 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.325783 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.325744 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:41:27.325908 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.325863 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:41:27.326649 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.326630 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jmqr8\"" Jun 02 16:41:27.332732 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.332709 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf"] Jun 02 16:41:27.463039 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.463013 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzchg\" (UniqueName: \"kubernetes.io/projected/c85914b4-76d6-42a4-b6fd-c24a036288d3-kube-api-access-fzchg\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.463160 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.463064 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.463160 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.463141 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.563814 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.563785 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.563953 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.563848 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.563953 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.563894 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzchg\" (UniqueName: \"kubernetes.io/projected/c85914b4-76d6-42a4-b6fd-c24a036288d3-kube-api-access-fzchg\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.564223 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.564202 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.564223 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.564214 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.572662 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.572608 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzchg\" (UniqueName: \"kubernetes.io/projected/c85914b4-76d6-42a4-b6fd-c24a036288d3-kube-api-access-fzchg\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.634277 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.634254 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:27.754894 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.754810 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf"] Jun 02 16:41:27.757042 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:41:27.757011 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85914b4_76d6_42a4_b6fd_c24a036288d3.slice/crio-bb9b48d7dd808080ff351e41c0276f5249cd0db09765caa82715b700476a3be4 WatchSource:0}: Error finding container bb9b48d7dd808080ff351e41c0276f5249cd0db09765caa82715b700476a3be4: Status 404 returned error can't find the container with id bb9b48d7dd808080ff351e41c0276f5249cd0db09765caa82715b700476a3be4 Jun 02 16:41:27.966482 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.966448 2548 generic.go:358] "Generic (PLEG): container finished" podID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerID="9975d2aae03c98e244d57b6e5d4eca24cf32ec9a7055ae077693fc1f8495a386" exitCode=0 Jun 02 16:41:27.966598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.966533 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" event={"ID":"c85914b4-76d6-42a4-b6fd-c24a036288d3","Type":"ContainerDied","Data":"9975d2aae03c98e244d57b6e5d4eca24cf32ec9a7055ae077693fc1f8495a386"} Jun 02 16:41:27.966598 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:27.966575 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" event={"ID":"c85914b4-76d6-42a4-b6fd-c24a036288d3","Type":"ContainerStarted","Data":"bb9b48d7dd808080ff351e41c0276f5249cd0db09765caa82715b700476a3be4"} Jun 02 16:41:29.974869 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:29.974841 2548 generic.go:358] "Generic (PLEG): container finished" podID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerID="e2d02d619832c0d2fb718608e545c0c79c1dad0860c393ef5d8c06eaf1b534d5" exitCode=0 Jun 02 16:41:29.975179 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:29.974934 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" event={"ID":"c85914b4-76d6-42a4-b6fd-c24a036288d3","Type":"ContainerDied","Data":"e2d02d619832c0d2fb718608e545c0c79c1dad0860c393ef5d8c06eaf1b534d5"} Jun 02 16:41:30.980316 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:30.980281 2548 generic.go:358] "Generic (PLEG): container finished" podID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerID="4df1b49adee81e0e56b85aa7db035baa2ecc182a9d0d395a22242b1a473201cd" exitCode=0 Jun 02 16:41:30.980640 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:30.980334 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" event={"ID":"c85914b4-76d6-42a4-b6fd-c24a036288d3","Type":"ContainerDied","Data":"4df1b49adee81e0e56b85aa7db035baa2ecc182a9d0d395a22242b1a473201cd"} Jun 02 16:41:32.103148 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.103126 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:32.200329 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.200302 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzchg\" (UniqueName: \"kubernetes.io/projected/c85914b4-76d6-42a4-b6fd-c24a036288d3-kube-api-access-fzchg\") pod \"c85914b4-76d6-42a4-b6fd-c24a036288d3\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " Jun 02 16:41:32.200460 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.200348 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-bundle\") pod \"c85914b4-76d6-42a4-b6fd-c24a036288d3\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " Jun 02 16:41:32.200460 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.200451 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-util\") pod \"c85914b4-76d6-42a4-b6fd-c24a036288d3\" (UID: \"c85914b4-76d6-42a4-b6fd-c24a036288d3\") " Jun 02 16:41:32.200748 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.200723 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-bundle" (OuterVolumeSpecName: "bundle") pod "c85914b4-76d6-42a4-b6fd-c24a036288d3" (UID: "c85914b4-76d6-42a4-b6fd-c24a036288d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:41:32.202337 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.202308 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c85914b4-76d6-42a4-b6fd-c24a036288d3-kube-api-access-fzchg" (OuterVolumeSpecName: "kube-api-access-fzchg") pod "c85914b4-76d6-42a4-b6fd-c24a036288d3" (UID: "c85914b4-76d6-42a4-b6fd-c24a036288d3"). InnerVolumeSpecName "kube-api-access-fzchg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:41:32.208562 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.208524 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-util" (OuterVolumeSpecName: "util") pod "c85914b4-76d6-42a4-b6fd-c24a036288d3" (UID: "c85914b4-76d6-42a4-b6fd-c24a036288d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:41:32.301527 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.301506 2548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-util\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:41:32.301527 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.301527 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzchg\" (UniqueName: \"kubernetes.io/projected/c85914b4-76d6-42a4-b6fd-c24a036288d3-kube-api-access-fzchg\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:41:32.301653 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.301537 2548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c85914b4-76d6-42a4-b6fd-c24a036288d3-bundle\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:41:32.988250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.988218 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" event={"ID":"c85914b4-76d6-42a4-b6fd-c24a036288d3","Type":"ContainerDied","Data":"bb9b48d7dd808080ff351e41c0276f5249cd0db09765caa82715b700476a3be4"} Jun 02 16:41:32.988250 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.988251 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb9b48d7dd808080ff351e41c0276f5249cd0db09765caa82715b700476a3be4" Jun 02 16:41:32.988435 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:32.988234 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebdznf" Jun 02 16:41:34.650535 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:34.650511 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:41:34.650941 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:34.650593 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:41:34.653801 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:34.653783 2548 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 16:41:39.734656 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734617 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w"] Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734935 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="extract" Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734946 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="extract" Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734960 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="util" Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734965 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="util" Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734973 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="pull" Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.734979 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="pull" Jun 02 16:41:39.736239 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.735032 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="c85914b4-76d6-42a4-b6fd-c24a036288d3" containerName="extract" Jun 02 16:41:39.736820 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.736804 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:39.740154 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.740128 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-c69r5\"" Jun 02 16:41:39.740272 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.740182 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:39.740272 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.740198 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:39.747840 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.747817 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w"] Jun 02 16:41:39.855398 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.855370 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4868t\" (UniqueName: \"kubernetes.io/projected/7b501684-e844-4d19-8078-149bac6d8855-kube-api-access-4868t\") pod \"jobset-operator-747c5859c7-hbh2w\" (UID: \"7b501684-e844-4d19-8078-149bac6d8855\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:39.855530 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.855445 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b501684-e844-4d19-8078-149bac6d8855-tmp\") pod \"jobset-operator-747c5859c7-hbh2w\" (UID: \"7b501684-e844-4d19-8078-149bac6d8855\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:39.956631 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.956604 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4868t\" (UniqueName: \"kubernetes.io/projected/7b501684-e844-4d19-8078-149bac6d8855-kube-api-access-4868t\") pod \"jobset-operator-747c5859c7-hbh2w\" (UID: \"7b501684-e844-4d19-8078-149bac6d8855\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:39.956751 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.956650 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b501684-e844-4d19-8078-149bac6d8855-tmp\") pod \"jobset-operator-747c5859c7-hbh2w\" (UID: \"7b501684-e844-4d19-8078-149bac6d8855\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:39.956993 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.956977 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b501684-e844-4d19-8078-149bac6d8855-tmp\") pod \"jobset-operator-747c5859c7-hbh2w\" (UID: \"7b501684-e844-4d19-8078-149bac6d8855\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:39.964454 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:39.964428 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4868t\" (UniqueName: \"kubernetes.io/projected/7b501684-e844-4d19-8078-149bac6d8855-kube-api-access-4868t\") pod \"jobset-operator-747c5859c7-hbh2w\" (UID: \"7b501684-e844-4d19-8078-149bac6d8855\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:40.045468 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:40.045442 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" Jun 02 16:41:40.170418 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:40.170396 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w"] Jun 02 16:41:40.172543 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:41:40.172519 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b501684_e844_4d19_8078_149bac6d8855.slice/crio-7ae9d608a19ba77dbcfe7feafea36717607f3daf5145fb3bc6f42fb9a79135bf WatchSource:0}: Error finding container 7ae9d608a19ba77dbcfe7feafea36717607f3daf5145fb3bc6f42fb9a79135bf: Status 404 returned error can't find the container with id 7ae9d608a19ba77dbcfe7feafea36717607f3daf5145fb3bc6f42fb9a79135bf Jun 02 16:41:40.174040 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:40.174020 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:41:41.015435 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:41.015389 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" event={"ID":"7b501684-e844-4d19-8078-149bac6d8855","Type":"ContainerStarted","Data":"7ae9d608a19ba77dbcfe7feafea36717607f3daf5145fb3bc6f42fb9a79135bf"} Jun 02 16:41:43.023966 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:43.023928 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" event={"ID":"7b501684-e844-4d19-8078-149bac6d8855","Type":"ContainerStarted","Data":"8bf047e383f7f70edb4d07906af4bdf8873f231e709aa2e9d1860610978fb8e3"} Jun 02 16:41:43.041599 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:41:43.041550 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-hbh2w" podStartSLOduration=1.801730605 podStartE2EDuration="4.041536372s" podCreationTimestamp="2026-06-02 16:41:39 +0000 UTC" firstStartedPulling="2026-06-02 16:41:40.174204892 +0000 UTC m=+305.981324878" lastFinishedPulling="2026-06-02 16:41:42.414010653 +0000 UTC m=+308.221130645" observedRunningTime="2026-06-02 16:41:43.040375326 +0000 UTC m=+308.847495329" watchObservedRunningTime="2026-06-02 16:41:43.041536372 +0000 UTC m=+308.848656374" Jun 02 16:42:07.184624 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.184592 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4"] Jun 02 16:42:07.189828 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.189805 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.192295 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.192269 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 02 16:42:07.192427 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.192303 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 16:42:07.192427 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.192313 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 16:42:07.192427 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.192271 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 02 16:42:07.194379 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.194356 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-r5rkf\"" Jun 02 16:42:07.195873 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.195851 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4"] Jun 02 16:42:07.274894 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.274863 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-754rf\" (UniqueName: \"kubernetes.io/projected/491b0377-b862-41d6-843b-111ee2e41c5f-kube-api-access-754rf\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.274894 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.274896 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/491b0377-b862-41d6-843b-111ee2e41c5f-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.275117 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.274946 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/491b0377-b862-41d6-843b-111ee2e41c5f-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.376286 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.376259 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-754rf\" (UniqueName: \"kubernetes.io/projected/491b0377-b862-41d6-843b-111ee2e41c5f-kube-api-access-754rf\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.376418 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.376294 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/491b0377-b862-41d6-843b-111ee2e41c5f-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.376418 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.376322 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/491b0377-b862-41d6-843b-111ee2e41c5f-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.376878 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.376842 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/491b0377-b862-41d6-843b-111ee2e41c5f-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.378568 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.378549 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/491b0377-b862-41d6-843b-111ee2e41c5f-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.384660 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.384631 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-754rf\" (UniqueName: \"kubernetes.io/projected/491b0377-b862-41d6-843b-111ee2e41c5f-kube-api-access-754rf\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-72xv4\" (UID: \"491b0377-b862-41d6-843b-111ee2e41c5f\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.499684 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.499623 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:07.620244 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:07.620179 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4"] Jun 02 16:42:07.622557 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:42:07.622517 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod491b0377_b862_41d6_843b_111ee2e41c5f.slice/crio-1f87782634b063462762a9247f1d91e78a2a23810ead395689d6d137d4f7ba4d WatchSource:0}: Error finding container 1f87782634b063462762a9247f1d91e78a2a23810ead395689d6d137d4f7ba4d: Status 404 returned error can't find the container with id 1f87782634b063462762a9247f1d91e78a2a23810ead395689d6d137d4f7ba4d Jun 02 16:42:08.107582 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:08.107547 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" event={"ID":"491b0377-b862-41d6-843b-111ee2e41c5f","Type":"ContainerStarted","Data":"1f87782634b063462762a9247f1d91e78a2a23810ead395689d6d137d4f7ba4d"} Jun 02 16:42:11.120758 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:11.120661 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" event={"ID":"491b0377-b862-41d6-843b-111ee2e41c5f","Type":"ContainerStarted","Data":"a1476b36fbd85661baae74731e6db81c3c4903dea7402efa0ece5d4db8b804b6"} Jun 02 16:42:11.120758 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:11.120708 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:42:11.137296 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:11.137249 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" podStartSLOduration=1.552945964 podStartE2EDuration="4.137234358s" podCreationTimestamp="2026-06-02 16:42:07 +0000 UTC" firstStartedPulling="2026-06-02 16:42:07.624261192 +0000 UTC m=+333.431381176" lastFinishedPulling="2026-06-02 16:42:10.208549573 +0000 UTC m=+336.015669570" observedRunningTime="2026-06-02 16:42:11.136425289 +0000 UTC m=+336.943545293" watchObservedRunningTime="2026-06-02 16:42:11.137234358 +0000 UTC m=+336.944354360" Jun 02 16:42:27.129315 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:42:27.129245 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-72xv4" Jun 02 16:44:06.871727 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.871646 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff"] Jun 02 16:44:06.873877 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.873861 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:44:06.876387 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.876360 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-nqndd\"/\"kube-root-ca.crt\"" Jun 02 16:44:06.876831 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.876813 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-nqndd\"/\"openshift-service-ca.crt\"" Jun 02 16:44:06.877044 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.876944 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-nqndd\"/\"default-dockercfg-dfflr\"" Jun 02 16:44:06.889615 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.889595 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff"] Jun 02 16:44:06.975096 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:06.975068 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxc9c\" (UniqueName: \"kubernetes.io/projected/39b4cdcd-4861-4621-933b-84cecd0c2149-kube-api-access-lxc9c\") pod \"test-trainjob-s2jwq-node-0-0-ztwff\" (UID: \"39b4cdcd-4861-4621-933b-84cecd0c2149\") " pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:44:07.076346 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:07.076320 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxc9c\" (UniqueName: \"kubernetes.io/projected/39b4cdcd-4861-4621-933b-84cecd0c2149-kube-api-access-lxc9c\") pod \"test-trainjob-s2jwq-node-0-0-ztwff\" (UID: \"39b4cdcd-4861-4621-933b-84cecd0c2149\") " pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:44:07.084570 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:07.084543 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxc9c\" (UniqueName: \"kubernetes.io/projected/39b4cdcd-4861-4621-933b-84cecd0c2149-kube-api-access-lxc9c\") pod \"test-trainjob-s2jwq-node-0-0-ztwff\" (UID: \"39b4cdcd-4861-4621-933b-84cecd0c2149\") " pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:44:07.187442 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:07.187387 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:44:07.313715 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:07.313691 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff"] Jun 02 16:44:07.315987 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:44:07.315954 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b4cdcd_4861_4621_933b_84cecd0c2149.slice/crio-e6947bba82dcfb28b854d2cd389806b51340a9ad2bdf792aa24b0f47307d2e59 WatchSource:0}: Error finding container e6947bba82dcfb28b854d2cd389806b51340a9ad2bdf792aa24b0f47307d2e59: Status 404 returned error can't find the container with id e6947bba82dcfb28b854d2cd389806b51340a9ad2bdf792aa24b0f47307d2e59 Jun 02 16:44:07.509591 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:07.509553 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" event={"ID":"39b4cdcd-4861-4621-933b-84cecd0c2149","Type":"ContainerStarted","Data":"e6947bba82dcfb28b854d2cd389806b51340a9ad2bdf792aa24b0f47307d2e59"} Jun 02 16:44:48.935763 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:48.935732 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-769967768-fzxwp"] Jun 02 16:44:48.992572 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:48.992542 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769967768-fzxwp"] Jun 02 16:44:48.992727 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:48.992617 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147105 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147077 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-trusted-ca-bundle\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147257 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147114 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-serving-cert\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147257 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147139 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-service-ca\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147257 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147240 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-oauth-config\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147398 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147273 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-config\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147398 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147305 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-oauth-serving-cert\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.147398 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.147376 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l62vb\" (UniqueName: \"kubernetes.io/projected/b9fa24bc-bff5-4547-a21c-b4ecc5412626-kube-api-access-l62vb\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248193 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248123 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-oauth-config\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248193 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248156 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-config\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248193 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248177 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-oauth-serving-cert\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248463 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248210 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l62vb\" (UniqueName: \"kubernetes.io/projected/b9fa24bc-bff5-4547-a21c-b4ecc5412626-kube-api-access-l62vb\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248463 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248256 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-trusted-ca-bundle\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248463 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248282 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-serving-cert\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.248463 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.248311 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-service-ca\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.249149 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.249122 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-oauth-serving-cert\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.249276 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.249122 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-service-ca\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.249445 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.249425 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-config\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.249667 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.249645 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9fa24bc-bff5-4547-a21c-b4ecc5412626-trusted-ca-bundle\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.250948 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.250902 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-oauth-config\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.251090 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.251068 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fa24bc-bff5-4547-a21c-b4ecc5412626-console-serving-cert\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.257882 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.257856 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l62vb\" (UniqueName: \"kubernetes.io/projected/b9fa24bc-bff5-4547-a21c-b4ecc5412626-kube-api-access-l62vb\") pod \"console-769967768-fzxwp\" (UID: \"b9fa24bc-bff5-4547-a21c-b4ecc5412626\") " pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.303560 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.303535 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:49.438477 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.438443 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769967768-fzxwp"] Jun 02 16:44:49.440542 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:44:49.440512 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fa24bc_bff5_4547_a21c_b4ecc5412626.slice/crio-a57de37474fb24eac4e606a7e1db2ce4cdf9620b9bc900d3f3bbbadbb9e9f959 WatchSource:0}: Error finding container a57de37474fb24eac4e606a7e1db2ce4cdf9620b9bc900d3f3bbbadbb9e9f959: Status 404 returned error can't find the container with id a57de37474fb24eac4e606a7e1db2ce4cdf9620b9bc900d3f3bbbadbb9e9f959 Jun 02 16:44:49.695992 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.695948 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769967768-fzxwp" event={"ID":"b9fa24bc-bff5-4547-a21c-b4ecc5412626","Type":"ContainerStarted","Data":"296bb8ab1c35d220265b9bc48655b7c5f2d9775fd0fc920cdbf5936ed558ee1d"} Jun 02 16:44:49.695992 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.695996 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769967768-fzxwp" event={"ID":"b9fa24bc-bff5-4547-a21c-b4ecc5412626","Type":"ContainerStarted","Data":"a57de37474fb24eac4e606a7e1db2ce4cdf9620b9bc900d3f3bbbadbb9e9f959"} Jun 02 16:44:49.716531 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:49.716483 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-769967768-fzxwp" podStartSLOduration=1.716470946 podStartE2EDuration="1.716470946s" podCreationTimestamp="2026-06-02 16:44:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:44:49.713898369 +0000 UTC m=+495.521018371" watchObservedRunningTime="2026-06-02 16:44:49.716470946 +0000 UTC m=+495.523590947" Jun 02 16:44:59.304653 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:59.304618 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:59.305210 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:59.304716 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:59.310386 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:59.310366 2548 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:59.735173 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:59.735085 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769967768-fzxwp" Jun 02 16:44:59.780984 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:44:59.780953 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f9664c55-8m77v"] Jun 02 16:45:23.817706 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:23.817637 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" event={"ID":"39b4cdcd-4861-4621-933b-84cecd0c2149","Type":"ContainerStarted","Data":"26e9ebdb2dd8424e0ec6b2ba46ba22dc327377339564fc416593607de7663de6"} Jun 02 16:45:23.832959 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:23.832890 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" podStartSLOduration=1.561448547 podStartE2EDuration="1m17.832873782s" podCreationTimestamp="2026-06-02 16:44:06 +0000 UTC" firstStartedPulling="2026-06-02 16:44:07.317867161 +0000 UTC m=+453.124987141" lastFinishedPulling="2026-06-02 16:45:23.589292382 +0000 UTC m=+529.396412376" observedRunningTime="2026-06-02 16:45:23.83193107 +0000 UTC m=+529.639051073" watchObservedRunningTime="2026-06-02 16:45:23.832873782 +0000 UTC m=+529.639993786" Jun 02 16:45:24.722009 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:24.721983 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-nqndd_test-trainjob-s2jwq-node-0-0-ztwff_39b4cdcd-4861-4621-933b-84cecd0c2149/node/0.log" Jun 02 16:45:24.805631 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:24.805591 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79f9664c55-8m77v" podUID="0aabfab8-0afe-42ea-b0cf-03d554b93cb4" containerName="console" containerID="cri-o://a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2" gracePeriod=15 Jun 02 16:45:25.063015 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.062985 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f9664c55-8m77v_0aabfab8-0afe-42ea-b0cf-03d554b93cb4/console/0.log" Jun 02 16:45:25.063407 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.063065 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:45:25.173835 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.173799 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-trusted-ca-bundle\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.173835 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.173841 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-oauth-config\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.174125 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.173857 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-oauth-serving-cert\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.174330 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.173890 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-service-ca\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.174479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174378 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-config\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.174479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174291 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-service-ca" (OuterVolumeSpecName: "service-ca") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:45:25.174479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174400 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqjpr\" (UniqueName: \"kubernetes.io/projected/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-kube-api-access-qqjpr\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.174479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174300 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:45:25.174479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174309 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:45:25.174479 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174465 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-serving-cert\") pod \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\" (UID: \"0aabfab8-0afe-42ea-b0cf-03d554b93cb4\") " Jun 02 16:45:25.174789 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174759 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-config" (OuterVolumeSpecName: "console-config") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:45:25.174902 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174879 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-oauth-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.175000 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174908 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-service-ca\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.175000 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174948 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.175000 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.174962 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-trusted-ca-bundle\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.176771 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.176747 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:45:25.176885 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.176830 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:45:25.176967 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.176886 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-kube-api-access-qqjpr" (OuterVolumeSpecName: "kube-api-access-qqjpr") pod "0aabfab8-0afe-42ea-b0cf-03d554b93cb4" (UID: "0aabfab8-0afe-42ea-b0cf-03d554b93cb4"). InnerVolumeSpecName "kube-api-access-qqjpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:45:25.275644 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.275610 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-serving-cert\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.275644 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.275639 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-console-oauth-config\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.275644 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.275649 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqjpr\" (UniqueName: \"kubernetes.io/projected/0aabfab8-0afe-42ea-b0cf-03d554b93cb4-kube-api-access-qqjpr\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:25.825726 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.825699 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f9664c55-8m77v_0aabfab8-0afe-42ea-b0cf-03d554b93cb4/console/0.log" Jun 02 16:45:25.825901 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.825738 2548 generic.go:358] "Generic (PLEG): container finished" podID="0aabfab8-0afe-42ea-b0cf-03d554b93cb4" containerID="a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2" exitCode=2 Jun 02 16:45:25.825901 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.825778 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9664c55-8m77v" event={"ID":"0aabfab8-0afe-42ea-b0cf-03d554b93cb4","Type":"ContainerDied","Data":"a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2"} Jun 02 16:45:25.825901 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.825801 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9664c55-8m77v" event={"ID":"0aabfab8-0afe-42ea-b0cf-03d554b93cb4","Type":"ContainerDied","Data":"4220cd4ceabdec4f2bfe08dc6c23432313068eee800398090465696a068c90cd"} Jun 02 16:45:25.825901 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.825803 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9664c55-8m77v" Jun 02 16:45:25.825901 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.825819 2548 scope.go:117] "RemoveContainer" containerID="a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2" Jun 02 16:45:25.836356 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.836310 2548 scope.go:117] "RemoveContainer" containerID="a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2" Jun 02 16:45:25.836597 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:45:25.836576 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2\": container with ID starting with a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2 not found: ID does not exist" containerID="a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2" Jun 02 16:45:25.836673 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.836601 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2"} err="failed to get container status \"a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2\": rpc error: code = NotFound desc = could not find container \"a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2\": container with ID starting with a6b364eaccf49df3cfa13a766305d31ddc46a4e54155bd7decafeac9a45a1df2 not found: ID does not exist" Jun 02 16:45:25.846338 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.846307 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f9664c55-8m77v"] Jun 02 16:45:25.850329 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:25.850302 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79f9664c55-8m77v"] Jun 02 16:45:26.783439 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:26.783407 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aabfab8-0afe-42ea-b0cf-03d554b93cb4" path="/var/lib/kubelet/pods/0aabfab8-0afe-42ea-b0cf-03d554b93cb4/volumes" Jun 02 16:45:26.830498 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:26.830468 2548 generic.go:358] "Generic (PLEG): container finished" podID="39b4cdcd-4861-4621-933b-84cecd0c2149" containerID="26e9ebdb2dd8424e0ec6b2ba46ba22dc327377339564fc416593607de7663de6" exitCode=0 Jun 02 16:45:26.830651 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:26.830538 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" event={"ID":"39b4cdcd-4861-4621-933b-84cecd0c2149","Type":"ContainerDied","Data":"26e9ebdb2dd8424e0ec6b2ba46ba22dc327377339564fc416593607de7663de6"} Jun 02 16:45:27.723530 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:27.723503 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-nqndd_test-trainjob-s2jwq-node-0-0-ztwff_39b4cdcd-4861-4621-933b-84cecd0c2149/node/0.log" Jun 02 16:45:27.959504 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:27.959482 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:45:28.101380 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:28.101350 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxc9c\" (UniqueName: \"kubernetes.io/projected/39b4cdcd-4861-4621-933b-84cecd0c2149-kube-api-access-lxc9c\") pod \"39b4cdcd-4861-4621-933b-84cecd0c2149\" (UID: \"39b4cdcd-4861-4621-933b-84cecd0c2149\") " Jun 02 16:45:28.103512 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:28.103481 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b4cdcd-4861-4621-933b-84cecd0c2149-kube-api-access-lxc9c" (OuterVolumeSpecName: "kube-api-access-lxc9c") pod "39b4cdcd-4861-4621-933b-84cecd0c2149" (UID: "39b4cdcd-4861-4621-933b-84cecd0c2149"). InnerVolumeSpecName "kube-api-access-lxc9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:45:28.202242 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:28.202215 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxc9c\" (UniqueName: \"kubernetes.io/projected/39b4cdcd-4861-4621-933b-84cecd0c2149-kube-api-access-lxc9c\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:45:28.843329 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:28.843301 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" Jun 02 16:45:28.843477 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:28.843299 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff" event={"ID":"39b4cdcd-4861-4621-933b-84cecd0c2149","Type":"ContainerDied","Data":"e6947bba82dcfb28b854d2cd389806b51340a9ad2bdf792aa24b0f47307d2e59"} Jun 02 16:45:28.843477 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:28.843414 2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6947bba82dcfb28b854d2cd389806b51340a9ad2bdf792aa24b0f47307d2e59" Jun 02 16:45:29.138653 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:29.138581 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-nqndd_test-trainjob-s2jwq-node-0-0-ztwff_39b4cdcd-4861-4621-933b-84cecd0c2149/node/0.log" Jun 02 16:45:30.080315 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080281 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-77sws/must-gather-6mxs5"] Jun 02 16:45:30.080696 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080678 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aabfab8-0afe-42ea-b0cf-03d554b93cb4" containerName="console" Jun 02 16:45:30.080778 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080698 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aabfab8-0afe-42ea-b0cf-03d554b93cb4" containerName="console" Jun 02 16:45:30.080778 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080718 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b4cdcd-4861-4621-933b-84cecd0c2149" containerName="node" Jun 02 16:45:30.080778 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080726 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b4cdcd-4861-4621-933b-84cecd0c2149" containerName="node" Jun 02 16:45:30.080955 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080841 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="0aabfab8-0afe-42ea-b0cf-03d554b93cb4" containerName="console" Jun 02 16:45:30.080955 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.080860 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="39b4cdcd-4861-4621-933b-84cecd0c2149" containerName="node" Jun 02 16:45:30.188528 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.188495 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77sws/must-gather-6mxs5"] Jun 02 16:45:30.188903 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.188607 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.191169 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.191148 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77sws\"/\"kube-root-ca.crt\"" Jun 02 16:45:30.191169 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.191167 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77sws\"/\"openshift-service-ca.crt\"" Jun 02 16:45:30.192012 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.191996 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-77sws\"/\"default-dockercfg-hkmmw\"" Jun 02 16:45:30.319809 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.319775 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw5tt\" (UniqueName: \"kubernetes.io/projected/37345357-72ba-4c74-8128-41588036d393-kube-api-access-nw5tt\") pod \"must-gather-6mxs5\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.320083 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.319815 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37345357-72ba-4c74-8128-41588036d393-must-gather-output\") pod \"must-gather-6mxs5\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.420693 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.420618 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw5tt\" (UniqueName: \"kubernetes.io/projected/37345357-72ba-4c74-8128-41588036d393-kube-api-access-nw5tt\") pod \"must-gather-6mxs5\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.420693 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.420664 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37345357-72ba-4c74-8128-41588036d393-must-gather-output\") pod \"must-gather-6mxs5\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.420967 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.420952 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37345357-72ba-4c74-8128-41588036d393-must-gather-output\") pod \"must-gather-6mxs5\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.428084 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.428060 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw5tt\" (UniqueName: \"kubernetes.io/projected/37345357-72ba-4c74-8128-41588036d393-kube-api-access-nw5tt\") pod \"must-gather-6mxs5\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.497774 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.497748 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:45:30.617987 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.617962 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77sws/must-gather-6mxs5"] Jun 02 16:45:30.620493 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:45:30.620464 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37345357_72ba_4c74_8128_41588036d393.slice/crio-7efa5a6d773ef6459942b4d3262dda9b2a36bb481aef880d2f119d5614f0d536 WatchSource:0}: Error finding container 7efa5a6d773ef6459942b4d3262dda9b2a36bb481aef880d2f119d5614f0d536: Status 404 returned error can't find the container with id 7efa5a6d773ef6459942b4d3262dda9b2a36bb481aef880d2f119d5614f0d536 Jun 02 16:45:30.851136 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:30.851098 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77sws/must-gather-6mxs5" event={"ID":"37345357-72ba-4c74-8128-41588036d393","Type":"ContainerStarted","Data":"7efa5a6d773ef6459942b4d3262dda9b2a36bb481aef880d2f119d5614f0d536"} Jun 02 16:45:34.171170 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:34.171136 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff"] Jun 02 16:45:34.173748 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:34.173714 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-nqndd/test-trainjob-s2jwq-node-0-0-ztwff"] Jun 02 16:45:34.786447 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:34.786410 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b4cdcd-4861-4621-933b-84cecd0c2149" path="/var/lib/kubelet/pods/39b4cdcd-4861-4621-933b-84cecd0c2149/volumes" Jun 02 16:45:38.886338 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:38.886238 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77sws/must-gather-6mxs5" event={"ID":"37345357-72ba-4c74-8128-41588036d393","Type":"ContainerStarted","Data":"ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5"} Jun 02 16:45:38.886338 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:38.886281 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77sws/must-gather-6mxs5" event={"ID":"37345357-72ba-4c74-8128-41588036d393","Type":"ContainerStarted","Data":"fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80"} Jun 02 16:45:38.903088 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:38.903040 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-77sws/must-gather-6mxs5" podStartSLOduration=1.242009965 podStartE2EDuration="8.903025826s" podCreationTimestamp="2026-06-02 16:45:30 +0000 UTC" firstStartedPulling="2026-06-02 16:45:30.622435108 +0000 UTC m=+536.429555102" lastFinishedPulling="2026-06-02 16:45:38.283450983 +0000 UTC m=+544.090570963" observedRunningTime="2026-06-02 16:45:38.900770203 +0000 UTC m=+544.707890206" watchObservedRunningTime="2026-06-02 16:45:38.903025826 +0000 UTC m=+544.710145827" Jun 02 16:45:47.859273 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:47.859244 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-72xv4_491b0377-b862-41d6-843b-111ee2e41c5f/manager/0.log" Jun 02 16:45:48.357095 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:48.357061 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-72xv4_491b0377-b862-41d6-843b-111ee2e41c5f/manager/0.log" Jun 02 16:45:49.006621 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:45:49.006587 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-72xv4_491b0377-b862-41d6-843b-111ee2e41c5f/manager/0.log" Jun 02 16:46:26.074677 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:26.074639 2548 generic.go:358] "Generic (PLEG): container finished" podID="37345357-72ba-4c74-8128-41588036d393" containerID="fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80" exitCode=0 Jun 02 16:46:26.075101 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:26.074682 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77sws/must-gather-6mxs5" event={"ID":"37345357-72ba-4c74-8128-41588036d393","Type":"ContainerDied","Data":"fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80"} Jun 02 16:46:26.075101 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:26.074983 2548 scope.go:117] "RemoveContainer" containerID="fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80" Jun 02 16:46:26.119194 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:26.119172 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-77sws_must-gather-6mxs5_37345357-72ba-4c74-8128-41588036d393/gather/0.log" Jun 02 16:46:29.414987 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:29.414953 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-99bsf_98f4109e-185b-43de-ba4b-4aa9b0fe76e7/global-pull-secret-syncer/0.log" Jun 02 16:46:29.558795 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:29.558766 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9dhrt_8f0f7184-7b77-4c96-84f1-c2afd6b31823/konnectivity-agent/0.log" Jun 02 16:46:29.641923 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:29.641885 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-221.ec2.internal_0821a616737b3cf9dfb29f3445b48368/haproxy/0.log" Jun 02 16:46:31.560170 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.560132 2548 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-77sws/must-gather-6mxs5"] Jun 02 16:46:31.560562 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.560344 2548 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-77sws/must-gather-6mxs5" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="copy" containerID="cri-o://ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5" gracePeriod=2 Jun 02 16:46:31.562342 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.562305 2548 status_manager.go:895] "Failed to get status for pod" podUID="37345357-72ba-4c74-8128-41588036d393" pod="openshift-must-gather-77sws/must-gather-6mxs5" err="pods \"must-gather-6mxs5\" is forbidden: User \"system:node:ip-10-0-129-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-77sws\": no relationship found between node 'ip-10-0-129-221.ec2.internal' and this object" Jun 02 16:46:31.563713 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.563689 2548 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-77sws/must-gather-6mxs5"] Jun 02 16:46:31.790986 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.790967 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-77sws_must-gather-6mxs5_37345357-72ba-4c74-8128-41588036d393/copy/0.log" Jun 02 16:46:31.791311 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.791297 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:46:31.793119 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.793095 2548 status_manager.go:895] "Failed to get status for pod" podUID="37345357-72ba-4c74-8128-41588036d393" pod="openshift-must-gather-77sws/must-gather-6mxs5" err="pods \"must-gather-6mxs5\" is forbidden: User \"system:node:ip-10-0-129-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-77sws\": no relationship found between node 'ip-10-0-129-221.ec2.internal' and this object" Jun 02 16:46:31.854187 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.854140 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37345357-72ba-4c74-8128-41588036d393-must-gather-output\") pod \"37345357-72ba-4c74-8128-41588036d393\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " Jun 02 16:46:31.854270 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.854207 2548 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw5tt\" (UniqueName: \"kubernetes.io/projected/37345357-72ba-4c74-8128-41588036d393-kube-api-access-nw5tt\") pod \"37345357-72ba-4c74-8128-41588036d393\" (UID: \"37345357-72ba-4c74-8128-41588036d393\") " Jun 02 16:46:31.856065 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.856038 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37345357-72ba-4c74-8128-41588036d393-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "37345357-72ba-4c74-8128-41588036d393" (UID: "37345357-72ba-4c74-8128-41588036d393"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:46:31.856235 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.856213 2548 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37345357-72ba-4c74-8128-41588036d393-kube-api-access-nw5tt" (OuterVolumeSpecName: "kube-api-access-nw5tt") pod "37345357-72ba-4c74-8128-41588036d393" (UID: "37345357-72ba-4c74-8128-41588036d393"). InnerVolumeSpecName "kube-api-access-nw5tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:31.954799 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.954780 2548 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37345357-72ba-4c74-8128-41588036d393-must-gather-output\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:46:31.954799 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:31.954801 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw5tt\" (UniqueName: \"kubernetes.io/projected/37345357-72ba-4c74-8128-41588036d393-kube-api-access-nw5tt\") on node \"ip-10-0-129-221.ec2.internal\" DevicePath \"\"" Jun 02 16:46:32.094781 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.094759 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-77sws_must-gather-6mxs5_37345357-72ba-4c74-8128-41588036d393/copy/0.log" Jun 02 16:46:32.095121 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.095098 2548 generic.go:358] "Generic (PLEG): container finished" podID="37345357-72ba-4c74-8128-41588036d393" containerID="ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5" exitCode=143 Jun 02 16:46:32.095192 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.095150 2548 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77sws/must-gather-6mxs5" Jun 02 16:46:32.095231 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.095192 2548 scope.go:117] "RemoveContainer" containerID="ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5" Jun 02 16:46:32.097136 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.097108 2548 status_manager.go:895] "Failed to get status for pod" podUID="37345357-72ba-4c74-8128-41588036d393" pod="openshift-must-gather-77sws/must-gather-6mxs5" err="pods \"must-gather-6mxs5\" is forbidden: User \"system:node:ip-10-0-129-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-77sws\": no relationship found between node 'ip-10-0-129-221.ec2.internal' and this object" Jun 02 16:46:32.102791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.102775 2548 scope.go:117] "RemoveContainer" containerID="fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80" Jun 02 16:46:32.106008 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.105950 2548 status_manager.go:895] "Failed to get status for pod" podUID="37345357-72ba-4c74-8128-41588036d393" pod="openshift-must-gather-77sws/must-gather-6mxs5" err="pods \"must-gather-6mxs5\" is forbidden: User \"system:node:ip-10-0-129-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-77sws\": no relationship found between node 'ip-10-0-129-221.ec2.internal' and this object" Jun 02 16:46:32.114577 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.114562 2548 scope.go:117] "RemoveContainer" containerID="ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5" Jun 02 16:46:32.114794 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:46:32.114774 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5\": container with ID starting with ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5 not found: ID does not exist" containerID="ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5" Jun 02 16:46:32.114875 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.114800 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5"} err="failed to get container status \"ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5\": rpc error: code = NotFound desc = could not find container \"ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5\": container with ID starting with ba98eaa9bad434f4fc25fb3ace3e73cbcbbb4ec7e66915c56696e5fada0dd6e5 not found: ID does not exist" Jun 02 16:46:32.114875 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.114819 2548 scope.go:117] "RemoveContainer" containerID="fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80" Jun 02 16:46:32.115079 ip-10-0-129-221 kubenswrapper[2548]: E0602 16:46:32.115055 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80\": container with ID starting with fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80 not found: ID does not exist" containerID="fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80" Jun 02 16:46:32.115183 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.115080 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80"} err="failed to get container status \"fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80\": rpc error: code = NotFound desc = could not find container \"fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80\": container with ID starting with fd2c7ee17023da2f64ed1abb19496abeaa6d200c8f71063b9a16064429f44f80 not found: ID does not exist" Jun 02 16:46:32.398904 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.398816 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/alertmanager/0.log" Jun 02 16:46:32.439832 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.439811 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/config-reloader/0.log" Jun 02 16:46:32.471349 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.471321 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/kube-rbac-proxy-web/0.log" Jun 02 16:46:32.509226 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.509180 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/kube-rbac-proxy/0.log" Jun 02 16:46:32.534936 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.534902 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/kube-rbac-proxy-metric/0.log" Jun 02 16:46:32.560867 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.560848 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/prom-label-proxy/0.log" Jun 02 16:46:32.584936 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.584900 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2492d4f3-7c2a-4c67-bb07-00b6c9349fb0/init-config-reloader/0.log" Jun 02 16:46:32.665506 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.665453 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-8c6bf_9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41/kube-state-metrics/0.log" Jun 02 16:46:32.688508 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.688478 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-8c6bf_9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41/kube-rbac-proxy-main/0.log" Jun 02 16:46:32.709696 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.709678 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-8c6bf_9a68b1cd-0a80-4bfb-b44c-d2d9a4163c41/kube-rbac-proxy-self/0.log" Jun 02 16:46:32.739344 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.739325 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-777cb697d6-8qv78_08cce9d5-250e-4bcf-bc85-fda47dd55d7c/metrics-server/0.log" Jun 02 16:46:32.783426 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.783402 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37345357-72ba-4c74-8128-41588036d393" path="/var/lib/kubelet/pods/37345357-72ba-4c74-8128-41588036d393/volumes" Jun 02 16:46:32.943640 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.943577 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-szzj9_0d80146e-7876-41a6-aaa1-be47b4cf48f2/node-exporter/0.log" Jun 02 16:46:32.963317 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.963296 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-szzj9_0d80146e-7876-41a6-aaa1-be47b4cf48f2/kube-rbac-proxy/0.log" Jun 02 16:46:32.987675 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:32.987646 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-szzj9_0d80146e-7876-41a6-aaa1-be47b4cf48f2/init-textfile/0.log" Jun 02 16:46:33.256231 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.256159 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dwr44_9646e327-cd1a-435f-8aa7-f6489dad7c9d/prometheus-operator/0.log" Jun 02 16:46:33.276627 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.276603 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dwr44_9646e327-cd1a-435f-8aa7-f6489dad7c9d/kube-rbac-proxy/0.log" Jun 02 16:46:33.299984 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.299954 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-zzfdj_7d4d0de3-5f05-4a42-87a7-58a5256fdf4a/prometheus-operator-admission-webhook/0.log" Jun 02 16:46:33.333607 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.333588 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb454dfdf-rtglz_e055beba-4302-4b05-b1b3-97f20e4e5dc8/telemeter-client/0.log" Jun 02 16:46:33.356956 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.356938 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb454dfdf-rtglz_e055beba-4302-4b05-b1b3-97f20e4e5dc8/reload/0.log" Jun 02 16:46:33.378477 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.378458 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb454dfdf-rtglz_e055beba-4302-4b05-b1b3-97f20e4e5dc8/kube-rbac-proxy/0.log" Jun 02 16:46:33.406419 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.406398 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579c85b85-2d8nz_1a91821c-5df8-4f5e-acb6-7d9cb20b9d57/thanos-query/0.log" Jun 02 16:46:33.427620 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.427603 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579c85b85-2d8nz_1a91821c-5df8-4f5e-acb6-7d9cb20b9d57/kube-rbac-proxy-web/0.log" Jun 02 16:46:33.447045 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.447019 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579c85b85-2d8nz_1a91821c-5df8-4f5e-acb6-7d9cb20b9d57/kube-rbac-proxy/0.log" Jun 02 16:46:33.467032 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.467011 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579c85b85-2d8nz_1a91821c-5df8-4f5e-acb6-7d9cb20b9d57/prom-label-proxy/0.log" Jun 02 16:46:33.490097 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.490079 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579c85b85-2d8nz_1a91821c-5df8-4f5e-acb6-7d9cb20b9d57/kube-rbac-proxy-rules/0.log" Jun 02 16:46:33.509992 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:33.509964 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579c85b85-2d8nz_1a91821c-5df8-4f5e-acb6-7d9cb20b9d57/kube-rbac-proxy-metrics/0.log" Jun 02 16:46:34.674439 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:34.674408 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:46:34.675974 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:34.675953 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:46:35.449254 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:35.449174 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-769967768-fzxwp_b9fa24bc-bff5-4547-a21c-b4ecc5412626/console/0.log" Jun 02 16:46:36.294209 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294176 2548 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh"] Jun 02 16:46:36.294569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294488 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="gather" Jun 02 16:46:36.294569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294498 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="gather" Jun 02 16:46:36.294569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294508 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="copy" Jun 02 16:46:36.294569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294513 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="copy" Jun 02 16:46:36.294569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294560 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="gather" Jun 02 16:46:36.294569 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.294568 2548 memory_manager.go:356] "RemoveStaleState removing state" podUID="37345357-72ba-4c74-8128-41588036d393" containerName="copy" Jun 02 16:46:36.299301 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.299281 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.301427 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.301408 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68cxz\"/\"kube-root-ca.crt\"" Jun 02 16:46:36.301526 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.301454 2548 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-68cxz\"/\"openshift-service-ca.crt\"" Jun 02 16:46:36.301585 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.301533 2548 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-68cxz\"/\"default-dockercfg-d8tvh\"" Jun 02 16:46:36.307539 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.307516 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh"] Jun 02 16:46:36.388940 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.388889 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-proc\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.389100 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.388993 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-sys\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.389100 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.389020 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-podres\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.389100 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.389061 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-lib-modules\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.389218 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.389103 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmw2\" (UniqueName: \"kubernetes.io/projected/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-kube-api-access-jtmw2\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.479038 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.479008 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4gcpd_bbf6b027-67b7-4160-87f5-b48459036201/dns/0.log" Jun 02 16:46:36.490453 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490422 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-sys\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490602 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490461 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-podres\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490602 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490497 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-lib-modules\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490602 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490529 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-sys\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490602 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490535 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmw2\" (UniqueName: \"kubernetes.io/projected/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-kube-api-access-jtmw2\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490603 2548 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-proc\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490660 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-podres\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490667 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-lib-modules\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.490791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.490703 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-proc\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.498225 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.498199 2548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmw2\" (UniqueName: \"kubernetes.io/projected/5d3a75b8-eb08-4ca7-84f5-f4519f6fba62-kube-api-access-jtmw2\") pod \"perf-node-gather-daemonset-hq2fh\" (UID: \"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62\") " pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.499599 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.499577 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4gcpd_bbf6b027-67b7-4160-87f5-b48459036201/kube-rbac-proxy/0.log" Jun 02 16:46:36.609935 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.609847 2548 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:36.656256 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.655472 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpc2k_2c9efb83-321a-4253-8331-46bf5f49dfad/dns-node-resolver/0.log" Jun 02 16:46:36.731656 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:36.731634 2548 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh"] Jun 02 16:46:36.733998 ip-10-0-129-221 kubenswrapper[2548]: W0602 16:46:36.733972 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5d3a75b8_eb08_4ca7_84f5_f4519f6fba62.slice/crio-8b361ffc75703877965344f838162c6cd0a65c5f600183bd4d77178ec89d2c74 WatchSource:0}: Error finding container 8b361ffc75703877965344f838162c6cd0a65c5f600183bd4d77178ec89d2c74: Status 404 returned error can't find the container with id 8b361ffc75703877965344f838162c6cd0a65c5f600183bd4d77178ec89d2c74 Jun 02 16:46:37.070395 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:37.070365 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hr2pk_00eef5d0-511c-48ae-abf3-7e83e90b0c8a/node-ca/0.log" Jun 02 16:46:37.113419 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:37.113385 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" event={"ID":"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62","Type":"ContainerStarted","Data":"e1e8d61d798eb8e3d0ae6d65d8dedeac163b7f2a43de538047440ac1e460204d"} Jun 02 16:46:37.113419 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:37.113419 2548 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" event={"ID":"5d3a75b8-eb08-4ca7-84f5-f4519f6fba62","Type":"ContainerStarted","Data":"8b361ffc75703877965344f838162c6cd0a65c5f600183bd4d77178ec89d2c74"} Jun 02 16:46:37.113595 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:37.113514 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:37.129094 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:37.129056 2548 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" podStartSLOduration=1.129042898 podStartE2EDuration="1.129042898s" podCreationTimestamp="2026-06-02 16:46:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:46:37.126776563 +0000 UTC m=+602.933896565" watchObservedRunningTime="2026-06-02 16:46:37.129042898 +0000 UTC m=+602.936162914" Jun 02 16:46:38.083243 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:38.083200 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kp9qm_ccf0fc42-7d80-4b74-ab2f-5daadddfdecb/serve-healthcheck-canary/0.log" Jun 02 16:46:38.555142 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:38.555118 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jphqf_7704113d-8f4e-4022-ad34-56efc7f69bcc/kube-rbac-proxy/0.log" Jun 02 16:46:38.577929 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:38.577887 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jphqf_7704113d-8f4e-4022-ad34-56efc7f69bcc/exporter/0.log" Jun 02 16:46:38.601589 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:38.601564 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jphqf_7704113d-8f4e-4022-ad34-56efc7f69bcc/extractor/0.log" Jun 02 16:46:40.381755 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:40.381728 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-hbh2w_7b501684-e844-4d19-8078-149bac6d8855/jobset-operator/0.log" Jun 02 16:46:43.126462 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:43.126435 2548 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-68cxz/perf-node-gather-daemonset-hq2fh" Jun 02 16:46:44.914086 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:44.913993 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/kube-multus-additional-cni-plugins/0.log" Jun 02 16:46:44.945205 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:44.945178 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/egress-router-binary-copy/0.log" Jun 02 16:46:44.967132 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:44.967113 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/cni-plugins/0.log" Jun 02 16:46:44.987387 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:44.987357 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/bond-cni-plugin/0.log" Jun 02 16:46:45.007942 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:45.007905 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/routeoverride-cni/0.log" Jun 02 16:46:45.031500 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:45.031482 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/whereabouts-cni-bincopy/0.log" Jun 02 16:46:45.054778 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:45.054755 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d2h5q_e009f8fe-9667-4418-80f7-ee32347895bd/whereabouts-cni/0.log" Jun 02 16:46:45.493519 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:45.493494 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x5628_0c5f2b6e-351e-4a27-a4eb-7653239ed80b/kube-multus/0.log" Jun 02 16:46:45.613942 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:45.613852 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lpdvk_3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1/network-metrics-daemon/0.log" Jun 02 16:46:45.648990 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:45.648967 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lpdvk_3f6d2c4d-a143-4b51-b8ff-473e5b82f2d1/kube-rbac-proxy/0.log" Jun 02 16:46:47.160835 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.160756 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-controller/0.log" Jun 02 16:46:47.185108 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.185083 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/0.log" Jun 02 16:46:47.190742 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.190721 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovn-acl-logging/1.log" Jun 02 16:46:47.212511 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.212482 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/kube-rbac-proxy-node/0.log" Jun 02 16:46:47.236395 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.236374 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 16:46:47.257751 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.257726 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/northd/0.log" Jun 02 16:46:47.280791 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.280759 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/nbdb/0.log" Jun 02 16:46:47.308501 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.308484 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/sbdb/0.log" Jun 02 16:46:47.465283 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:47.465224 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7dxv_8d8dfbd2-9d8b-4452-89cf-4052579e643a/ovnkube-controller/0.log" Jun 02 16:46:48.543786 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:48.543755 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7lngf_e735f456-faa7-4b7d-913d-847d1a4eb70e/network-check-target-container/0.log" Jun 02 16:46:49.487868 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:49.487838 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qs5g9_d503b7d7-8c76-4d1d-b44e-79c59f58d5b3/iptables-alerter/0.log" Jun 02 16:46:50.103048 ip-10-0-129-221 kubenswrapper[2548]: I0602 16:46:50.103018 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fl9hw_b956c2a7-62d8-4c70-af6e-3193e8135558/tuned/0.log"