Jun 03 03:17:37.933383 ip-10-0-132-105 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 03:17:37.933398 ip-10-0-132-105 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 03:17:37.933407 ip-10-0-132-105 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 03:17:37.933716 ip-10-0-132-105 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 03:17:47.935945 ip-10-0-132-105 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 03:17:47.935965 ip-10-0-132-105 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f9ee7cc4baab4a28b99369430e589c0d -- Jun 03 03:20:24.710502 ip-10-0-132-105 systemd[1]: Starting Kubernetes Kubelet... Jun 03 03:20:25.195022 ip-10-0-132-105 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:25.195022 ip-10-0-132-105 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 03:20:25.195022 ip-10-0-132-105 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:25.195022 ip-10-0-132-105 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 03:20:25.195022 ip-10-0-132-105 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:25.196810 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.196656 2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 03:20:25.199638 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199622 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.199638 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199638 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199642 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199645 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199648 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199651 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199653 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199656 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199659 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199662 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199665 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199668 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199670 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199673 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199675 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199678 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199682 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199686 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199689 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199692 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.199701 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199694 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199704 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199709 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199712 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199716 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199719 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199722 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199725 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199728 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199730 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199734 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199736 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199739 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199741 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199744 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199746 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199749 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199751 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199754 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.200158 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199756 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199759 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199761 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199764 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199767 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199770 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199772 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199775 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199777 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199780 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199782 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199785 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199788 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199790 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199792 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199796 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199799 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199801 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199805 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199807 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.200686 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199810 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199812 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199815 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199817 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199820 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199822 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199826 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199829 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199831 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199834 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199836 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199839 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199841 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199844 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199846 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199849 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199851 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199853 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199856 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199858 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.201189 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199861 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199863 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199866 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199868 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199871 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199875 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.199878 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200268 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200274 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200277 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200280 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200283 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200287 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200291 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200294 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200297 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200300 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200302 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200305 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.201698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200308 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200311 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200314 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200316 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200319 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200321 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200324 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200326 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200329 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200331 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200334 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200336 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200338 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200341 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200343 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200346 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200348 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200351 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200355 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.202151 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200358 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200361 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200364 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200366 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200369 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200371 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200375 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200378 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200381 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200383 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200386 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200388 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200391 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200394 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200396 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200399 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200401 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200404 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200406 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200409 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.202671 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200412 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200414 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200417 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200419 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200422 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200424 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200427 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200429 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200432 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200435 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200437 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200439 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200442 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200444 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200447 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200450 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200452 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200454 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200457 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200459 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.203209 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200462 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200464 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200466 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200469 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200471 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200474 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200477 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200481 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200483 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200486 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200489 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200491 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200494 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200496 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.200499 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201305 2570 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201319 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201334 2570 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201343 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201348 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201351 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 03:20:25.203711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201356 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201361 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201364 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201367 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201371 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201374 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201377 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201380 2570 flags.go:64] FLAG: --cgroup-root="" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201383 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201386 2570 flags.go:64] FLAG: --client-ca-file="" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201389 2570 flags.go:64] FLAG: --cloud-config="" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201392 2570 flags.go:64] FLAG: --cloud-provider="external" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201403 2570 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201407 2570 flags.go:64] FLAG: --cluster-domain="" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201410 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201414 2570 flags.go:64] FLAG: --config-dir="" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201417 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201421 2570 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201425 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201429 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201432 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201435 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201438 2570 flags.go:64] FLAG: --contention-profiling="false" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201441 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 03:20:25.204227 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201444 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201447 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201450 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201455 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201458 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201461 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201464 2570 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201467 2570 flags.go:64] FLAG: --enable-server="true" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201470 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201474 2570 flags.go:64] FLAG: --event-burst="100" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201478 2570 flags.go:64] FLAG: --event-qps="50" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201481 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201484 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201487 2570 flags.go:64] FLAG: --eviction-hard="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201491 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201494 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201497 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201500 2570 flags.go:64] FLAG: --eviction-soft="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201503 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201505 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201508 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201511 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201514 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201517 2570 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201524 2570 flags.go:64] FLAG: --feature-gates="" Jun 03 03:20:25.204818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201528 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201531 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201535 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201539 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201542 2570 flags.go:64] FLAG: --healthz-port="10248" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201545 2570 flags.go:64] FLAG: --help="false" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201548 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201551 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201554 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201556 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201560 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201563 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201566 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201569 2570 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201572 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201575 2570 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201578 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201581 2570 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201584 2570 flags.go:64] FLAG: --kube-reserved="" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201587 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201589 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201592 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201595 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201598 2570 flags.go:64] FLAG: --lock-file="" Jun 03 03:20:25.205450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201601 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201604 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201607 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201612 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201615 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201618 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201621 2570 flags.go:64] FLAG: --logging-format="text" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201625 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201628 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201631 2570 flags.go:64] FLAG: --manifest-url="" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201635 2570 flags.go:64] FLAG: --manifest-url-header="" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201640 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201643 2570 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201647 2570 flags.go:64] FLAG: --max-pods="110" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201651 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201654 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201656 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201659 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201662 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201665 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201668 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201676 2570 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201679 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201682 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 03:20:25.206060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201685 2570 flags.go:64] FLAG: --pod-cidr="" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201687 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201693 2570 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201696 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201699 2570 flags.go:64] FLAG: --pods-per-core="0" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201703 2570 flags.go:64] FLAG: --port="10250" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201706 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201709 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ffc3143bae569cc1" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201712 2570 flags.go:64] FLAG: --qos-reserved="" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201715 2570 flags.go:64] FLAG: --read-only-port="10255" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201720 2570 flags.go:64] FLAG: --register-node="true" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201723 2570 flags.go:64] FLAG: --register-schedulable="true" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201726 2570 flags.go:64] FLAG: --register-with-taints="" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201730 2570 flags.go:64] FLAG: --registry-burst="10" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201732 2570 flags.go:64] FLAG: --registry-qps="5" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201736 2570 flags.go:64] FLAG: --reserved-cpus="" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201739 2570 flags.go:64] FLAG: --reserved-memory="" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201743 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201747 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201750 2570 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201753 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201756 2570 flags.go:64] FLAG: --runonce="false" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201759 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201762 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201765 2570 flags.go:64] FLAG: --seccomp-default="false" Jun 03 03:20:25.206732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201768 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201771 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201774 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201778 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201781 2570 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201783 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201786 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201789 2570 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201792 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201795 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201798 2570 flags.go:64] FLAG: --system-cgroups="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201800 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201806 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201808 2570 flags.go:64] FLAG: --tls-cert-file="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201811 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201815 2570 flags.go:64] FLAG: --tls-min-version="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201817 2570 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201824 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201827 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201829 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201832 2570 flags.go:64] FLAG: --v="2" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201837 2570 flags.go:64] FLAG: --version="false" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201841 2570 flags.go:64] FLAG: --vmodule="" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201845 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.201849 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 03:20:25.207358 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201945 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201948 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201951 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201954 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201958 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201961 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201964 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201967 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201969 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201972 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201975 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201978 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201980 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201983 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201986 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201988 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201991 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201993 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201996 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.201999 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.207958 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202001 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202004 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202006 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202009 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202013 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202015 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202018 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202021 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202023 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202026 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202030 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202035 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202038 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202040 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202043 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202046 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202048 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202051 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202054 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202057 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.208516 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202059 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202062 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202064 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202067 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202069 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202072 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202075 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202078 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202080 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202083 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202085 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202088 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202090 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202094 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202098 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202101 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202105 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202108 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202111 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.209042 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202114 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202117 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202119 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202122 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202125 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202128 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202130 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202133 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202136 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202138 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202141 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202144 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202146 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202149 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202152 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202154 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202157 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202160 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202162 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.209537 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202165 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202168 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202170 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202173 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202175 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202178 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202180 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.202183 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.202773 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.209834 2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.209851 2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209898 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209903 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209907 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209910 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209913 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.210016 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209916 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209919 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209922 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209925 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209928 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209931 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209934 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209937 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209940 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209943 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209945 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209948 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209951 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209953 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209956 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209958 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209961 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209963 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209966 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.210439 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209969 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209971 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209974 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209976 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209979 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209981 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209985 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209990 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209993 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209997 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.209999 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210002 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210005 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210007 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210010 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210012 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210015 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210018 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210020 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210023 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.210906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210026 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210028 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210032 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210034 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210037 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210040 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210042 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210045 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210048 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210051 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210053 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210056 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210058 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210061 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210063 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210066 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210068 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210071 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210075 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.211413 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210079 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210082 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210085 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210088 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210091 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210094 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210096 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210099 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210102 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210105 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210108 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210110 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210113 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210115 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210118 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210120 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210123 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210126 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210129 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210132 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.211888 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210134 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210137 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210139 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.210144 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210263 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210270 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210273 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210276 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210279 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210282 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210285 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210287 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210290 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210293 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210296 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210299 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:25.212503 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210301 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210304 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210307 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210309 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210312 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210314 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210317 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210319 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210322 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210324 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210327 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210329 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210332 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210335 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210337 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210339 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210342 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210345 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210348 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:25.212906 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210350 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210352 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210355 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210358 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210360 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210363 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210365 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210368 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210370 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210373 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210376 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210378 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210381 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210384 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210386 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210389 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210391 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210393 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210396 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210398 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:25.213379 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210401 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210403 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210406 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210408 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210411 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210414 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210416 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210419 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210422 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210424 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210427 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210429 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210432 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210435 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210437 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210440 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210443 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210445 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210448 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:25.213915 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210451 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210454 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210457 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210460 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210463 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210465 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210469 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210472 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210475 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210477 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210480 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210483 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210485 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210488 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210490 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:25.214408 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:25.210493 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:25.214791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.210498 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:25.214791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.211266 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 03:20:25.214791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.213369 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 03:20:25.214791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.214636 2570 server.go:1019] "Starting client certificate rotation" Jun 03 03:20:25.214791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.214732 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 03:20:25.214791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.214763 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 03:20:25.240804 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.240776 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 03:20:25.242661 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.242640 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 03:20:25.263445 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.263422 2570 log.go:25] "Validated CRI v1 runtime API" Jun 03 03:20:25.269689 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.269666 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 03:20:25.269956 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.269942 2570 log.go:25] "Validated CRI v1 image API" Jun 03 03:20:25.271229 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.271195 2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 03:20:25.278034 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.278009 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ada0c37f-3e8f-49d6-bfbf-1800c97c0200:/dev/nvme0n1p4 b185cc1b-6ff1-4bbb-886d-708f3f875e69:/dev/nvme0n1p3] Jun 03 03:20:25.278083 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.278034 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 03:20:25.283533 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.283422 2570 manager.go:217] Machine: {Timestamp:2026-06-03 03:20:25.282115418 +0000 UTC m=+0.443839079 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100145 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24efe87de934f27435ff52cd6ee542 SystemUUID:ec24efe8-7de9-34f2-7435-ff52cd6ee542 BootID:f9ee7cc4-baab-4a28-b993-69430e589c0d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:9c:14:a1:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:9c:14:a1:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:25:41:60:2e:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 03:20:25.283533 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.283530 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 03:20:25.283642 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.283613 2570 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 03:20:25.285996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.285972 2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 03:20:25.286132 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.285997 2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 03:20:25.286180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.286141 2570 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 03:20:25.286180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.286150 2570 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 03:20:25.286180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.286157 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 03:20:25.287830 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.287818 2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 03:20:25.289474 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.289463 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 03 03:20:25.289586 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.289577 2570 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 03:20:25.292161 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.292151 2570 kubelet.go:491] "Attempting to sync node with API server" Jun 03 03:20:25.292199 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.292165 2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 03:20:25.292199 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.292177 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 03:20:25.292199 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.292186 2570 kubelet.go:397] "Adding apiserver pod source" Jun 03 03:20:25.292199 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.292194 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 03:20:25.293638 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.293626 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 03:20:25.293691 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.293645 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 03:20:25.297677 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.297654 2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 03:20:25.300023 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.300009 2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 03:20:25.302230 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302203 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 03:20:25.302230 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302234 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302241 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302246 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302269 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302275 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302281 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302286 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302292 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302298 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302314 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 03:20:25.302419 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.302320 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 03:20:25.303620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.303610 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 03:20:25.303620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.303620 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 03:20:25.307351 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.307332 2570 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 03:20:25.307438 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.307341 2570 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 03:20:25.307438 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.307353 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 03:20:25.307438 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.307406 2570 server.go:1295] "Started kubelet" Jun 03 03:20:25.307438 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.307408 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 03:20:25.307583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.307506 2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 03:20:25.307583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.307568 2570 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 03:20:25.308248 ip-10-0-132-105 systemd[1]: Started Kubernetes Kubelet. Jun 03 03:20:25.308399 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.308365 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 03:20:25.308737 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.308701 2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 03:20:25.311128 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.311114 2570 server.go:317] "Adding debug handlers to kubelet server" Jun 03 03:20:25.313330 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.312437 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-105.ec2.internal.18b5740ca25d7e28 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-105.ec2.internal,UID:ip-10-0-132-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-105.ec2.internal,},FirstTimestamp:2026-06-03 03:20:25.307364904 +0000 UTC m=+0.469088573,LastTimestamp:2026-06-03 03:20:25.307364904 +0000 UTC m=+0.469088573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-105.ec2.internal,}" Jun 03 03:20:25.314791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.314772 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 03:20:25.315475 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.315457 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 03:20:25.315695 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.315673 2570 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 03:20:25.315695 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.315692 2570 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 03:20:25.315846 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.315795 2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 03:20:25.315846 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.315830 2570 reconstruct.go:97] "Volume reconstruction finished" Jun 03 03:20:25.315846 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.315839 2570 reconciler.go:26] "Reconciler: start to sync state" Jun 03 03:20:25.316306 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316290 2570 factory.go:55] Registering systemd factory Jun 03 03:20:25.316306 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316303 2570 factory.go:223] Registration of the systemd container factory successfully Jun 03 03:20:25.316461 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.316437 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.316557 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316514 2570 factory.go:153] Registering CRI-O factory Jun 03 03:20:25.316557 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316529 2570 factory.go:223] Registration of the crio container factory successfully Jun 03 03:20:25.316655 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316581 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 03:20:25.316655 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316600 2570 factory.go:103] Registering Raw factory Jun 03 03:20:25.316655 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.316615 2570 manager.go:1196] Started watching for new ooms in manager Jun 03 03:20:25.316762 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.316648 2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 03:20:25.317351 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.317328 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 03:20:25.317547 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.317503 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 03:20:25.317806 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.317788 2570 manager.go:319] Starting recovery of all containers Jun 03 03:20:25.327125 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.326931 2570 manager.go:324] Recovery completed Jun 03 03:20:25.330296 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.330275 2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 03:20:25.333127 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.333115 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.335620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.335603 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.335706 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.335631 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.335706 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.335642 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.336133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.336116 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 03:20:25.336133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.336129 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 03:20:25.336290 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.336145 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 03 03:20:25.338870 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.338858 2570 policy_none.go:49] "None policy: Start" Jun 03 03:20:25.338923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.338875 2570 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 03:20:25.338923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.338886 2570 state_mem.go:35] "Initializing new in-memory state store" Jun 03 03:20:25.348103 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.348035 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-105.ec2.internal.18b5740ca40c9d53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-105.ec2.internal,UID:ip-10-0-132-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-105.ec2.internal,},FirstTimestamp:2026-06-03 03:20:25.335618899 +0000 UTC m=+0.497342561,LastTimestamp:2026-06-03 03:20:25.335618899 +0000 UTC m=+0.497342561,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-105.ec2.internal,}" Jun 03 03:20:25.356930 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.356866 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-105.ec2.internal.18b5740ca40ce113 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-105.ec2.internal,UID:ip-10-0-132-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-105.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-105.ec2.internal,},FirstTimestamp:2026-06-03 03:20:25.335636243 +0000 UTC m=+0.497359904,LastTimestamp:2026-06-03 03:20:25.335636243 +0000 UTC m=+0.497359904,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-105.ec2.internal,}" Jun 03 03:20:25.363250 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.363226 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tthvz" Jun 03 03:20:25.364515 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.364449 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-105.ec2.internal.18b5740ca40d0706 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-105.ec2.internal,UID:ip-10-0-132-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-105.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-105.ec2.internal,},FirstTimestamp:2026-06-03 03:20:25.335645958 +0000 UTC m=+0.497369620,LastTimestamp:2026-06-03 03:20:25.335645958 +0000 UTC m=+0.497369620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-105.ec2.internal,}" Jun 03 03:20:25.370369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.370322 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tthvz" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.373757 2570 manager.go:341] "Starting Device Plugin manager" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.373790 2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.373802 2570 server.go:85] "Starting device plugin registration server" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.374042 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.374056 2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.374131 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.374198 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.374207 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.374852 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 03:20:25.387468 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.374891 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.410315 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.410283 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 03:20:25.411422 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.411405 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 03:20:25.411531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.411430 2570 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 03:20:25.411531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.411452 2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 03:20:25.411531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.411459 2570 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 03:20:25.411531 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.411497 2570 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 03:20:25.414205 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.414185 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:25.474510 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.474429 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.475433 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.475415 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.475503 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.475450 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.475503 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.475464 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.475580 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.475512 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.486337 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.486312 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.486337 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.486336 2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-105.ec2.internal\": node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.511650 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.511619 2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal"] Jun 03 03:20:25.511799 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.511692 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.513795 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.513779 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.513909 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.513810 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.513909 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.513824 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.514294 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.514277 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.515166 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515151 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.515325 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515312 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.515377 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515340 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.515835 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515820 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.515905 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515846 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.515905 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515852 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.515905 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515860 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.515905 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515880 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.515905 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.515895 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.517155 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.517141 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.517207 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.517165 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:25.517831 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.517817 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:25.517897 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.517841 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:25.517897 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.517851 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:25.541918 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.541894 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-105.ec2.internal\" not found" node="ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.546398 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.546383 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-105.ec2.internal\" not found" node="ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.614396 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.614365 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.616635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.616617 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea0f503daa5a72440061aa27dbe6c8a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal\" (UID: \"ea0f503daa5a72440061aa27dbe6c8a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.616693 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.616644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea0f503daa5a72440061aa27dbe6c8a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal\" (UID: \"ea0f503daa5a72440061aa27dbe6c8a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.616693 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.616661 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2437879e208ceb33c4ad964cb808c2a3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-105.ec2.internal\" (UID: \"2437879e208ceb33c4ad964cb808c2a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.714580 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.714545 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.716758 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.716742 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea0f503daa5a72440061aa27dbe6c8a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal\" (UID: \"ea0f503daa5a72440061aa27dbe6c8a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.716810 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.716768 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea0f503daa5a72440061aa27dbe6c8a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal\" (UID: \"ea0f503daa5a72440061aa27dbe6c8a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.716859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.716811 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2437879e208ceb33c4ad964cb808c2a3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-105.ec2.internal\" (UID: \"2437879e208ceb33c4ad964cb808c2a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.716859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.716840 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2437879e208ceb33c4ad964cb808c2a3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-105.ec2.internal\" (UID: \"2437879e208ceb33c4ad964cb808c2a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.716938 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.716840 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea0f503daa5a72440061aa27dbe6c8a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal\" (UID: \"ea0f503daa5a72440061aa27dbe6c8a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.716938 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.716872 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea0f503daa5a72440061aa27dbe6c8a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal\" (UID: \"ea0f503daa5a72440061aa27dbe6c8a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.815168 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.815070 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:25.844380 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.844360 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.851344 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:25.851326 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" Jun 03 03:20:25.916226 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:25.916184 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.016500 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.016471 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.116885 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.116820 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.166289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.166267 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:26.214344 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.214325 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 03:20:26.214807 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.214471 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:26.214807 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.214485 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:26.217564 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.217545 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.315670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.315645 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 03:20:26.317805 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.317686 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.323927 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.323904 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 03:20:26.327297 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.327276 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:26.341157 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:26.341129 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2437879e208ceb33c4ad964cb808c2a3.slice/crio-4db070ee5054475a56d1c2ddf837a85831df7e8a32209219ff1b06739bd6c930 WatchSource:0}: Error finding container 4db070ee5054475a56d1c2ddf837a85831df7e8a32209219ff1b06739bd6c930: Status 404 returned error can't find the container with id 4db070ee5054475a56d1c2ddf837a85831df7e8a32209219ff1b06739bd6c930 Jun 03 03:20:26.341387 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:26.341366 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0f503daa5a72440061aa27dbe6c8a1.slice/crio-047b45fcd1c822c635ffcdf149099bc58a94df08698a4c3239017f1b6fb41818 WatchSource:0}: Error finding container 047b45fcd1c822c635ffcdf149099bc58a94df08698a4c3239017f1b6fb41818: Status 404 returned error can't find the container with id 047b45fcd1c822c635ffcdf149099bc58a94df08698a4c3239017f1b6fb41818 Jun 03 03:20:26.344649 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.344630 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:20:26.372168 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.372114 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 03:15:25 +0000 UTC" deadline="2027-11-20 11:32:21.269348855 +0000 UTC" Jun 03 03:20:26.372168 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.372139 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12848h11m54.897211874s" Jun 03 03:20:26.399618 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.399597 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-82r5x" Jun 03 03:20:26.406720 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.406705 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-82r5x" Jun 03 03:20:26.414533 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.414496 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" event={"ID":"2437879e208ceb33c4ad964cb808c2a3","Type":"ContainerStarted","Data":"4db070ee5054475a56d1c2ddf837a85831df7e8a32209219ff1b06739bd6c930"} Jun 03 03:20:26.415414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.415397 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" event={"ID":"ea0f503daa5a72440061aa27dbe6c8a1","Type":"ContainerStarted","Data":"047b45fcd1c822c635ffcdf149099bc58a94df08698a4c3239017f1b6fb41818"} Jun 03 03:20:26.418715 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.418702 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.519116 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.519095 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.619514 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.619491 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.719944 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.719919 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.820757 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:26.820707 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-105.ec2.internal\" not found" Jun 03 03:20:26.898568 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.898491 2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:26.916319 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.916284 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" Jun 03 03:20:26.926977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.926946 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 03:20:26.928401 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.928227 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" Jun 03 03:20:26.935346 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:26.935325 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 03:20:27.294017 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.293979 2570 apiserver.go:52] "Watching apiserver" Jun 03 03:20:27.301476 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.301454 2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 03:20:27.301831 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.301807 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-gvqd9","kube-system/konnectivity-agent-sv9jl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht","openshift-image-registry/node-ca-pmfhp","openshift-multus/network-metrics-daemon-pfx99","openshift-ovn-kubernetes/ovnkube-node-vdbxv","kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal","openshift-cluster-node-tuning-operator/tuned-slzcg","openshift-dns/node-resolver-jv4k5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal","openshift-multus/multus-5k7w8","openshift-multus/multus-additional-cni-plugins-48thb","openshift-network-diagnostics/network-check-target-gmwjq"] Jun 03 03:20:27.303503 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.303484 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.304887 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.304866 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.305495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.305476 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 03:20:27.305697 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.305684 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.305741 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.305725 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 03:20:27.306059 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.305482 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 03:20:27.306059 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.305906 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.306059 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.305984 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q5ttq\"" Jun 03 03:20:27.306341 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.306320 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.307124 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.307108 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 03:20:27.307237 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.307106 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xqwwh\"" Jun 03 03:20:27.307237 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.307161 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 03:20:27.308197 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.308176 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 03:20:27.308301 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.308274 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.308356 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.308307 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.308488 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.308471 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j2tz8\"" Jun 03 03:20:27.309601 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.309577 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.309701 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.309659 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.309763 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.309723 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:27.311374 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.311300 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.311790 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.311769 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 03:20:27.312638 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.312620 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.313024 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.313007 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c9hnt\"" Jun 03 03:20:27.314478 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.313402 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.314478 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.313921 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.314621 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.314600 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-62jq7\"" Jun 03 03:20:27.315617 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.315011 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.315835 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.315815 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 03:20:27.316860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.316529 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 03:20:27.316860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.316557 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 03:20:27.316860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.316574 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 03:20:27.316860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.316818 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.316860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.316856 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.317384 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.317368 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 03:20:27.317472 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.317428 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.318172 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.318155 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.318527 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.318490 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.318945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.318896 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.319037 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.319022 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cldvj\"" Jun 03 03:20:27.319103 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.319053 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.319156 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.319126 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xwlvx\"" Jun 03 03:20:27.319946 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.319924 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:27.320044 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.319990 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:27.320434 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.320417 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dcch9\"" Jun 03 03:20:27.320549 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.320527 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 03:20:27.321247 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.320980 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 03:20:27.321807 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.321789 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.323700 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.323700 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323667 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-registration-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.323859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-systemd-units\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.323859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-ovnkube-config\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.323859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysconfig\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.323859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323774 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxd5k\" (UniqueName: \"kubernetes.io/projected/f5333f73-4353-4f94-93ef-4137cf3b76e0-kube-api-access-bxd5k\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.323859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323780 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 03:20:27.323859 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysctl-conf\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-host\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323915 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8nl7n\"" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323934 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-kubelet\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323960 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-run-netns\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.323983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-cni-netd\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2c94\" (UniqueName: \"kubernetes.io/projected/a02c2434-65dd-4c98-ab3c-09afd173f7a1-kube-api-access-d2c94\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324048 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-tuned\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e15bac92-028f-4cf2-b21b-625c36a65398-host\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324110 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-env-overrides\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-kubernetes\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-ovnkube-script-lib\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b6c8dec-0ca2-4629-a47c-12917d920f65-agent-certs\") pod \"konnectivity-agent-sv9jl\" (UID: \"3b6c8dec-0ca2-4629-a47c-12917d920f65\") " pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324277 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324292 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-ovn\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324310 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-os-release\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324335 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-etc-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-sys-fs\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-system-cni-dir\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv26l\" (UniqueName: \"kubernetes.io/projected/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-kube-api-access-bv26l\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-slash\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-var-lib-kubelet\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324564 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-cni-bin\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b6c8dec-0ca2-4629-a47c-12917d920f65-konnectivity-ca\") pod \"konnectivity-agent-sv9jl\" (UID: \"3b6c8dec-0ca2-4629-a47c-12917d920f65\") " pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324600 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-device-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.324635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324618 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e15bac92-028f-4cf2-b21b-625c36a65398-serviceca\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324641 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-systemd\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-log-socket\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysctl-d\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324751 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3c83c11-833e-4fcc-8df4-b40016a8fc31-host-slash\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-sys\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324835 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6nkh\" (UniqueName: \"kubernetes.io/projected/e15bac92-028f-4cf2-b21b-625c36a65398-kube-api-access-s6nkh\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-var-lib-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1295a97b-a599-4291-8f8a-1d160a77d700-ovn-node-metrics-cert\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324936 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-socket-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324967 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.324990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmls\" (UniqueName: \"kubernetes.io/projected/1295a97b-a599-4291-8f8a-1d160a77d700-kube-api-access-jtmls\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325033 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfdda73e-bc72-4301-a73e-3668f7337a89-tmp\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325078 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swr9r\" (UniqueName: \"kubernetes.io/projected/dfdda73e-bc72-4301-a73e-3668f7337a89-kube-api-access-swr9r\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.325383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325092 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cni-binary-copy\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325111 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3c83c11-833e-4fcc-8df4-b40016a8fc31-iptables-alerter-script\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325176 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-lib-modules\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-run-ovn-kubernetes\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325271 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-modprobe-d\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-systemd\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-run\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325382 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cnibin\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325410 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-node-log\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.326148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.325434 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdq69\" (UniqueName: \"kubernetes.io/projected/b3c83c11-833e-4fcc-8df4-b40016a8fc31-kube-api-access-sdq69\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.407816 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.407779 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 03:15:26 +0000 UTC" deadline="2027-12-14 00:54:27.687021834 +0000 UTC" Jun 03 03:20:27.407816 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.407811 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13413h34m0.279213689s" Jun 03 03:20:27.416802 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.416770 2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 03:20:27.425638 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425610 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysconfig\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.425765 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425656 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:27.425765 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425685 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxd5k\" (UniqueName: \"kubernetes.io/projected/f5333f73-4353-4f94-93ef-4137cf3b76e0-kube-api-access-bxd5k\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.425765 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425725 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysctl-conf\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.425765 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425734 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysconfig\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.425765 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425754 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-host\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425771 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-kubelet\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425787 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-run-netns\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425818 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-cni-netd\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425845 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-cnibin\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425862 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49fc9946-f022-453f-a020-09c5e1771327-multus-daemon-config\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425877 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysctl-conf\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-cni-netd\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425878 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-host\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425895 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2c94\" (UniqueName: \"kubernetes.io/projected/a02c2434-65dd-4c98-ab3c-09afd173f7a1-kube-api-access-d2c94\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.425977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425964 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-tuned\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425986 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e15bac92-028f-4cf2-b21b-625c36a65398-host\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.425988 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-kubelet\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426002 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-env-overrides\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426038 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426064 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-kubernetes\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426078 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-run-netns\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426088 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-ovnkube-script-lib\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-socket-dir-parent\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426153 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e15bac92-028f-4cf2-b21b-625c36a65398-host\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426134 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-kubernetes\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-conf-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426177 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426203 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b6c8dec-0ca2-4629-a47c-12917d920f65-agent-certs\") pod \"konnectivity-agent-sv9jl\" (UID: \"3b6c8dec-0ca2-4629-a47c-12917d920f65\") " pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426253 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426278 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-ovn\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426300 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426328 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.426436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426342 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-ovn\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426305 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-hostroot\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426379 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-os-release\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426404 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-etc-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-multus-certs\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426601 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-sys-fs\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426656 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-sys-fs\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426659 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-etc-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-os-release\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426703 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-system-cni-dir\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426719 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-ovnkube-script-lib\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426737 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-system-cni-dir\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426753 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bv26l\" (UniqueName: \"kubernetes.io/projected/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-kube-api-access-bv26l\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426779 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-slash\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426806 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-cni-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-k8s-cni-cncf-io\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426859 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-var-lib-kubelet\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.427246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426885 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-cni-bin\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426915 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-slash\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426937 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-cni-multus\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426953 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-var-lib-kubelet\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426968 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b6c8dec-0ca2-4629-a47c-12917d920f65-konnectivity-ca\") pod \"konnectivity-agent-sv9jl\" (UID: \"3b6c8dec-0ca2-4629-a47c-12917d920f65\") " pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426975 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-cni-bin\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.426993 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-device-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427018 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e15bac92-028f-4cf2-b21b-625c36a65398-serviceca\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427042 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-systemd\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427061 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-device-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427065 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-log-socket\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427099 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysctl-d\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427102 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-run-systemd\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427123 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3c83c11-833e-4fcc-8df4-b40016a8fc31-host-slash\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427146 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-cni-bin\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427155 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3c83c11-833e-4fcc-8df4-b40016a8fc31-host-slash\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427100 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-log-socket\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427168 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-sys\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.427996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427201 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-sysctl-d\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427208 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-sys\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427209 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427265 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6nkh\" (UniqueName: \"kubernetes.io/projected/e15bac92-028f-4cf2-b21b-625c36a65398-kube-api-access-s6nkh\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427290 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-var-lib-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427313 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1295a97b-a599-4291-8f8a-1d160a77d700-ovn-node-metrics-cert\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427334 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427348 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-env-overrides\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427377 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-var-lib-openvswitch\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427415 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e15bac92-028f-4cf2-b21b-625c36a65398-serviceca\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427470 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a37bf2d-821f-4f29-9448-ba501e17bc7d-hosts-file\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427493 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b6c8dec-0ca2-4629-a47c-12917d920f65-konnectivity-ca\") pod \"konnectivity-agent-sv9jl\" (UID: \"3b6c8dec-0ca2-4629-a47c-12917d920f65\") " pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427504 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-socket-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427528 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427549 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmls\" (UniqueName: \"kubernetes.io/projected/1295a97b-a599-4291-8f8a-1d160a77d700-kube-api-access-jtmls\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a37bf2d-821f-4f29-9448-ba501e17bc7d-tmp-dir\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427578 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-socket-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.428824 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427621 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-system-cni-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-kubelet\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427677 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427705 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfdda73e-bc72-4301-a73e-3668f7337a89-tmp\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.427788 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427844 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swr9r\" (UniqueName: \"kubernetes.io/projected/dfdda73e-bc72-4301-a73e-3668f7337a89-kube-api-access-swr9r\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.427860 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:27.92784023 +0000 UTC m=+3.089563892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427892 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cni-binary-copy\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427920 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427952 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3c83c11-833e-4fcc-8df4-b40016a8fc31-iptables-alerter-script\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.427980 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49fc9946-f022-453f-a020-09c5e1771327-cni-binary-copy\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428005 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-lib-modules\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428032 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-run-ovn-kubernetes\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428059 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-os-release\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.429609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428113 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-modprobe-d\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428157 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-systemd\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428182 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-run\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428206 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cnibin\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428260 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-node-log\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428285 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdq69\" (UniqueName: \"kubernetes.io/projected/b3c83c11-833e-4fcc-8df4-b40016a8fc31-kube-api-access-sdq69\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428287 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428310 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-netns\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-etc-kubernetes\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428364 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428390 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-registration-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428420 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-systemd-units\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428455 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-host-run-ovn-kubernetes\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428461 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-ovnkube-config\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428499 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42x9x\" (UniqueName: \"kubernetes.io/projected/0a37bf2d-821f-4f29-9448-ba501e17bc7d-kube-api-access-42x9x\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428545 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2mz\" (UniqueName: \"kubernetes.io/projected/49fc9946-f022-453f-a020-09c5e1771327-kube-api-access-kl2mz\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.430292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428806 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-modprobe-d\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428863 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-systemd\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428920 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1295a97b-a599-4291-8f8a-1d160a77d700-ovnkube-config\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428913 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-run\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428988 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-node-log\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429025 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cnibin\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429038 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-cni-binary-copy\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429077 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-registration-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429115 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1295a97b-a599-4291-8f8a-1d160a77d700-systemd-units\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.428420 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfdda73e-bc72-4301-a73e-3668f7337a89-lib-modules\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429138 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a02c2434-65dd-4c98-ab3c-09afd173f7a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429430 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3c83c11-833e-4fcc-8df4-b40016a8fc31-iptables-alerter-script\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.429957 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dfdda73e-bc72-4301-a73e-3668f7337a89-etc-tuned\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.430185 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b6c8dec-0ca2-4629-a47c-12917d920f65-agent-certs\") pod \"konnectivity-agent-sv9jl\" (UID: \"3b6c8dec-0ca2-4629-a47c-12917d920f65\") " pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.430931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.430406 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1295a97b-a599-4291-8f8a-1d160a77d700-ovn-node-metrics-cert\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.431451 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.431392 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfdda73e-bc72-4301-a73e-3668f7337a89-tmp\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.437287 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.437258 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxd5k\" (UniqueName: \"kubernetes.io/projected/f5333f73-4353-4f94-93ef-4137cf3b76e0-kube-api-access-bxd5k\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.437780 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.437759 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2c94\" (UniqueName: \"kubernetes.io/projected/a02c2434-65dd-4c98-ab3c-09afd173f7a1-kube-api-access-d2c94\") pod \"aws-ebs-csi-driver-node-hglht\" (UID: \"a02c2434-65dd-4c98-ab3c-09afd173f7a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.438015 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.437969 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swr9r\" (UniqueName: \"kubernetes.io/projected/dfdda73e-bc72-4301-a73e-3668f7337a89-kube-api-access-swr9r\") pod \"tuned-slzcg\" (UID: \"dfdda73e-bc72-4301-a73e-3668f7337a89\") " pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.438929 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.438904 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmls\" (UniqueName: \"kubernetes.io/projected/1295a97b-a599-4291-8f8a-1d160a77d700-kube-api-access-jtmls\") pod \"ovnkube-node-vdbxv\" (UID: \"1295a97b-a599-4291-8f8a-1d160a77d700\") " pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.439465 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.439443 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6nkh\" (UniqueName: \"kubernetes.io/projected/e15bac92-028f-4cf2-b21b-625c36a65398-kube-api-access-s6nkh\") pod \"node-ca-pmfhp\" (UID: \"e15bac92-028f-4cf2-b21b-625c36a65398\") " pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.439693 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.439657 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv26l\" (UniqueName: \"kubernetes.io/projected/eba5ed4f-2b75-43ab-bcd4-741cf348ff43-kube-api-access-bv26l\") pod \"multus-additional-cni-plugins-48thb\" (UID: \"eba5ed4f-2b75-43ab-bcd4-741cf348ff43\") " pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.440016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.439999 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdq69\" (UniqueName: \"kubernetes.io/projected/b3c83c11-833e-4fcc-8df4-b40016a8fc31-kube-api-access-sdq69\") pod \"iptables-alerter-gvqd9\" (UID: \"b3c83c11-833e-4fcc-8df4-b40016a8fc31\") " pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.529356 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529316 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:27.529554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529372 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-cnibin\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529483 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49fc9946-f022-453f-a020-09c5e1771327-multus-daemon-config\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529513 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-socket-dir-parent\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529544 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-conf-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529544 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-cnibin\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529585 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-conf-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529589 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-hostroot\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529621 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-multus-certs\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-hostroot\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529665 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-cni-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529683 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-socket-dir-parent\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529705 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-k8s-cni-cncf-io\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529733 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-cni-multus\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529762 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-cni-bin\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529763 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-multus-cni-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.529808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529786 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a37bf2d-821f-4f29-9448-ba501e17bc7d-hosts-file\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529819 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-multus-certs\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529813 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a37bf2d-821f-4f29-9448-ba501e17bc7d-tmp-dir\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529852 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-system-cni-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529864 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-cni-multus\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529876 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-kubelet\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529910 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-k8s-cni-cncf-io\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529949 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-kubelet\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.529950 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49fc9946-f022-453f-a020-09c5e1771327-cni-binary-copy\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530054 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-system-cni-dir\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530093 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-var-lib-cni-bin\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530115 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-os-release\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530158 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-netns\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530186 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-etc-kubernetes\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530232 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42x9x\" (UniqueName: \"kubernetes.io/projected/0a37bf2d-821f-4f29-9448-ba501e17bc7d-kube-api-access-42x9x\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530235 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49fc9946-f022-453f-a020-09c5e1771327-multus-daemon-config\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530245 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-os-release\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530276 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2mz\" (UniqueName: \"kubernetes.io/projected/49fc9946-f022-453f-a020-09c5e1771327-kube-api-access-kl2mz\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530282 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-host-run-netns\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530367 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a37bf2d-821f-4f29-9448-ba501e17bc7d-tmp-dir\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.530977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530415 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49fc9946-f022-453f-a020-09c5e1771327-etc-kubernetes\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.530977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.530435 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a37bf2d-821f-4f29-9448-ba501e17bc7d-hosts-file\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.531121 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.531072 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49fc9946-f022-453f-a020-09c5e1771327-cni-binary-copy\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.536465 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.536445 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:27.536465 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.536467 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:27.536682 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.536480 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:27.536682 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.536541 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:28.036523422 +0000 UTC m=+3.198247092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:27.539491 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.539468 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42x9x\" (UniqueName: \"kubernetes.io/projected/0a37bf2d-821f-4f29-9448-ba501e17bc7d-kube-api-access-42x9x\") pod \"node-resolver-jv4k5\" (UID: \"0a37bf2d-821f-4f29-9448-ba501e17bc7d\") " pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.539491 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.539481 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2mz\" (UniqueName: \"kubernetes.io/projected/49fc9946-f022-453f-a020-09c5e1771327-kube-api-access-kl2mz\") pod \"multus-5k7w8\" (UID: \"49fc9946-f022-453f-a020-09c5e1771327\") " pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.615457 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.615377 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-48thb" Jun 03 03:20:27.622344 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.622323 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:27.631979 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.631958 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" Jun 03 03:20:27.636953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.636936 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pmfhp" Jun 03 03:20:27.643633 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.643615 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:27.651185 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.651167 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvqd9" Jun 03 03:20:27.657815 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.657797 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-slzcg" Jun 03 03:20:27.664347 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.664326 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jv4k5" Jun 03 03:20:27.669831 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.669815 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5k7w8" Jun 03 03:20:27.782925 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.782897 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:27.897768 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.897672 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c83c11_833e_4fcc_8df4_b40016a8fc31.slice/crio-b56fd6eccdb7c982cdc6be16dce2b000d809fd33987f72024a5e254dcb5158ec WatchSource:0}: Error finding container b56fd6eccdb7c982cdc6be16dce2b000d809fd33987f72024a5e254dcb5158ec: Status 404 returned error can't find the container with id b56fd6eccdb7c982cdc6be16dce2b000d809fd33987f72024a5e254dcb5158ec Jun 03 03:20:27.902228 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.902127 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fc9946_f022_453f_a020_09c5e1771327.slice/crio-757541e74cc57d8e8bf5f13d57d1c1cce14aebab3f8f83fbab8fc4e14a4cb0d3 WatchSource:0}: Error finding container 757541e74cc57d8e8bf5f13d57d1c1cce14aebab3f8f83fbab8fc4e14a4cb0d3: Status 404 returned error can't find the container with id 757541e74cc57d8e8bf5f13d57d1c1cce14aebab3f8f83fbab8fc4e14a4cb0d3 Jun 03 03:20:27.903766 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.903688 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a37bf2d_821f_4f29_9448_ba501e17bc7d.slice/crio-bd9b0768af2ba68ddbd3ce22abce8703e66a19435e5149be0b5f68a0f5998b2a WatchSource:0}: Error finding container bd9b0768af2ba68ddbd3ce22abce8703e66a19435e5149be0b5f68a0f5998b2a: Status 404 returned error can't find the container with id bd9b0768af2ba68ddbd3ce22abce8703e66a19435e5149be0b5f68a0f5998b2a Jun 03 03:20:27.904449 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.904425 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfdda73e_bc72_4301_a73e_3668f7337a89.slice/crio-89bcdbf13a1db6a87105af2b1633341c8a52c3f064c049096f3e61a9d667bc33 WatchSource:0}: Error finding container 89bcdbf13a1db6a87105af2b1633341c8a52c3f064c049096f3e61a9d667bc33: Status 404 returned error can't find the container with id 89bcdbf13a1db6a87105af2b1633341c8a52c3f064c049096f3e61a9d667bc33 Jun 03 03:20:27.905322 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.905296 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02c2434_65dd_4c98_ab3c_09afd173f7a1.slice/crio-8bb1bbf51d5625f3cad4f28efb35feb79e4047b7532bb80f0d136ee267e1deb5 WatchSource:0}: Error finding container 8bb1bbf51d5625f3cad4f28efb35feb79e4047b7532bb80f0d136ee267e1deb5: Status 404 returned error can't find the container with id 8bb1bbf51d5625f3cad4f28efb35feb79e4047b7532bb80f0d136ee267e1deb5 Jun 03 03:20:27.906483 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.906421 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15bac92_028f_4cf2_b21b_625c36a65398.slice/crio-9eef5d790ba495db2e0f9cf90ff70b2cde28c5c5131526b8b05c1cf0732019d7 WatchSource:0}: Error finding container 9eef5d790ba495db2e0f9cf90ff70b2cde28c5c5131526b8b05c1cf0732019d7: Status 404 returned error can't find the container with id 9eef5d790ba495db2e0f9cf90ff70b2cde28c5c5131526b8b05c1cf0732019d7 Jun 03 03:20:27.908415 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.908049 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6c8dec_0ca2_4629_a47c_12917d920f65.slice/crio-7e764f87eb3cfef19220fa8b130a67dae21971af6e86c4b1fe94356979d0ee87 WatchSource:0}: Error finding container 7e764f87eb3cfef19220fa8b130a67dae21971af6e86c4b1fe94356979d0ee87: Status 404 returned error can't find the container with id 7e764f87eb3cfef19220fa8b130a67dae21971af6e86c4b1fe94356979d0ee87 Jun 03 03:20:27.909499 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.909473 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1295a97b_a599_4291_8f8a_1d160a77d700.slice/crio-c8b4556d01100436282572fcd0c2e4e72051deb1b389c07912cce2b0b4c5928a WatchSource:0}: Error finding container c8b4556d01100436282572fcd0c2e4e72051deb1b389c07912cce2b0b4c5928a: Status 404 returned error can't find the container with id c8b4556d01100436282572fcd0c2e4e72051deb1b389c07912cce2b0b4c5928a Jun 03 03:20:27.911072 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:20:27.911049 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba5ed4f_2b75_43ab_bcd4_741cf348ff43.slice/crio-32a51a6ee66f850c48bcc0e81fedaeca587245d6de51de7359e0932a0f8f7fe4 WatchSource:0}: Error finding container 32a51a6ee66f850c48bcc0e81fedaeca587245d6de51de7359e0932a0f8f7fe4: Status 404 returned error can't find the container with id 32a51a6ee66f850c48bcc0e81fedaeca587245d6de51de7359e0932a0f8f7fe4 Jun 03 03:20:27.933055 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:27.933029 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:27.933185 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.933170 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:27.933260 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:27.933234 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:28.933204941 +0000 UTC m=+4.094928596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:28.134974 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.134765 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:28.135083 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:28.134970 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:28.135083 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:28.134989 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:28.135083 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:28.135000 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:28.135083 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:28.135049 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:29.135036096 +0000 UTC m=+4.296759745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:28.408948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.408822 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 03:15:26 +0000 UTC" deadline="2028-01-11 16:39:06.012906069 +0000 UTC" Jun 03 03:20:28.408948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.408869 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14101h18m37.604040912s" Jun 03 03:20:28.442440 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.442376 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jv4k5" event={"ID":"0a37bf2d-821f-4f29-9448-ba501e17bc7d","Type":"ContainerStarted","Data":"bd9b0768af2ba68ddbd3ce22abce8703e66a19435e5149be0b5f68a0f5998b2a"} Jun 03 03:20:28.449811 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.449745 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sv9jl" event={"ID":"3b6c8dec-0ca2-4629-a47c-12917d920f65","Type":"ContainerStarted","Data":"7e764f87eb3cfef19220fa8b130a67dae21971af6e86c4b1fe94356979d0ee87"} Jun 03 03:20:28.451572 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.451503 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5k7w8" event={"ID":"49fc9946-f022-453f-a020-09c5e1771327","Type":"ContainerStarted","Data":"757541e74cc57d8e8bf5f13d57d1c1cce14aebab3f8f83fbab8fc4e14a4cb0d3"} Jun 03 03:20:28.452729 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.452664 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvqd9" event={"ID":"b3c83c11-833e-4fcc-8df4-b40016a8fc31","Type":"ContainerStarted","Data":"b56fd6eccdb7c982cdc6be16dce2b000d809fd33987f72024a5e254dcb5158ec"} Jun 03 03:20:28.461858 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.461830 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" event={"ID":"2437879e208ceb33c4ad964cb808c2a3","Type":"ContainerStarted","Data":"97fb06851c34f6d147adcfbe2ee9096931a1cdfd52131ed3d95f6c1c7e191fa6"} Jun 03 03:20:28.476350 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.476241 2570 generic.go:358] "Generic (PLEG): container finished" podID="ea0f503daa5a72440061aa27dbe6c8a1" containerID="9a30ac7b08d1a06bffc9969494ddabca6bef0d6b54785ca041a2033e948a1696" exitCode=0 Jun 03 03:20:28.476350 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.476318 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" event={"ID":"ea0f503daa5a72440061aa27dbe6c8a1","Type":"ContainerDied","Data":"9a30ac7b08d1a06bffc9969494ddabca6bef0d6b54785ca041a2033e948a1696"} Jun 03 03:20:28.487878 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.487851 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerStarted","Data":"32a51a6ee66f850c48bcc0e81fedaeca587245d6de51de7359e0932a0f8f7fe4"} Jun 03 03:20:28.491023 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.490999 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"c8b4556d01100436282572fcd0c2e4e72051deb1b389c07912cce2b0b4c5928a"} Jun 03 03:20:28.491954 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.491907 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-105.ec2.internal" podStartSLOduration=2.491893848 podStartE2EDuration="2.491893848s" podCreationTimestamp="2026-06-03 03:20:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:20:28.474026228 +0000 UTC m=+3.635749901" watchObservedRunningTime="2026-06-03 03:20:28.491893848 +0000 UTC m=+3.653617521" Jun 03 03:20:28.495744 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.495697 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" event={"ID":"a02c2434-65dd-4c98-ab3c-09afd173f7a1","Type":"ContainerStarted","Data":"8bb1bbf51d5625f3cad4f28efb35feb79e4047b7532bb80f0d136ee267e1deb5"} Jun 03 03:20:28.499017 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.498961 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pmfhp" event={"ID":"e15bac92-028f-4cf2-b21b-625c36a65398","Type":"ContainerStarted","Data":"9eef5d790ba495db2e0f9cf90ff70b2cde28c5c5131526b8b05c1cf0732019d7"} Jun 03 03:20:28.511116 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.511092 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-slzcg" event={"ID":"dfdda73e-bc72-4301-a73e-3668f7337a89","Type":"ContainerStarted","Data":"89bcdbf13a1db6a87105af2b1633341c8a52c3f064c049096f3e61a9d667bc33"} Jun 03 03:20:28.941259 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:28.941165 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:28.941426 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:28.941349 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:28.941426 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:28.941421 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:30.941400442 +0000 UTC m=+6.103124091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:29.071107 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:29.071074 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:29.143066 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:29.143030 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:29.143274 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:29.143204 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:29.143274 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:29.143240 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:29.143274 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:29.143253 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:29.143442 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:29.143312 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:31.143293501 +0000 UTC m=+6.305017156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:29.412554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:29.412476 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:29.412992 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:29.412597 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:29.412992 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:29.412959 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:29.413102 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:29.413057 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:29.520448 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:29.520414 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" event={"ID":"ea0f503daa5a72440061aa27dbe6c8a1","Type":"ContainerStarted","Data":"698e91a855583f913e4bcc7b3b570dda08b6a0446225c248f464033d56b18230"} Jun 03 03:20:30.958727 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:30.958194 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:30.958727 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:30.958352 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:30.958727 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:30.958414 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:34.958401262 +0000 UTC m=+10.120124930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:31.160032 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:31.159995 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:31.160196 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:31.160163 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:31.160196 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:31.160182 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:31.160196 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:31.160196 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:31.160398 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:31.160283 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:35.160262931 +0000 UTC m=+10.321986585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:31.412765 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:31.412687 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:31.412898 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:31.412808 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:31.412898 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:31.412687 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:31.412962 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:31.412930 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:33.412750 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:33.412540 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:33.412750 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:33.412682 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:33.413272 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:33.413069 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:33.413272 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:33.413236 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:34.991289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:34.991259 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:34.991753 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:34.991364 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:34.991753 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:34.991408 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:42.991395311 +0000 UTC m=+18.153118959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:35.192778 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:35.192166 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:35.192778 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:35.192368 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:35.192778 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:35.192388 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:35.192778 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:35.192401 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:35.192778 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:35.192459 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:43.192442067 +0000 UTC m=+18.354165719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:35.412948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:35.412880 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:35.413065 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:35.412977 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:35.413108 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:35.413054 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:35.413195 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:35.413172 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:37.411630 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:37.411596 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:37.411976 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:37.411701 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:37.411976 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:37.411757 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:37.411976 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:37.411850 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:39.411841 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:39.411799 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:39.411841 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:39.411832 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:39.412403 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:39.411939 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:39.412403 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:39.412040 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:41.412488 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:41.412449 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:41.412980 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:41.412499 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:41.412980 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:41.412589 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:41.412980 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:41.412754 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:43.051677 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:43.051643 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:43.052113 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.051813 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:43.052113 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.051887 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:59.051870674 +0000 UTC m=+34.213594327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:43.252434 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:43.252400 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:43.252599 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.252570 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:43.252599 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.252595 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:43.252682 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.252607 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:43.252682 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.252660 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:59.252642975 +0000 UTC m=+34.414366629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:43.412343 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:43.412264 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:43.412537 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:43.412272 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:43.412537 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.412387 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:43.412537 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:43.412481 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:45.413128 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:45.413097 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:45.413814 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:45.413203 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:45.413814 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:45.413260 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:45.413814 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:45.413356 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:46.549492 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.549250 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" event={"ID":"a02c2434-65dd-4c98-ab3c-09afd173f7a1","Type":"ContainerStarted","Data":"bab4e8640a21d6838a27f5ab5c8422793a3fe3f0fb5097edddfd879da18b2c4e"} Jun 03 03:20:46.550514 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.550487 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pmfhp" event={"ID":"e15bac92-028f-4cf2-b21b-625c36a65398","Type":"ContainerStarted","Data":"a0e4179eae542da628ff4df9c81fd8ee240932a6d0881d3fc8d25900bc659d99"} Jun 03 03:20:46.551849 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.551824 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-slzcg" event={"ID":"dfdda73e-bc72-4301-a73e-3668f7337a89","Type":"ContainerStarted","Data":"f1adf62908847837e349dabf0d190c9bbd1945e7a00c43d487aca7b3f0b555b5"} Jun 03 03:20:46.553105 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.553048 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jv4k5" event={"ID":"0a37bf2d-821f-4f29-9448-ba501e17bc7d","Type":"ContainerStarted","Data":"ec965037805440488a0c0f77fc24d4122e3f79272ca68433c821e3cd202e2405"} Jun 03 03:20:46.554442 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.554423 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sv9jl" event={"ID":"3b6c8dec-0ca2-4629-a47c-12917d920f65","Type":"ContainerStarted","Data":"562eba85688a255b185fd581d6e9192bdee7ea2face223d41d073b46c5db2706"} Jun 03 03:20:46.555572 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.555552 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5k7w8" event={"ID":"49fc9946-f022-453f-a020-09c5e1771327","Type":"ContainerStarted","Data":"8a5c1de714a3cbea44ff4aa9b24e8062aeabe7369f1ef1d9cb82ef8a74feeb22"} Jun 03 03:20:46.556637 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.556617 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerStarted","Data":"855e6b18b356c77d2914b881289b4645fbe04e69a063a006e19228bcf077cb61"} Jun 03 03:20:46.563679 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.563648 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-105.ec2.internal" podStartSLOduration=20.563638981 podStartE2EDuration="20.563638981s" podCreationTimestamp="2026-06-03 03:20:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:20:29.533703915 +0000 UTC m=+4.695427588" watchObservedRunningTime="2026-06-03 03:20:46.563638981 +0000 UTC m=+21.725362651" Jun 03 03:20:46.564003 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.563983 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pmfhp" podStartSLOduration=7.757976918 podStartE2EDuration="21.563977691s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.908519891 +0000 UTC m=+3.070243569" lastFinishedPulling="2026-06-03 03:20:41.714520692 +0000 UTC m=+16.876244342" observedRunningTime="2026-06-03 03:20:46.563514354 +0000 UTC m=+21.725238025" watchObservedRunningTime="2026-06-03 03:20:46.563977691 +0000 UTC m=+21.725701391" Jun 03 03:20:46.579959 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.579913 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-slzcg" podStartSLOduration=3.29613224 podStartE2EDuration="21.579900165s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.906405075 +0000 UTC m=+3.068128757" lastFinishedPulling="2026-06-03 03:20:46.190173032 +0000 UTC m=+21.351896682" observedRunningTime="2026-06-03 03:20:46.579749231 +0000 UTC m=+21.741472902" watchObservedRunningTime="2026-06-03 03:20:46.579900165 +0000 UTC m=+21.741623838" Jun 03 03:20:46.594351 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.594309 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jv4k5" podStartSLOduration=3.359945246 podStartE2EDuration="21.594296475s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.905460266 +0000 UTC m=+3.067183932" lastFinishedPulling="2026-06-03 03:20:46.1398115 +0000 UTC m=+21.301535161" observedRunningTime="2026-06-03 03:20:46.594234273 +0000 UTC m=+21.755957936" watchObservedRunningTime="2026-06-03 03:20:46.594296475 +0000 UTC m=+21.756020145" Jun 03 03:20:46.613825 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:46.613769 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5k7w8" podStartSLOduration=3.32291371 podStartE2EDuration="21.613756389s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.903788921 +0000 UTC m=+3.065512585" lastFinishedPulling="2026-06-03 03:20:46.194631605 +0000 UTC m=+21.356355264" observedRunningTime="2026-06-03 03:20:46.613137667 +0000 UTC m=+21.774861350" watchObservedRunningTime="2026-06-03 03:20:46.613756389 +0000 UTC m=+21.775480080" Jun 03 03:20:47.357049 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.356856 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:47.357659 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.357634 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:47.371857 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.371817 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sv9jl" podStartSLOduration=4.161139668 podStartE2EDuration="22.371805676s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.910650249 +0000 UTC m=+3.072373899" lastFinishedPulling="2026-06-03 03:20:46.121316239 +0000 UTC m=+21.283039907" observedRunningTime="2026-06-03 03:20:46.645841812 +0000 UTC m=+21.807565482" watchObservedRunningTime="2026-06-03 03:20:47.371805676 +0000 UTC m=+22.533529347" Jun 03 03:20:47.411970 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.411946 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:47.412070 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:47.412036 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:47.412070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.412064 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:47.412146 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:47.412115 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:47.559303 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.559273 2570 generic.go:358] "Generic (PLEG): container finished" podID="eba5ed4f-2b75-43ab-bcd4-741cf348ff43" containerID="855e6b18b356c77d2914b881289b4645fbe04e69a063a006e19228bcf077cb61" exitCode=0 Jun 03 03:20:47.559848 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.559366 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerDied","Data":"855e6b18b356c77d2914b881289b4645fbe04e69a063a006e19228bcf077cb61"} Jun 03 03:20:47.561996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.561972 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:20:47.562323 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562303 2570 generic.go:358] "Generic (PLEG): container finished" podID="1295a97b-a599-4291-8f8a-1d160a77d700" containerID="718dc1f5981e9f4afd0ecd1e361e248ec70d2b880f2ae0e17a627d6063366b02" exitCode=1 Jun 03 03:20:47.562438 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562410 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"b2a343c667d671a8f920e0ae1bb851a7337ee97670b1ba42ae906ec9280e9557"} Jun 03 03:20:47.562510 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562456 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"1af35bf8329c57155b9de3236287eff903ca1b34c4b248c7b2ba34a6f7127e46"} Jun 03 03:20:47.562510 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562470 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"1ab06c9f7d87c818e4b73dc02dcee3e7f1729b8ff2f5f558939d713a7e4d3092"} Jun 03 03:20:47.562510 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562483 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"03914e8d4330edc07040a22e593b0695815127541a212c9ca7c579cd49b18df4"} Jun 03 03:20:47.562510 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562495 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerDied","Data":"718dc1f5981e9f4afd0ecd1e361e248ec70d2b880f2ae0e17a627d6063366b02"} Jun 03 03:20:47.562510 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.562509 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"5449e093cbec3322a1cc483950908c92c57ff1ff3f0c30442c4c51e276652330"} Jun 03 03:20:47.672070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:47.672049 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 03:20:48.389013 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.388828 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T03:20:47.67206551Z","UUID":"03c6f22a-af6a-4c95-9615-8fe292e0a3c4","Handler":null,"Name":"","Endpoint":""} Jun 03 03:20:48.391528 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.391487 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 03:20:48.391528 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.391524 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 03:20:48.566332 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.566296 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" event={"ID":"a02c2434-65dd-4c98-ab3c-09afd173f7a1","Type":"ContainerStarted","Data":"50b3189afb738cec9896d082e8094128b453ef5df3bd219a325120ce3074338c"} Jun 03 03:20:48.567785 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.567763 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 03:20:48.567916 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.567766 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvqd9" event={"ID":"b3c83c11-833e-4fcc-8df4-b40016a8fc31","Type":"ContainerStarted","Data":"4128433c779bd4ca615d23cef38b997e7fb9c56fe238a93816879f4a2524c31f"} Jun 03 03:20:48.584424 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:48.584374 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gvqd9" podStartSLOduration=5.297091187 podStartE2EDuration="23.584357194s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.901152417 +0000 UTC m=+3.062876070" lastFinishedPulling="2026-06-03 03:20:46.188418401 +0000 UTC m=+21.350142077" observedRunningTime="2026-06-03 03:20:48.583508521 +0000 UTC m=+23.745232192" watchObservedRunningTime="2026-06-03 03:20:48.584357194 +0000 UTC m=+23.746080866" Jun 03 03:20:49.411947 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:49.411896 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:49.411947 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:49.411934 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:49.412181 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:49.412026 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:49.412260 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:49.412178 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:49.572856 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:49.572829 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:20:49.575531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:49.575497 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" event={"ID":"a02c2434-65dd-4c98-ab3c-09afd173f7a1","Type":"ContainerStarted","Data":"e0dd084660672a4e615ef627996b4940b235038e6111bdfb5126a1a1174edf27"} Jun 03 03:20:50.580933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:50.580724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:20:50.581409 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:50.581358 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"187a0549d884d6cbabe9084db8015972329e77f1b1e33e42749e9ae19bfe428b"} Jun 03 03:20:51.411806 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:51.411774 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:51.412006 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:51.411774 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:51.412006 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:51.411892 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:51.412006 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:51.411997 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:52.385578 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.385402 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:52.386375 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.385675 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 03:20:52.386375 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.386037 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sv9jl" Jun 03 03:20:52.399050 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.399010 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hglht" podStartSLOduration=6.702956687 podStartE2EDuration="27.398997292s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.907359794 +0000 UTC m=+3.069083446" lastFinishedPulling="2026-06-03 03:20:48.603400398 +0000 UTC m=+23.765124051" observedRunningTime="2026-06-03 03:20:49.592461325 +0000 UTC m=+24.754184998" watchObservedRunningTime="2026-06-03 03:20:52.398997292 +0000 UTC m=+27.560720965" Jun 03 03:20:52.588050 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.588017 2570 generic.go:358] "Generic (PLEG): container finished" podID="eba5ed4f-2b75-43ab-bcd4-741cf348ff43" containerID="bc1861ca895e2d529a14ef41c9e25eca11a148f65b9aca9743bab4ca35a2514d" exitCode=0 Jun 03 03:20:52.588229 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.588106 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerDied","Data":"bc1861ca895e2d529a14ef41c9e25eca11a148f65b9aca9743bab4ca35a2514d"} Jun 03 03:20:52.591272 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.591205 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:20:52.591615 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.591593 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"674f7f6ad2e99335e15481faf4ef9d7bd52a7c15ce7c2637b85cae83b3dd4543"} Jun 03 03:20:52.592006 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.591988 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:52.592093 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.592011 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:52.592162 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.592148 2570 scope.go:117] "RemoveContainer" containerID="718dc1f5981e9f4afd0ecd1e361e248ec70d2b880f2ae0e17a627d6063366b02" Jun 03 03:20:52.607277 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:52.607242 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:53.412417 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.412386 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:53.412896 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.412399 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:53.412896 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:53.412493 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:53.412896 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:53.412625 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:53.595642 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.595605 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerStarted","Data":"7b898a75013dda8490a946d2f3db5fd573de92115b8befa8fa478412a5e78e80"} Jun 03 03:20:53.598360 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.598341 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:20:53.598626 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.598608 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" event={"ID":"1295a97b-a599-4291-8f8a-1d160a77d700","Type":"ContainerStarted","Data":"51999a4a9dd543cc41ad88aa81787f156ce274d7d71229c7e238ed7a25ff6188"} Jun 03 03:20:53.598908 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.598890 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:53.616902 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.616879 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:20:53.640062 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.640008 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" podStartSLOduration=9.929437048 podStartE2EDuration="28.639989536s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.912447357 +0000 UTC m=+3.074171012" lastFinishedPulling="2026-06-03 03:20:46.622999837 +0000 UTC m=+21.784723500" observedRunningTime="2026-06-03 03:20:53.639107363 +0000 UTC m=+28.800831045" watchObservedRunningTime="2026-06-03 03:20:53.639989536 +0000 UTC m=+28.801713210" Jun 03 03:20:53.900240 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.900191 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gmwjq"] Jun 03 03:20:53.900399 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.900316 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:53.900472 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:53.900418 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:53.903406 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.903372 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pfx99"] Jun 03 03:20:53.903553 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:53.903540 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:53.903699 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:53.903678 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:54.602614 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:54.602576 2570 generic.go:358] "Generic (PLEG): container finished" podID="eba5ed4f-2b75-43ab-bcd4-741cf348ff43" containerID="7b898a75013dda8490a946d2f3db5fd573de92115b8befa8fa478412a5e78e80" exitCode=0 Jun 03 03:20:54.602950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:54.602658 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerDied","Data":"7b898a75013dda8490a946d2f3db5fd573de92115b8befa8fa478412a5e78e80"} Jun 03 03:20:55.412328 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:55.412244 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:55.412328 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:55.412250 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:55.412535 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:55.412356 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:55.412535 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:55.412446 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:55.606998 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:55.606965 2570 generic.go:358] "Generic (PLEG): container finished" podID="eba5ed4f-2b75-43ab-bcd4-741cf348ff43" containerID="c11d97a5b7ce9a054dbf37d27de53bdc67611bdb184581b862731c0755824825" exitCode=0 Jun 03 03:20:55.607386 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:55.606996 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerDied","Data":"c11d97a5b7ce9a054dbf37d27de53bdc67611bdb184581b862731c0755824825"} Jun 03 03:20:57.412156 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:57.411948 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:57.412659 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:57.412265 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:20:57.412659 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:57.412034 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:57.412659 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:57.412647 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:59.068787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:59.068748 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:59.069364 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.068857 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:59.069364 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.068913 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:31.068898545 +0000 UTC m=+66.230622197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:59.270610 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:59.270565 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:59.270768 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.270706 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:59.270768 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.270734 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:59.270768 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.270749 2570 projected.go:194] Error preparing data for projected volume kube-api-access-l8gq8 for pod openshift-network-diagnostics/network-check-target-gmwjq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:59.270888 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.270809 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8 podName:dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:31.270795089 +0000 UTC m=+66.432518742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l8gq8" (UniqueName: "kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8") pod "network-check-target-gmwjq" (UID: "dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:59.412208 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:59.412123 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:20:59.412400 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:20:59.412131 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:20:59.412400 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.412275 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:20:59.412400 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:20:59.412341 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmwjq" podUID="dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5" Jun 03 03:21:00.151985 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.151902 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-105.ec2.internal" event="NodeReady" Jun 03 03:21:00.152575 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.152116 2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 03:21:00.190421 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.190373 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s49xc"] Jun 03 03:21:00.211395 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.211361 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k2w2h"] Jun 03 03:21:00.211562 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.211488 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.214850 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.214829 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 03:21:00.215620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.215600 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 03:21:00.215736 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.215702 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kzhg4\"" Jun 03 03:21:00.223412 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.223389 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s49xc"] Jun 03 03:21:00.223527 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.223417 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2w2h"] Jun 03 03:21:00.223527 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.223502 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.226752 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.226732 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 03:21:00.228701 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.228681 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 03:21:00.228795 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.228749 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jxzs\"" Jun 03 03:21:00.229200 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.229182 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 03:21:00.380086 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.380045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.380299 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.380117 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1d24a3-cee0-447f-a190-b720f7c532b0-tmp-dir\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.380299 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.380139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-782xm\" (UniqueName: \"kubernetes.io/projected/5e1d24a3-cee0-447f-a190-b720f7c532b0-kube-api-access-782xm\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.380299 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.380162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.380299 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.380182 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr2l4\" (UniqueName: \"kubernetes.io/projected/09234263-e48e-4dee-9de1-f9c3e2aa34fd-kube-api-access-dr2l4\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.380299 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.380263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1d24a3-cee0-447f-a190-b720f7c532b0-config-volume\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.481467 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481428 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.481670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481499 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1d24a3-cee0-447f-a190-b720f7c532b0-tmp-dir\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.481670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481532 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-782xm\" (UniqueName: \"kubernetes.io/projected/5e1d24a3-cee0-447f-a190-b720f7c532b0-kube-api-access-782xm\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.481670 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.481570 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:00.481670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481582 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.481670 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.481641 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:21:00.981621871 +0000 UTC m=+36.143345524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:00.481670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481615 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dr2l4\" (UniqueName: \"kubernetes.io/projected/09234263-e48e-4dee-9de1-f9c3e2aa34fd-kube-api-access-dr2l4\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.481984 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481689 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1d24a3-cee0-447f-a190-b720f7c532b0-config-volume\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.481984 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.481849 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:00.481984 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.481871 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1d24a3-cee0-447f-a190-b720f7c532b0-tmp-dir\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.481984 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.481904 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:00.981893557 +0000 UTC m=+36.143617205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:00.482253 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.482235 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1d24a3-cee0-447f-a190-b720f7c532b0-config-volume\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.494949 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.494889 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-782xm\" (UniqueName: \"kubernetes.io/projected/5e1d24a3-cee0-447f-a190-b720f7c532b0-kube-api-access-782xm\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.495075 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.495059 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr2l4\" (UniqueName: \"kubernetes.io/projected/09234263-e48e-4dee-9de1-f9c3e2aa34fd-kube-api-access-dr2l4\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.985707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.985665 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:00.985893 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:00.985761 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:00.985893 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.985857 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:00.986002 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.985892 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:00.986002 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.985944 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:01.985921631 +0000 UTC m=+37.147645282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:00.986002 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:00.985990 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:21:01.985972648 +0000 UTC m=+37.147696302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:01.412596 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.412519 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:21:01.412596 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.412519 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:21:01.414894 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.414870 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 03:21:01.415022 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.414922 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 03:21:01.415709 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.415688 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 03:21:01.415709 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.415707 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwf2t\"" Jun 03 03:21:01.415866 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.415689 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcjrn\"" Jun 03 03:21:01.993449 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.993410 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:01.993597 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:01.993469 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:01.993597 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:01.993557 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:01.993597 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:01.993577 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:01.993715 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:01.993626 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:21:03.993607452 +0000 UTC m=+39.155331107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:01.993715 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:01.993640 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:03.993634257 +0000 UTC m=+39.155357906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:02.623717 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:02.623686 2570 generic.go:358] "Generic (PLEG): container finished" podID="eba5ed4f-2b75-43ab-bcd4-741cf348ff43" containerID="e5898dbda9caf11a2e9467636bdd59e8e8dc1aad4f247f4769e7a0e5b1350e2c" exitCode=0 Jun 03 03:21:02.624154 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:02.623754 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerDied","Data":"e5898dbda9caf11a2e9467636bdd59e8e8dc1aad4f247f4769e7a0e5b1350e2c"} Jun 03 03:21:03.628382 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:03.628301 2570 generic.go:358] "Generic (PLEG): container finished" podID="eba5ed4f-2b75-43ab-bcd4-741cf348ff43" containerID="4b0046ac221d68e2c934c233810088f8a3c3678de3596a414ff3d20ce07345b8" exitCode=0 Jun 03 03:21:03.628689 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:03.628378 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerDied","Data":"4b0046ac221d68e2c934c233810088f8a3c3678de3596a414ff3d20ce07345b8"} Jun 03 03:21:04.009595 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:04.009563 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:04.009748 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:04.009621 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:04.009748 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:04.009701 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:04.009816 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:04.009766 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:08.009749377 +0000 UTC m=+43.171473031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:04.009816 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:04.009704 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:04.009887 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:04.009831 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:21:08.009820073 +0000 UTC m=+43.171543726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:04.632679 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:04.632647 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48thb" event={"ID":"eba5ed4f-2b75-43ab-bcd4-741cf348ff43","Type":"ContainerStarted","Data":"f0ec1cf2ab99cbe812cf0f67450662d7e80c246f72df96f6d6ae4e29e2fed7a7"} Jun 03 03:21:04.653889 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:04.653850 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-48thb" podStartSLOduration=5.890212033 podStartE2EDuration="39.653838382s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:27.915165241 +0000 UTC m=+3.076888893" lastFinishedPulling="2026-06-03 03:21:01.678791593 +0000 UTC m=+36.840515242" observedRunningTime="2026-06-03 03:21:04.652808542 +0000 UTC m=+39.814532212" watchObservedRunningTime="2026-06-03 03:21:04.653838382 +0000 UTC m=+39.815562053" Jun 03 03:21:08.035096 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:08.035055 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:08.035520 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:08.035123 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:08.035520 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:08.035209 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:08.035520 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:08.035233 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:08.035520 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:08.035294 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:21:16.035276649 +0000 UTC m=+51.197000317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:08.035520 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:08.035309 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:16.035303007 +0000 UTC m=+51.197026656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:16.088255 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:16.088198 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:16.088804 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:16.088271 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:16.088804 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:16.088341 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:16.088804 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:16.088355 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:16.088804 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:16.088406 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:21:32.088389602 +0000 UTC m=+67.250113251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:16.088804 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:16.088421 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:32.088415753 +0000 UTC m=+67.250139401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:25.617606 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:25.617579 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vdbxv" Jun 03 03:21:31.082826 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.082773 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:21:31.085001 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.084983 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 03:21:31.093798 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:31.093780 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 03:21:31.093852 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:31.093842 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:35.093827001 +0000 UTC m=+130.255550656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : secret "metrics-daemon-secret" not found Jun 03 03:21:31.283639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.283597 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:21:31.285825 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.285808 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 03:21:31.296542 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.296525 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 03:21:31.308374 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.308357 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gq8\" (UniqueName: \"kubernetes.io/projected/dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5-kube-api-access-l8gq8\") pod \"network-check-target-gmwjq\" (UID: \"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5\") " pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:21:31.429343 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.429324 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcjrn\"" Jun 03 03:21:31.437304 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.437287 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:21:31.559127 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.559099 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gmwjq"] Jun 03 03:21:31.563790 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:21:31.563749 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb1cda1_6b28_4b7d_9208_55c8b91fdcc5.slice/crio-daa64a6d4367c82d7105023119f2a50d37f30ed00510d692ce46ca213ab686b6 WatchSource:0}: Error finding container daa64a6d4367c82d7105023119f2a50d37f30ed00510d692ce46ca213ab686b6: Status 404 returned error can't find the container with id daa64a6d4367c82d7105023119f2a50d37f30ed00510d692ce46ca213ab686b6 Jun 03 03:21:31.685445 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:31.685354 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gmwjq" event={"ID":"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5","Type":"ContainerStarted","Data":"daa64a6d4367c82d7105023119f2a50d37f30ed00510d692ce46ca213ab686b6"} Jun 03 03:21:32.091923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:32.091844 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:21:32.091923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:32.091920 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:21:32.092389 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:32.092032 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:32.092389 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:32.092089 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:32.092389 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:32.092115 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:04.092092962 +0000 UTC m=+99.253816635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:21:32.092389 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:21:32.092157 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:22:04.092138443 +0000 UTC m=+99.253862104 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:21:35.694173 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:35.694140 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gmwjq" event={"ID":"dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5","Type":"ContainerStarted","Data":"ace14e9349f25e895ad297643a79624ea7df02057083c62d1f7785ec28209a5e"} Jun 03 03:21:35.694541 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:35.694258 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:21:35.708835 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:21:35.708797 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gmwjq" podStartSLOduration=67.175280158 podStartE2EDuration="1m10.708783637s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:21:31.565616646 +0000 UTC m=+66.727340492" lastFinishedPulling="2026-06-03 03:21:35.099120311 +0000 UTC m=+70.260843971" observedRunningTime="2026-06-03 03:21:35.707922357 +0000 UTC m=+70.869646029" watchObservedRunningTime="2026-06-03 03:21:35.708783637 +0000 UTC m=+70.870507307" Jun 03 03:22:04.096305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:04.096267 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:22:04.096780 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:04.096324 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:22:04.096780 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:04.096417 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:22:04.096780 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:04.096482 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:22:04.096780 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:04.096495 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert podName:09234263-e48e-4dee-9de1-f9c3e2aa34fd nodeName:}" failed. No retries permitted until 2026-06-03 03:23:08.096478855 +0000 UTC m=+163.258202511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert") pod "ingress-canary-k2w2h" (UID: "09234263-e48e-4dee-9de1-f9c3e2aa34fd") : secret "canary-serving-cert" not found Jun 03 03:22:04.096780 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:04.096544 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls podName:5e1d24a3-cee0-447f-a190-b720f7c532b0 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:08.096527346 +0000 UTC m=+163.258251012 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls") pod "dns-default-s49xc" (UID: "5e1d24a3-cee0-447f-a190-b720f7c532b0") : secret "dns-default-metrics-tls" not found Jun 03 03:22:06.697738 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:06.697708 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gmwjq" Jun 03 03:22:35.190524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:35.190482 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:22:35.191012 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:35.190633 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 03:22:35.191012 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:35.190701 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs podName:f5333f73-4353-4f94-93ef-4137cf3b76e0 nodeName:}" failed. No retries permitted until 2026-06-03 03:24:37.190684666 +0000 UTC m=+252.352408319 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs") pod "network-metrics-daemon-pfx99" (UID: "f5333f73-4353-4f94-93ef-4137cf3b76e0") : secret "metrics-daemon-secret" not found Jun 03 03:22:37.910630 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.910593 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd"] Jun 03 03:22:37.912881 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.912859 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:37.915110 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.915088 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 03:22:37.915420 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.915402 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 03:22:37.915509 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.915423 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:22:37.916361 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.916336 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nn9dv\"" Jun 03 03:22:37.923866 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:37.923845 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd"] Jun 03 03:22:38.010552 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.010529 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k"] Jun 03 03:22:38.011063 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.011037 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:38.011153 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.011122 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkqsd\" (UniqueName: \"kubernetes.io/projected/6bade280-bd27-462a-a4bf-5eb738cafc30-kube-api-access-qkqsd\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:38.012293 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.012278 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.013525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.013502 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bc58fbf75-dbmv2"] Jun 03 03:22:38.016263 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.016239 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 03:22:38.016549 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.016533 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 03:22:38.016866 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.016850 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 03:22:38.017101 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.017087 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sdl27\"" Jun 03 03:22:38.017351 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.017336 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 03:22:38.018478 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.018460 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.020520 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.020501 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-96wwc\"" Jun 03 03:22:38.020625 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.020520 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 03:22:38.020625 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.020511 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 03:22:38.020625 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.020548 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 03:22:38.025711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.025693 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 03:22:38.027055 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.027034 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k"] Jun 03 03:22:38.041136 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.041116 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc58fbf75-dbmv2"] Jun 03 03:22:38.108306 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.108282 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-742kz"] Jun 03 03:22:38.110211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.110197 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.112319 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112300 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2swc\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-kube-api-access-s2swc\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112410 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112325 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3814b96-d22e-48ad-b1f0-be1a7de7009b-ca-trust-extracted\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112410 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.112410 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112371 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkqsd\" (UniqueName: \"kubernetes.io/projected/6bade280-bd27-462a-a4bf-5eb738cafc30-kube-api-access-qkqsd\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:38.112410 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112387 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-certificates\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112423 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-trusted-ca\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsbpl\" (UniqueName: \"kubernetes.io/projected/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-kube-api-access-tsbpl\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-bound-sa-token\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112499 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112514 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-installation-pull-secrets\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112550 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112578 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-image-registry-private-configuration\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.112629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112629 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 03:22:38.112945 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.112656 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 03:22:38.112945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.112684 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 03:22:38.112945 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.112715 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls podName:6bade280-bd27-462a-a4bf-5eb738cafc30 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:38.612698573 +0000 UTC m=+133.774422223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9h4xd" (UID: "6bade280-bd27-462a-a4bf-5eb738cafc30") : secret "samples-operator-tls" not found Jun 03 03:22:38.113048 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.113002 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:22:38.113084 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.113057 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 03:22:38.113122 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.113057 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vmtx8\"" Jun 03 03:22:38.119390 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.119369 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-742kz"] Jun 03 03:22:38.124052 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.124028 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkqsd\" (UniqueName: \"kubernetes.io/projected/6bade280-bd27-462a-a4bf-5eb738cafc30-kube-api-access-qkqsd\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:38.213527 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213508 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-certificates\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.213608 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213536 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-trusted-ca\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.213608 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213564 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsbpl\" (UniqueName: \"kubernetes.io/projected/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-kube-api-access-tsbpl\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.213608 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213584 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-bound-sa-token\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.213747 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213728 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.213785 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6f21a41-add6-4434-8d54-99a932c768ea-config\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.213826 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tvzz\" (UniqueName: \"kubernetes.io/projected/e6f21a41-add6-4434-8d54-99a932c768ea-kube-api-access-5tvzz\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.213875 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.213827 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:22:38.213875 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.213845 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc58fbf75-dbmv2: secret "image-registry-tls" not found Jun 03 03:22:38.213875 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213849 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-installation-pull-secrets\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214016 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.213888 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls podName:e3814b96-d22e-48ad-b1f0-be1a7de7009b nodeName:}" failed. No retries permitted until 2026-06-03 03:22:38.713874406 +0000 UTC m=+133.875598060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls") pod "image-registry-6bc58fbf75-dbmv2" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b") : secret "image-registry-tls" not found Jun 03 03:22:38.214016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213904 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.214016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213948 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-image-registry-private-configuration\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.213985 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2swc\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-kube-api-access-s2swc\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214016 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214013 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3814b96-d22e-48ad-b1f0-be1a7de7009b-ca-trust-extracted\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214294 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214040 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.214294 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214056 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-certificates\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214294 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6f21a41-add6-4434-8d54-99a932c768ea-serving-cert\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.214294 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.214172 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:38.214294 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.214240 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls podName:2fb03ea5-da4e-463d-948d-27f4cbf1fbfa nodeName:}" failed. No retries permitted until 2026-06-03 03:22:38.714203193 +0000 UTC m=+133.875926843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f947k" (UID: "2fb03ea5-da4e-463d-948d-27f4cbf1fbfa") : secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:38.214552 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214405 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3814b96-d22e-48ad-b1f0-be1a7de7009b-ca-trust-extracted\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214552 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214468 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-trusted-ca\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.214625 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.214615 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.216141 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.216120 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-installation-pull-secrets\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.216246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.216139 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-image-registry-private-configuration\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.221603 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.221572 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsbpl\" (UniqueName: \"kubernetes.io/projected/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-kube-api-access-tsbpl\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.221691 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.221644 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-bound-sa-token\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.221826 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.221811 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2swc\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-kube-api-access-s2swc\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.314853 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.314829 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6f21a41-add6-4434-8d54-99a932c768ea-serving-cert\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.314943 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.314895 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6f21a41-add6-4434-8d54-99a932c768ea-config\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.314943 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.314911 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tvzz\" (UniqueName: \"kubernetes.io/projected/e6f21a41-add6-4434-8d54-99a932c768ea-kube-api-access-5tvzz\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.315386 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.315361 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6f21a41-add6-4434-8d54-99a932c768ea-config\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.316665 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.316645 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6f21a41-add6-4434-8d54-99a932c768ea-serving-cert\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.321775 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.321758 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tvzz\" (UniqueName: \"kubernetes.io/projected/e6f21a41-add6-4434-8d54-99a932c768ea-kube-api-access-5tvzz\") pod \"service-ca-operator-69877444c-742kz\" (UID: \"e6f21a41-add6-4434-8d54-99a932c768ea\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.418558 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.418533 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" Jun 03 03:22:38.529146 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.529115 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-742kz"] Jun 03 03:22:38.532808 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:22:38.532769 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f21a41_add6_4434_8d54_99a932c768ea.slice/crio-eaafcceee1460f13271d4add11726471f60b394a59afe20be2d6eec4997f9c63 WatchSource:0}: Error finding container eaafcceee1460f13271d4add11726471f60b394a59afe20be2d6eec4997f9c63: Status 404 returned error can't find the container with id eaafcceee1460f13271d4add11726471f60b394a59afe20be2d6eec4997f9c63 Jun 03 03:22:38.617508 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.617478 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:38.617594 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.617576 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 03:22:38.617637 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.617621 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls podName:6bade280-bd27-462a-a4bf-5eb738cafc30 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:39.617608221 +0000 UTC m=+134.779331869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9h4xd" (UID: "6bade280-bd27-462a-a4bf-5eb738cafc30") : secret "samples-operator-tls" not found Jun 03 03:22:38.718626 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.718602 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:38.718711 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.718657 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:38.718760 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.718734 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:22:38.718760 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.718749 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:38.718817 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.718790 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls podName:2fb03ea5-da4e-463d-948d-27f4cbf1fbfa nodeName:}" failed. No retries permitted until 2026-06-03 03:22:39.718776888 +0000 UTC m=+134.880500536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f947k" (UID: "2fb03ea5-da4e-463d-948d-27f4cbf1fbfa") : secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:38.718817 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.718750 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc58fbf75-dbmv2: secret "image-registry-tls" not found Jun 03 03:22:38.718817 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:38.718818 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls podName:e3814b96-d22e-48ad-b1f0-be1a7de7009b nodeName:}" failed. No retries permitted until 2026-06-03 03:22:39.718812453 +0000 UTC m=+134.880536101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls") pod "image-registry-6bc58fbf75-dbmv2" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b") : secret "image-registry-tls" not found Jun 03 03:22:38.806311 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:38.806253 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" event={"ID":"e6f21a41-add6-4434-8d54-99a932c768ea","Type":"ContainerStarted","Data":"eaafcceee1460f13271d4add11726471f60b394a59afe20be2d6eec4997f9c63"} Jun 03 03:22:39.625500 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:39.625456 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:39.625885 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.625614 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 03:22:39.625885 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.625692 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls podName:6bade280-bd27-462a-a4bf-5eb738cafc30 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:41.625672047 +0000 UTC m=+136.787395711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9h4xd" (UID: "6bade280-bd27-462a-a4bf-5eb738cafc30") : secret "samples-operator-tls" not found Jun 03 03:22:39.725952 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:39.725920 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:39.726107 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:39.726000 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:39.726107 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.726069 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:39.726193 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.726146 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls podName:2fb03ea5-da4e-463d-948d-27f4cbf1fbfa nodeName:}" failed. No retries permitted until 2026-06-03 03:22:41.726126241 +0000 UTC m=+136.887849907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f947k" (UID: "2fb03ea5-da4e-463d-948d-27f4cbf1fbfa") : secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:39.726193 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.726159 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:22:39.726193 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.726174 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc58fbf75-dbmv2: secret "image-registry-tls" not found Jun 03 03:22:39.726349 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:39.726231 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls podName:e3814b96-d22e-48ad-b1f0-be1a7de7009b nodeName:}" failed. No retries permitted until 2026-06-03 03:22:41.726205002 +0000 UTC m=+136.887928668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls") pod "image-registry-6bc58fbf75-dbmv2" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b") : secret "image-registry-tls" not found Jun 03 03:22:40.811011 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:40.810972 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" event={"ID":"e6f21a41-add6-4434-8d54-99a932c768ea","Type":"ContainerStarted","Data":"a64de388e1252528f1ada0b6d8f6ae20758a50f46e7a2cf2fda6f0e040777330"} Jun 03 03:22:40.825191 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:40.825145 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" podStartSLOduration=0.745357333 podStartE2EDuration="2.825134114s" podCreationTimestamp="2026-06-03 03:22:38 +0000 UTC" firstStartedPulling="2026-06-03 03:22:38.534459035 +0000 UTC m=+133.696182684" lastFinishedPulling="2026-06-03 03:22:40.614235812 +0000 UTC m=+135.775959465" observedRunningTime="2026-06-03 03:22:40.823922757 +0000 UTC m=+135.985646427" watchObservedRunningTime="2026-06-03 03:22:40.825134114 +0000 UTC m=+135.986857785" Jun 03 03:22:41.639497 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:41.639454 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:41.639655 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.639606 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 03:22:41.639709 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.639669 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls podName:6bade280-bd27-462a-a4bf-5eb738cafc30 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:45.639651918 +0000 UTC m=+140.801375571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9h4xd" (UID: "6bade280-bd27-462a-a4bf-5eb738cafc30") : secret "samples-operator-tls" not found Jun 03 03:22:41.740100 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:41.740071 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:41.740276 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:41.740137 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:41.740276 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.740244 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:22:41.740276 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.740252 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:41.740437 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.740332 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls podName:2fb03ea5-da4e-463d-948d-27f4cbf1fbfa nodeName:}" failed. No retries permitted until 2026-06-03 03:22:45.740310684 +0000 UTC m=+140.902034344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f947k" (UID: "2fb03ea5-da4e-463d-948d-27f4cbf1fbfa") : secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:41.740437 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.740261 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc58fbf75-dbmv2: secret "image-registry-tls" not found Jun 03 03:22:41.740437 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:41.740403 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls podName:e3814b96-d22e-48ad-b1f0-be1a7de7009b nodeName:}" failed. No retries permitted until 2026-06-03 03:22:45.740388397 +0000 UTC m=+140.902112059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls") pod "image-registry-6bc58fbf75-dbmv2" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b") : secret "image-registry-tls" not found Jun 03 03:22:43.709968 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.709935 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wvcdc"] Jun 03 03:22:43.712805 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.712790 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.716285 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.716256 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 03:22:43.716827 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.716804 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 03:22:43.716931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.716839 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 03:22:43.717147 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.717131 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fhq2w\"" Jun 03 03:22:43.717410 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.717393 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 03:22:43.729384 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.729364 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wvcdc"] Jun 03 03:22:43.855405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.855372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/68c0426d-ab78-4971-8e82-c7c28dd774dc-signing-key\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.855538 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.855435 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/68c0426d-ab78-4971-8e82-c7c28dd774dc-signing-cabundle\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.855538 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.855495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5c5\" (UniqueName: \"kubernetes.io/projected/68c0426d-ab78-4971-8e82-c7c28dd774dc-kube-api-access-sm5c5\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.908355 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.908325 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-9792g"] Jun 03 03:22:43.911250 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.911235 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" Jun 03 03:22:43.913494 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.913460 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jlff4\"" Jun 03 03:22:43.919819 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.919798 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-9792g"] Jun 03 03:22:43.956672 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.956645 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/68c0426d-ab78-4971-8e82-c7c28dd774dc-signing-key\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.956805 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.956715 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/68c0426d-ab78-4971-8e82-c7c28dd774dc-signing-cabundle\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.956805 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.956753 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5c5\" (UniqueName: \"kubernetes.io/projected/68c0426d-ab78-4971-8e82-c7c28dd774dc-kube-api-access-sm5c5\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.957340 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.957324 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/68c0426d-ab78-4971-8e82-c7c28dd774dc-signing-cabundle\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.958925 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.958908 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/68c0426d-ab78-4971-8e82-c7c28dd774dc-signing-key\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:43.963923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:43.963875 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5c5\" (UniqueName: \"kubernetes.io/projected/68c0426d-ab78-4971-8e82-c7c28dd774dc-kube-api-access-sm5c5\") pod \"service-ca-685df94d57-wvcdc\" (UID: \"68c0426d-ab78-4971-8e82-c7c28dd774dc\") " pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:44.021331 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.021305 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-wvcdc" Jun 03 03:22:44.058255 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.058202 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d74x\" (UniqueName: \"kubernetes.io/projected/ee03b01d-e424-4007-88d3-4cca049d1824-kube-api-access-2d74x\") pod \"network-check-source-56d84b9f44-9792g\" (UID: \"ee03b01d-e424-4007-88d3-4cca049d1824\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" Jun 03 03:22:44.136660 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.136611 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wvcdc"] Jun 03 03:22:44.139970 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:22:44.139940 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c0426d_ab78_4971_8e82_c7c28dd774dc.slice/crio-169bd88cf27d9c2f2b9e8b4a5d85f9d36182ddb09cce42aeed97cb874e0f528a WatchSource:0}: Error finding container 169bd88cf27d9c2f2b9e8b4a5d85f9d36182ddb09cce42aeed97cb874e0f528a: Status 404 returned error can't find the container with id 169bd88cf27d9c2f2b9e8b4a5d85f9d36182ddb09cce42aeed97cb874e0f528a Jun 03 03:22:44.159531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.159507 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2d74x\" (UniqueName: \"kubernetes.io/projected/ee03b01d-e424-4007-88d3-4cca049d1824-kube-api-access-2d74x\") pod \"network-check-source-56d84b9f44-9792g\" (UID: \"ee03b01d-e424-4007-88d3-4cca049d1824\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" Jun 03 03:22:44.166924 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.166904 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d74x\" (UniqueName: \"kubernetes.io/projected/ee03b01d-e424-4007-88d3-4cca049d1824-kube-api-access-2d74x\") pod \"network-check-source-56d84b9f44-9792g\" (UID: \"ee03b01d-e424-4007-88d3-4cca049d1824\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" Jun 03 03:22:44.219845 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.219783 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" Jun 03 03:22:44.333319 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.333292 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-9792g"] Jun 03 03:22:44.336119 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:22:44.336089 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee03b01d_e424_4007_88d3_4cca049d1824.slice/crio-85adbf3d7c6d6deecb9c89f7048a35c929fb4279998ad910857acbeeda77944b WatchSource:0}: Error finding container 85adbf3d7c6d6deecb9c89f7048a35c929fb4279998ad910857acbeeda77944b: Status 404 returned error can't find the container with id 85adbf3d7c6d6deecb9c89f7048a35c929fb4279998ad910857acbeeda77944b Jun 03 03:22:44.783176 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.783150 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jv4k5_0a37bf2d-821f-4f29-9448-ba501e17bc7d/dns-node-resolver/0.log" Jun 03 03:22:44.819506 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.819468 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" event={"ID":"ee03b01d-e424-4007-88d3-4cca049d1824","Type":"ContainerStarted","Data":"021313e7426e8661f9231bee91c09b383b4723f6b1b4fb291bc2a3816c705226"} Jun 03 03:22:44.819659 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.819510 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" event={"ID":"ee03b01d-e424-4007-88d3-4cca049d1824","Type":"ContainerStarted","Data":"85adbf3d7c6d6deecb9c89f7048a35c929fb4279998ad910857acbeeda77944b"} Jun 03 03:22:44.820783 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.820761 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-wvcdc" event={"ID":"68c0426d-ab78-4971-8e82-c7c28dd774dc","Type":"ContainerStarted","Data":"5b7b0ec1d2027d5addda421974ee81c88c53c0156015eca4285babb3f2feed59"} Jun 03 03:22:44.820783 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.820785 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-wvcdc" event={"ID":"68c0426d-ab78-4971-8e82-c7c28dd774dc","Type":"ContainerStarted","Data":"169bd88cf27d9c2f2b9e8b4a5d85f9d36182ddb09cce42aeed97cb874e0f528a"} Jun 03 03:22:44.834104 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.834067 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-9792g" podStartSLOduration=1.834058108 podStartE2EDuration="1.834058108s" podCreationTimestamp="2026-06-03 03:22:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:22:44.833328815 +0000 UTC m=+139.995052487" watchObservedRunningTime="2026-06-03 03:22:44.834058108 +0000 UTC m=+139.995781778" Jun 03 03:22:44.846600 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:44.846565 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-wvcdc" podStartSLOduration=1.846551437 podStartE2EDuration="1.846551437s" podCreationTimestamp="2026-06-03 03:22:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:22:44.846139916 +0000 UTC m=+140.007863588" watchObservedRunningTime="2026-06-03 03:22:44.846551437 +0000 UTC m=+140.008275110" Jun 03 03:22:45.583424 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:45.583396 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pmfhp_e15bac92-028f-4cf2-b21b-625c36a65398/node-ca/0.log" Jun 03 03:22:45.672007 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:45.671971 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:45.672239 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.672126 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 03:22:45.672239 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.672184 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls podName:6bade280-bd27-462a-a4bf-5eb738cafc30 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:53.67216667 +0000 UTC m=+148.833890329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-9h4xd" (UID: "6bade280-bd27-462a-a4bf-5eb738cafc30") : secret "samples-operator-tls" not found Jun 03 03:22:45.772415 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:45.772378 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:45.772606 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:45.772475 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:45.772606 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.772592 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:22:45.772606 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.772606 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bc58fbf75-dbmv2: secret "image-registry-tls" not found Jun 03 03:22:45.772766 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.772658 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls podName:e3814b96-d22e-48ad-b1f0-be1a7de7009b nodeName:}" failed. No retries permitted until 2026-06-03 03:22:53.772640131 +0000 UTC m=+148.934363785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls") pod "image-registry-6bc58fbf75-dbmv2" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b") : secret "image-registry-tls" not found Jun 03 03:22:45.773037 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.773022 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:45.773105 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:22:45.773071 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls podName:2fb03ea5-da4e-463d-948d-27f4cbf1fbfa nodeName:}" failed. No retries permitted until 2026-06-03 03:22:53.773058164 +0000 UTC m=+148.934781817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f947k" (UID: "2fb03ea5-da4e-463d-948d-27f4cbf1fbfa") : secret "cluster-monitoring-operator-tls" not found Jun 03 03:22:53.733988 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.733953 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:53.736171 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.736145 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bade280-bd27-462a-a4bf-5eb738cafc30-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-9h4xd\" (UID: \"6bade280-bd27-462a-a4bf-5eb738cafc30\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:53.821449 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.821424 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" Jun 03 03:22:53.835279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.835255 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:53.835366 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.835348 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:53.837634 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.837608 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fb03ea5-da4e-463d-948d-27f4cbf1fbfa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f947k\" (UID: \"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:53.837744 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.837608 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"image-registry-6bc58fbf75-dbmv2\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:53.924667 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.924639 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" Jun 03 03:22:53.930414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.930387 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:53.941380 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:53.941198 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd"] Jun 03 03:22:54.061718 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.061683 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k"] Jun 03 03:22:54.065689 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:22:54.065655 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb03ea5_da4e_463d_948d_27f4cbf1fbfa.slice/crio-03eee23998566f11a3016922c25785dfdd016d1b5d2ff580836c0cad62d36994 WatchSource:0}: Error finding container 03eee23998566f11a3016922c25785dfdd016d1b5d2ff580836c0cad62d36994: Status 404 returned error can't find the container with id 03eee23998566f11a3016922c25785dfdd016d1b5d2ff580836c0cad62d36994 Jun 03 03:22:54.077789 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.077669 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc58fbf75-dbmv2"] Jun 03 03:22:54.079713 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:22:54.079692 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3814b96_d22e_48ad_b1f0_be1a7de7009b.slice/crio-e124168c24e3173552b205b2b3f5f2bcb9ae0034a8ca3660812dd7c05e1febca WatchSource:0}: Error finding container e124168c24e3173552b205b2b3f5f2bcb9ae0034a8ca3660812dd7c05e1febca: Status 404 returned error can't find the container with id e124168c24e3173552b205b2b3f5f2bcb9ae0034a8ca3660812dd7c05e1febca Jun 03 03:22:54.843435 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.843392 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" event={"ID":"e3814b96-d22e-48ad-b1f0-be1a7de7009b","Type":"ContainerStarted","Data":"b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16"} Jun 03 03:22:54.843435 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.843439 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" event={"ID":"e3814b96-d22e-48ad-b1f0-be1a7de7009b","Type":"ContainerStarted","Data":"e124168c24e3173552b205b2b3f5f2bcb9ae0034a8ca3660812dd7c05e1febca"} Jun 03 03:22:54.843928 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.843547 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:22:54.845174 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.845136 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" event={"ID":"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa","Type":"ContainerStarted","Data":"03eee23998566f11a3016922c25785dfdd016d1b5d2ff580836c0cad62d36994"} Jun 03 03:22:54.846244 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.846203 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" event={"ID":"6bade280-bd27-462a-a4bf-5eb738cafc30","Type":"ContainerStarted","Data":"b738d0c9ce40cbf237b331d3dba560efcf7bef502560c4fb00d5376e5ea5dc6e"} Jun 03 03:22:54.862709 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:54.862662 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" podStartSLOduration=17.862648795 podStartE2EDuration="17.862648795s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:22:54.861682603 +0000 UTC m=+150.023406278" watchObservedRunningTime="2026-06-03 03:22:54.862648795 +0000 UTC m=+150.024372493" Jun 03 03:22:56.852505 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:56.852470 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" event={"ID":"6bade280-bd27-462a-a4bf-5eb738cafc30","Type":"ContainerStarted","Data":"ed319e619924c67d64a85f90fac0d353d15832fb46ef69d78cd202b506e50b6b"} Jun 03 03:22:56.852845 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:56.852512 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" event={"ID":"6bade280-bd27-462a-a4bf-5eb738cafc30","Type":"ContainerStarted","Data":"969b4c218000eb2c2920a04412c260cff6cc4af6e2b155a450f16ca80b94b18d"} Jun 03 03:22:56.868050 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:56.868011 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-9h4xd" podStartSLOduration=18.00863726 podStartE2EDuration="19.867997569s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="2026-06-03 03:22:53.997750165 +0000 UTC m=+149.159473829" lastFinishedPulling="2026-06-03 03:22:55.857110486 +0000 UTC m=+151.018834138" observedRunningTime="2026-06-03 03:22:56.866798278 +0000 UTC m=+152.028521949" watchObservedRunningTime="2026-06-03 03:22:56.867997569 +0000 UTC m=+152.029721265" Jun 03 03:22:57.857920 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:57.857873 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" event={"ID":"2fb03ea5-da4e-463d-948d-27f4cbf1fbfa","Type":"ContainerStarted","Data":"ff79095a6b89eda442e88008dbbfdbd9b13133407319bc696a779b3659c45d30"} Jun 03 03:22:57.872923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:22:57.872883 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f947k" podStartSLOduration=18.076657558 podStartE2EDuration="20.872870449s" podCreationTimestamp="2026-06-03 03:22:37 +0000 UTC" firstStartedPulling="2026-06-03 03:22:54.067418597 +0000 UTC m=+149.229142246" lastFinishedPulling="2026-06-03 03:22:56.863631485 +0000 UTC m=+152.025355137" observedRunningTime="2026-06-03 03:22:57.872293333 +0000 UTC m=+153.034017027" watchObservedRunningTime="2026-06-03 03:22:57.872870449 +0000 UTC m=+153.034594119" Jun 03 03:23:03.223192 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:03.223154 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s49xc" podUID="5e1d24a3-cee0-447f-a190-b720f7c532b0" Jun 03 03:23:03.233449 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:03.233419 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-k2w2h" podUID="09234263-e48e-4dee-9de1-f9c3e2aa34fd" Jun 03 03:23:03.871147 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:03.871112 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s49xc" Jun 03 03:23:03.871311 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:03.871112 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:23:04.423619 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:04.423583 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pfx99" podUID="f5333f73-4353-4f94-93ef-4137cf3b76e0" Jun 03 03:23:07.083282 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.083246 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f846bd64f-82cxh"] Jun 03 03:23:07.087606 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.087586 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.091077 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.091057 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9rp5v\"" Jun 03 03:23:07.091929 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.091905 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 03:23:07.092085 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.092050 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 03:23:07.092827 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.092810 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 03:23:07.092935 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.092847 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 03:23:07.094561 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.094392 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 03:23:07.094861 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.094847 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 03:23:07.107831 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.107812 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 03:23:07.108869 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.108846 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f846bd64f-82cxh"] Jun 03 03:23:07.116113 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.116090 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bc58fbf75-dbmv2"] Jun 03 03:23:07.129412 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.129393 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pq6qr"] Jun 03 03:23:07.132530 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.132511 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.135733 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.135715 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 03:23:07.136001 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.135974 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mwlqd\"" Jun 03 03:23:07.136086 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.136008 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 03:23:07.136086 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.136036 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 03:23:07.136197 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.136089 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 03:23:07.168025 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.168006 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pq6qr"] Jun 03 03:23:07.223908 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.223889 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-oauth-serving-cert\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.224005 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.223921 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4458a55-e71e-4e08-bb30-8a2175d9aec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.224005 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.223957 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4458a55-e71e-4e08-bb30-8a2175d9aec6-crio-socket\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.224005 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.223994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4458a55-e71e-4e08-bb30-8a2175d9aec6-data-volume\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.224115 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224031 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4458a55-e71e-4e08-bb30-8a2175d9aec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.224149 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-service-ca\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.224149 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6775\" (UniqueName: \"kubernetes.io/projected/299b62fe-45cf-4b4a-ab12-465b2c033925-kube-api-access-c6775\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.224237 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-console-config\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.224275 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xphx\" (UniqueName: \"kubernetes.io/projected/e4458a55-e71e-4e08-bb30-8a2175d9aec6-kube-api-access-6xphx\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.224310 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-oauth-config\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.224310 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.224303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-serving-cert\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325157 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325132 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-oauth-serving-cert\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325301 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325160 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4458a55-e71e-4e08-bb30-8a2175d9aec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325301 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325191 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4458a55-e71e-4e08-bb30-8a2175d9aec6-crio-socket\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325301 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325206 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4458a55-e71e-4e08-bb30-8a2175d9aec6-data-volume\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325301 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325248 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4458a55-e71e-4e08-bb30-8a2175d9aec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325301 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325293 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-service-ca\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325297 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4458a55-e71e-4e08-bb30-8a2175d9aec6-crio-socket\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325309 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6775\" (UniqueName: \"kubernetes.io/projected/299b62fe-45cf-4b4a-ab12-465b2c033925-kube-api-access-c6775\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325375 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-console-config\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325410 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xphx\" (UniqueName: \"kubernetes.io/projected/e4458a55-e71e-4e08-bb30-8a2175d9aec6-kube-api-access-6xphx\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325436 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-oauth-config\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325465 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-serving-cert\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.325887 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4458a55-e71e-4e08-bb30-8a2175d9aec6-data-volume\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.325970 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.325943 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-oauth-serving-cert\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.326081 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.326045 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-console-config\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.326186 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.326095 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-service-ca\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.326186 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.326167 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4458a55-e71e-4e08-bb30-8a2175d9aec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.327787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.327768 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-oauth-config\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.328026 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.328010 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4458a55-e71e-4e08-bb30-8a2175d9aec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.328100 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.328085 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-serving-cert\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.335250 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.335176 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xphx\" (UniqueName: \"kubernetes.io/projected/e4458a55-e71e-4e08-bb30-8a2175d9aec6-kube-api-access-6xphx\") pod \"insights-runtime-extractor-pq6qr\" (UID: \"e4458a55-e71e-4e08-bb30-8a2175d9aec6\") " pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.335436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.335419 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6775\" (UniqueName: \"kubernetes.io/projected/299b62fe-45cf-4b4a-ab12-465b2c033925-kube-api-access-c6775\") pod \"console-5f846bd64f-82cxh\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.396577 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.396558 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:07.441550 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.441524 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pq6qr" Jun 03 03:23:07.523112 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.523084 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f846bd64f-82cxh"] Jun 03 03:23:07.526149 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:07.526121 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299b62fe_45cf_4b4a_ab12_465b2c033925.slice/crio-f981f8df2713dfb07bbac9366aeeae137e9a1a4ccf0e34a5a608f4f84bdcd582 WatchSource:0}: Error finding container f981f8df2713dfb07bbac9366aeeae137e9a1a4ccf0e34a5a608f4f84bdcd582: Status 404 returned error can't find the container with id f981f8df2713dfb07bbac9366aeeae137e9a1a4ccf0e34a5a608f4f84bdcd582 Jun 03 03:23:07.569937 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.569910 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pq6qr"] Jun 03 03:23:07.572667 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:07.572643 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4458a55_e71e_4e08_bb30_8a2175d9aec6.slice/crio-339c2efb7f3a597cbd61faea76de87e9a018f2a5a755df2d81265309fecdbb9c WatchSource:0}: Error finding container 339c2efb7f3a597cbd61faea76de87e9a018f2a5a755df2d81265309fecdbb9c: Status 404 returned error can't find the container with id 339c2efb7f3a597cbd61faea76de87e9a018f2a5a755df2d81265309fecdbb9c Jun 03 03:23:07.880399 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.880315 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f846bd64f-82cxh" event={"ID":"299b62fe-45cf-4b4a-ab12-465b2c033925","Type":"ContainerStarted","Data":"f981f8df2713dfb07bbac9366aeeae137e9a1a4ccf0e34a5a608f4f84bdcd582"} Jun 03 03:23:07.881612 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.881586 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq6qr" event={"ID":"e4458a55-e71e-4e08-bb30-8a2175d9aec6","Type":"ContainerStarted","Data":"05778cc4bd453ac15760006bc8a0422fc9135100971f06fcd50c95d0a5b2470c"} Jun 03 03:23:07.881714 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:07.881617 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq6qr" event={"ID":"e4458a55-e71e-4e08-bb30-8a2175d9aec6","Type":"ContainerStarted","Data":"339c2efb7f3a597cbd61faea76de87e9a018f2a5a755df2d81265309fecdbb9c"} Jun 03 03:23:08.131396 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.131314 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:23:08.131396 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.131375 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:23:08.133834 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.133812 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e1d24a3-cee0-447f-a190-b720f7c532b0-metrics-tls\") pod \"dns-default-s49xc\" (UID: \"5e1d24a3-cee0-447f-a190-b720f7c532b0\") " pod="openshift-dns/dns-default-s49xc" Jun 03 03:23:08.133980 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.133955 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09234263-e48e-4dee-9de1-f9c3e2aa34fd-cert\") pod \"ingress-canary-k2w2h\" (UID: \"09234263-e48e-4dee-9de1-f9c3e2aa34fd\") " pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:23:08.374021 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.373994 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jxzs\"" Jun 03 03:23:08.374883 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.374862 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kzhg4\"" Jun 03 03:23:08.382743 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.382684 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2w2h" Jun 03 03:23:08.382743 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.382721 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s49xc" Jun 03 03:23:08.538891 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.538858 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2w2h"] Jun 03 03:23:08.542119 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:08.542083 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09234263_e48e_4dee_9de1_f9c3e2aa34fd.slice/crio-05e7862e12be1772799595fcd03e28b44bc60971494102221c89a04b65faf704 WatchSource:0}: Error finding container 05e7862e12be1772799595fcd03e28b44bc60971494102221c89a04b65faf704: Status 404 returned error can't find the container with id 05e7862e12be1772799595fcd03e28b44bc60971494102221c89a04b65faf704 Jun 03 03:23:08.559268 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.559246 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s49xc"] Jun 03 03:23:08.562052 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:08.562027 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1d24a3_cee0_447f_a190_b720f7c532b0.slice/crio-8618d50b2398a48274ee41099e2fcac6a7f43609d829d405491ec918ce212b65 WatchSource:0}: Error finding container 8618d50b2398a48274ee41099e2fcac6a7f43609d829d405491ec918ce212b65: Status 404 returned error can't find the container with id 8618d50b2398a48274ee41099e2fcac6a7f43609d829d405491ec918ce212b65 Jun 03 03:23:08.887595 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.887562 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq6qr" event={"ID":"e4458a55-e71e-4e08-bb30-8a2175d9aec6","Type":"ContainerStarted","Data":"10a5eef024f89323ff2379114c51212e0463e02a857521c7988a5159050c2118"} Jun 03 03:23:08.888581 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.888556 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2w2h" event={"ID":"09234263-e48e-4dee-9de1-f9c3e2aa34fd","Type":"ContainerStarted","Data":"05e7862e12be1772799595fcd03e28b44bc60971494102221c89a04b65faf704"} Jun 03 03:23:08.889507 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:08.889474 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s49xc" event={"ID":"5e1d24a3-cee0-447f-a190-b720f7c532b0","Type":"ContainerStarted","Data":"8618d50b2398a48274ee41099e2fcac6a7f43609d829d405491ec918ce212b65"} Jun 03 03:23:11.394167 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.394128 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6"] Jun 03 03:23:11.397555 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.397529 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.401208 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.400964 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 03:23:11.401208 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.400999 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qdplt\"" Jun 03 03:23:11.401208 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.401059 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 03:23:11.401208 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.401063 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 03:23:11.408210 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.408187 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6"] Jun 03 03:23:11.560879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.560839 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.561060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.560904 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.561060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.561011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhcx\" (UniqueName: \"kubernetes.io/projected/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-kube-api-access-tvhcx\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.561168 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.561126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.662164 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.662087 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.662164 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.662150 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.662441 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.662184 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.662441 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.662241 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhcx\" (UniqueName: \"kubernetes.io/projected/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-kube-api-access-tvhcx\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.662441 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:11.662253 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 03:23:11.662441 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:11.662327 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls podName:9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c nodeName:}" failed. No retries permitted until 2026-06-03 03:23:12.162306156 +0000 UTC m=+167.324029810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-xqbn6" (UID: "9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c") : secret "prometheus-operator-tls" not found Jun 03 03:23:11.662889 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.662864 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.664784 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.664763 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:11.671512 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:11.671487 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhcx\" (UniqueName: \"kubernetes.io/projected/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-kube-api-access-tvhcx\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:12.168123 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.168081 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:12.168334 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:12.168313 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 03:23:12.168430 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:12.168404 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls podName:9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c nodeName:}" failed. No retries permitted until 2026-06-03 03:23:13.168383976 +0000 UTC m=+168.330107641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-xqbn6" (UID: "9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c") : secret "prometheus-operator-tls" not found Jun 03 03:23:12.901919 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.901884 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2w2h" event={"ID":"09234263-e48e-4dee-9de1-f9c3e2aa34fd","Type":"ContainerStarted","Data":"52b8606d3a57cb753a074fc124abe43625743264808a70980021cf61c740922a"} Jun 03 03:23:12.903416 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.903381 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s49xc" event={"ID":"5e1d24a3-cee0-447f-a190-b720f7c532b0","Type":"ContainerStarted","Data":"dc26d704e1deea3fe9a972788ba78e7cace17d49c45f2b27f6c7533b32ac81fc"} Jun 03 03:23:12.903416 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.903414 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s49xc" event={"ID":"5e1d24a3-cee0-447f-a190-b720f7c532b0","Type":"ContainerStarted","Data":"473fd8ac954f2acf0ec6b14cc51cb6d8fb21b951e81a7a9373a557af90c0a7c0"} Jun 03 03:23:12.903596 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.903450 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s49xc" Jun 03 03:23:12.904669 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.904642 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f846bd64f-82cxh" event={"ID":"299b62fe-45cf-4b4a-ab12-465b2c033925","Type":"ContainerStarted","Data":"48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510"} Jun 03 03:23:12.906334 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.906313 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq6qr" event={"ID":"e4458a55-e71e-4e08-bb30-8a2175d9aec6","Type":"ContainerStarted","Data":"ae2c5095a42fd9aedf316ac04f51992b0b0cfe55641270bfe47fddcb0695dd30"} Jun 03 03:23:12.916531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.916493 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k2w2h" podStartSLOduration=129.365502435 podStartE2EDuration="2m12.916481693s" podCreationTimestamp="2026-06-03 03:21:00 +0000 UTC" firstStartedPulling="2026-06-03 03:23:08.544386476 +0000 UTC m=+163.706110125" lastFinishedPulling="2026-06-03 03:23:12.09536572 +0000 UTC m=+167.257089383" observedRunningTime="2026-06-03 03:23:12.915266737 +0000 UTC m=+168.076990410" watchObservedRunningTime="2026-06-03 03:23:12.916481693 +0000 UTC m=+168.078205364" Jun 03 03:23:12.931064 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.931027 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pq6qr" podStartSLOduration=1.467796562 podStartE2EDuration="5.931018157s" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.62852543 +0000 UTC m=+162.790249078" lastFinishedPulling="2026-06-03 03:23:12.091747018 +0000 UTC m=+167.253470673" observedRunningTime="2026-06-03 03:23:12.930125521 +0000 UTC m=+168.091849193" watchObservedRunningTime="2026-06-03 03:23:12.931018157 +0000 UTC m=+168.092741827" Jun 03 03:23:12.945151 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.945115 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-s49xc" podStartSLOduration=129.417451637 podStartE2EDuration="2m12.945102869s" podCreationTimestamp="2026-06-03 03:21:00 +0000 UTC" firstStartedPulling="2026-06-03 03:23:08.564107258 +0000 UTC m=+163.725830906" lastFinishedPulling="2026-06-03 03:23:12.091758485 +0000 UTC m=+167.253482138" observedRunningTime="2026-06-03 03:23:12.944330711 +0000 UTC m=+168.106054383" watchObservedRunningTime="2026-06-03 03:23:12.945102869 +0000 UTC m=+168.106826540" Jun 03 03:23:12.961229 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:12.961179 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f846bd64f-82cxh" podStartSLOduration=1.39168767 podStartE2EDuration="5.961170301s" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.529379443 +0000 UTC m=+162.691103094" lastFinishedPulling="2026-06-03 03:23:12.098862064 +0000 UTC m=+167.260585725" observedRunningTime="2026-06-03 03:23:12.960297356 +0000 UTC m=+168.122021029" watchObservedRunningTime="2026-06-03 03:23:12.961170301 +0000 UTC m=+168.122893973" Jun 03 03:23:13.174837 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:13.174761 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:13.177013 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:13.176984 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-xqbn6\" (UID: \"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:13.211025 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:13.210991 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" Jun 03 03:23:13.326958 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:13.326812 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6"] Jun 03 03:23:13.329370 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:13.329344 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c88a1ad_6fd6_4819_ab66_fcbcfcd3093c.slice/crio-b7508b0445f387f86c5e4ec9d7291b5d49956416b13f29344362d5768918834e WatchSource:0}: Error finding container b7508b0445f387f86c5e4ec9d7291b5d49956416b13f29344362d5768918834e: Status 404 returned error can't find the container with id b7508b0445f387f86c5e4ec9d7291b5d49956416b13f29344362d5768918834e Jun 03 03:23:13.910782 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:13.910730 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" event={"ID":"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c","Type":"ContainerStarted","Data":"b7508b0445f387f86c5e4ec9d7291b5d49956416b13f29344362d5768918834e"} Jun 03 03:23:15.457095 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.457063 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f8b65789-xprvt"] Jun 03 03:23:15.460017 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.460000 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.467515 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.467496 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 03:23:15.469573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.469546 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f8b65789-xprvt"] Jun 03 03:23:15.597099 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-trusted-ca-bundle\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.597305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597111 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-service-ca\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.597305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-oauth-serving-cert\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.597305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-console-config\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.597305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597200 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-oauth-config\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.597305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-serving-cert\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.597305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.597299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xpqc\" (UniqueName: \"kubernetes.io/projected/83206ae8-a917-450b-a7be-c505d7e9a40a-kube-api-access-8xpqc\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.697604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697573 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xpqc\" (UniqueName: \"kubernetes.io/projected/83206ae8-a917-450b-a7be-c505d7e9a40a-kube-api-access-8xpqc\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.697761 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697620 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-trusted-ca-bundle\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.697847 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697797 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-service-ca\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.697847 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697823 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-oauth-serving-cert\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698018 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697852 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-console-config\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698018 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697881 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-oauth-config\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698018 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.697917 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-serving-cert\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698664 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.698640 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-service-ca\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698782 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.698638 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-oauth-serving-cert\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698782 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.698654 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-trusted-ca-bundle\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.698782 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.698712 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-console-config\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.700435 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.700399 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-oauth-config\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.700661 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.700642 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-serving-cert\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.704473 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.704452 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xpqc\" (UniqueName: \"kubernetes.io/projected/83206ae8-a917-450b-a7be-c505d7e9a40a-kube-api-access-8xpqc\") pod \"console-79f8b65789-xprvt\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.769558 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.769469 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:15.886077 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.886041 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f8b65789-xprvt"] Jun 03 03:23:15.889082 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:15.889056 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83206ae8_a917_450b_a7be_c505d7e9a40a.slice/crio-2d5f858b34794a536c19eeef1b9188c5c275edfff0273ef18a4cae224a04f152 WatchSource:0}: Error finding container 2d5f858b34794a536c19eeef1b9188c5c275edfff0273ef18a4cae224a04f152: Status 404 returned error can't find the container with id 2d5f858b34794a536c19eeef1b9188c5c275edfff0273ef18a4cae224a04f152 Jun 03 03:23:15.917253 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.917208 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" event={"ID":"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c","Type":"ContainerStarted","Data":"34993d44644e11b589fc5acf90644c3faf54ecc62a9881a144eae2e91a95d088"} Jun 03 03:23:15.917361 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.917261 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" event={"ID":"9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c","Type":"ContainerStarted","Data":"89ddfecff0202242de2e1c0a7f9cb425a2e16769b047f04c17c94446a44633b3"} Jun 03 03:23:15.918187 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.918167 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8b65789-xprvt" event={"ID":"83206ae8-a917-450b-a7be-c505d7e9a40a","Type":"ContainerStarted","Data":"2d5f858b34794a536c19eeef1b9188c5c275edfff0273ef18a4cae224a04f152"} Jun 03 03:23:15.931588 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:15.931545 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-xqbn6" podStartSLOduration=3.383636102 podStartE2EDuration="4.931532554s" podCreationTimestamp="2026-06-03 03:23:11 +0000 UTC" firstStartedPulling="2026-06-03 03:23:13.331079883 +0000 UTC m=+168.492803532" lastFinishedPulling="2026-06-03 03:23:14.878976317 +0000 UTC m=+170.040699984" observedRunningTime="2026-06-03 03:23:15.93095048 +0000 UTC m=+171.092674145" watchObservedRunningTime="2026-06-03 03:23:15.931532554 +0000 UTC m=+171.093256225" Jun 03 03:23:16.922480 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:16.922446 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8b65789-xprvt" event={"ID":"83206ae8-a917-450b-a7be-c505d7e9a40a","Type":"ContainerStarted","Data":"7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7"} Jun 03 03:23:16.939102 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:16.939057 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79f8b65789-xprvt" podStartSLOduration=1.9390451 podStartE2EDuration="1.9390451s" podCreationTimestamp="2026-06-03 03:23:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:23:16.937979255 +0000 UTC m=+172.099702927" watchObservedRunningTime="2026-06-03 03:23:16.9390451 +0000 UTC m=+172.100768770" Jun 03 03:23:17.121656 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.121631 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:23:17.398801 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.398763 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:17.399003 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.398844 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:17.404201 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.404181 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:17.715587 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.715555 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cpntn"] Jun 03 03:23:17.719425 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.719406 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.721644 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.721619 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 03:23:17.721927 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.721900 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 03:23:17.721927 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.721911 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dc8g8\"" Jun 03 03:23:17.723289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.723266 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd"] Jun 03 03:23:17.726322 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.726306 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.730019 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.729544 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 03:23:17.733538 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.730341 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 03:23:17.733538 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.730822 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 03:23:17.733538 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.733488 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cpntn"] Jun 03 03:23:17.738729 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.738577 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qpg6q"] Jun 03 03:23:17.744059 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.743489 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6dl7d\"" Jun 03 03:23:17.747090 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.747068 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd"] Jun 03 03:23:17.747250 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.747228 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.757417 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.757399 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 03:23:17.758130 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.758110 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 03:23:17.759660 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.759640 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9xxj\"" Jun 03 03:23:17.760455 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.760434 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 03:23:17.817189 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.817157 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wgl9\" (UniqueName: \"kubernetes.io/projected/b2288c22-402c-4bb6-9a41-37b9f698ac35-kube-api-access-6wgl9\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.817389 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.817211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.817389 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.817290 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.817389 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.817338 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2288c22-402c-4bb6-9a41-37b9f698ac35-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.918405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918371 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-root\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.918405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918401 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.918647 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f111e1-44ae-4b38-8d1c-0867feec5ecc-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.918647 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918447 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wgl9\" (UniqueName: \"kubernetes.io/projected/b2288c22-402c-4bb6-9a41-37b9f698ac35-kube-api-access-6wgl9\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.918647 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pc6v\" (UniqueName: \"kubernetes.io/projected/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-api-access-5pc6v\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.918647 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918597 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.918647 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-wtmp\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-tls\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918721 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918781 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/23f111e1-44ae-4b38-8d1c-0867feec5ecc-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:17.918801 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-sys\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.918903 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:17.918887 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-tls podName:b2288c22-402c-4bb6-9a41-37b9f698ac35 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:18.418865591 +0000 UTC m=+173.580589256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-cpntn" (UID: "b2288c22-402c-4bb6-9a41-37b9f698ac35") : secret "openshift-state-metrics-tls" not found Jun 03 03:23:17.919317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918922 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvpm\" (UniqueName: \"kubernetes.io/projected/31bab2e6-2add-4a33-90e8-0d6b9197f81e-kube-api-access-4pvpm\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.919317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918952 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:17.919317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.918997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-textfile\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.919317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.919022 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.919317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.919044 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31bab2e6-2add-4a33-90e8-0d6b9197f81e-metrics-client-ca\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:17.919317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.919090 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2288c22-402c-4bb6-9a41-37b9f698ac35-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.919721 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.919704 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2288c22-402c-4bb6-9a41-37b9f698ac35-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.921918 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.921891 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.926806 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.926783 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wgl9\" (UniqueName: \"kubernetes.io/projected/b2288c22-402c-4bb6-9a41-37b9f698ac35-kube-api-access-6wgl9\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:17.930698 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:17.930677 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:18.019852 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.019765 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31bab2e6-2add-4a33-90e8-0d6b9197f81e-metrics-client-ca\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.019852 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.019833 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-root\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.019860 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.019941 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f111e1-44ae-4b38-8d1c-0867feec5ecc-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.020060 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.019945 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-root\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020089 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pc6v\" (UniqueName: \"kubernetes.io/projected/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-api-access-5pc6v\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.020211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020125 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.020211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020158 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-wtmp\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020195 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-tls\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020404 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020256 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.020404 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020286 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/23f111e1-44ae-4b38-8d1c-0867feec5ecc-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.020404 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020352 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-wtmp\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020551 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020406 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020551 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020449 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-sys\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020551 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020515 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31bab2e6-2add-4a33-90e8-0d6b9197f81e-sys\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.020913 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.020886 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/23f111e1-44ae-4b38-8d1c-0867feec5ecc-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021084 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvpm\" (UniqueName: \"kubernetes.io/projected/31bab2e6-2add-4a33-90e8-0d6b9197f81e-kube-api-access-4pvpm\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021086 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021113 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021116 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31bab2e6-2add-4a33-90e8-0d6b9197f81e-metrics-client-ca\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021148 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021182 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-textfile\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:18.021209 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 03:23:18.021362 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:18.021310 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-tls podName:23f111e1-44ae-4b38-8d1c-0867feec5ecc nodeName:}" failed. No retries permitted until 2026-06-03 03:23:18.5212927 +0000 UTC m=+173.683016356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-jgrfd" (UID: "23f111e1-44ae-4b38-8d1c-0867feec5ecc") : secret "kube-state-metrics-tls" not found Jun 03 03:23:18.021822 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.021465 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-textfile\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.022162 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.022139 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f111e1-44ae-4b38-8d1c-0867feec5ecc-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.023464 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.023444 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.023587 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.023432 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.024736 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.024714 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31bab2e6-2add-4a33-90e8-0d6b9197f81e-node-exporter-tls\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.032756 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.032725 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvpm\" (UniqueName: \"kubernetes.io/projected/31bab2e6-2add-4a33-90e8-0d6b9197f81e-kube-api-access-4pvpm\") pod \"node-exporter-qpg6q\" (UID: \"31bab2e6-2add-4a33-90e8-0d6b9197f81e\") " pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.032919 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.032898 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pc6v\" (UniqueName: \"kubernetes.io/projected/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-api-access-5pc6v\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.058743 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.058716 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qpg6q" Jun 03 03:23:18.067070 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:18.067047 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bab2e6_2add_4a33_90e8_0d6b9197f81e.slice/crio-3b8010321d8f9bb5181bc0809baf73a8a54f684b6c49fcf9bfcd4901581b31d0 WatchSource:0}: Error finding container 3b8010321d8f9bb5181bc0809baf73a8a54f684b6c49fcf9bfcd4901581b31d0: Status 404 returned error can't find the container with id 3b8010321d8f9bb5181bc0809baf73a8a54f684b6c49fcf9bfcd4901581b31d0 Jun 03 03:23:18.424365 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.424275 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:18.426681 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.426662 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2288c22-402c-4bb6-9a41-37b9f698ac35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-cpntn\" (UID: \"b2288c22-402c-4bb6-9a41-37b9f698ac35\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:18.525085 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.525051 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.527350 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.527324 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23f111e1-44ae-4b38-8d1c-0867feec5ecc-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-jgrfd\" (UID: \"23f111e1-44ae-4b38-8d1c-0867feec5ecc\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.632680 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.632645 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" Jun 03 03:23:18.645895 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.645870 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" Jun 03 03:23:18.806408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.806376 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-cpntn"] Jun 03 03:23:18.810605 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:18.810567 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2288c22_402c_4bb6_9a41_37b9f698ac35.slice/crio-409869e50f7c7fb99b832b795bd01186e90cdbd824b9063d820ea0b67f3802eb WatchSource:0}: Error finding container 409869e50f7c7fb99b832b795bd01186e90cdbd824b9063d820ea0b67f3802eb: Status 404 returned error can't find the container with id 409869e50f7c7fb99b832b795bd01186e90cdbd824b9063d820ea0b67f3802eb Jun 03 03:23:18.822139 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.821931 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd"] Jun 03 03:23:18.826402 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:18.826352 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f111e1_44ae_4b38_8d1c_0867feec5ecc.slice/crio-b8b0ccd21856b961d72cec412260409b48646ef48678a45ba1490d4efea26098 WatchSource:0}: Error finding container b8b0ccd21856b961d72cec412260409b48646ef48678a45ba1490d4efea26098: Status 404 returned error can't find the container with id b8b0ccd21856b961d72cec412260409b48646ef48678a45ba1490d4efea26098 Jun 03 03:23:18.933696 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.933620 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" event={"ID":"23f111e1-44ae-4b38-8d1c-0867feec5ecc","Type":"ContainerStarted","Data":"b8b0ccd21856b961d72cec412260409b48646ef48678a45ba1490d4efea26098"} Jun 03 03:23:18.935528 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.935493 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" event={"ID":"b2288c22-402c-4bb6-9a41-37b9f698ac35","Type":"ContainerStarted","Data":"18d409fbc0532ec654984e53ed9fdc28e9f5a6e0d35fb90512b9011cae70c283"} Jun 03 03:23:18.935671 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.935532 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" event={"ID":"b2288c22-402c-4bb6-9a41-37b9f698ac35","Type":"ContainerStarted","Data":"409869e50f7c7fb99b832b795bd01186e90cdbd824b9063d820ea0b67f3802eb"} Jun 03 03:23:18.936992 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:18.936959 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpg6q" event={"ID":"31bab2e6-2add-4a33-90e8-0d6b9197f81e","Type":"ContainerStarted","Data":"3b8010321d8f9bb5181bc0809baf73a8a54f684b6c49fcf9bfcd4901581b31d0"} Jun 03 03:23:19.412103 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:19.412029 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:23:19.942739 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:19.942688 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" event={"ID":"b2288c22-402c-4bb6-9a41-37b9f698ac35","Type":"ContainerStarted","Data":"4d8655cceba6712c753214a47ce9c67ca680a8c53a44649b912d21fba8bbadf0"} Jun 03 03:23:19.944437 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:19.944401 2570 generic.go:358] "Generic (PLEG): container finished" podID="31bab2e6-2add-4a33-90e8-0d6b9197f81e" containerID="980c6e3430e85620417448076d56b355035673036e33a775a360ff31195df43c" exitCode=0 Jun 03 03:23:19.944579 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:19.944516 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpg6q" event={"ID":"31bab2e6-2add-4a33-90e8-0d6b9197f81e","Type":"ContainerDied","Data":"980c6e3430e85620417448076d56b355035673036e33a775a360ff31195df43c"} Jun 03 03:23:20.725233 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.725194 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78dd6d597c-lzrkh"] Jun 03 03:23:20.730043 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.730027 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.733690 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.733671 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 03:23:20.733850 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.733743 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6pdic3ojv85e5\"" Jun 03 03:23:20.734466 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.734446 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 03:23:20.734541 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.734481 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 03:23:20.734610 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.734460 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6hx5b\"" Jun 03 03:23:20.734720 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.734606 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 03:23:20.734879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.734633 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 03:23:20.748043 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748058 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-tls\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748077 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb2f1375-a742-4928-93c1-b3738c69b604-metrics-client-ca\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748103 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-grpc-tls\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqcg\" (UniqueName: \"kubernetes.io/projected/bb2f1375-a742-4928-93c1-b3738c69b604-kube-api-access-xnqcg\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748420 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748159 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.748420 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.748237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.755106 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.755072 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78dd6d597c-lzrkh"] Jun 03 03:23:20.848778 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.848750 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-tls\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.848778 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.848782 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb2f1375-a742-4928-93c1-b3738c69b604-metrics-client-ca\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.848992 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.848818 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-grpc-tls\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.848992 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.848845 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqcg\" (UniqueName: \"kubernetes.io/projected/bb2f1375-a742-4928-93c1-b3738c69b604-kube-api-access-xnqcg\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.849272 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.849248 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.849387 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.849296 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.849595 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.849569 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.850186 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.849808 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.850470 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.850444 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb2f1375-a742-4928-93c1-b3738c69b604-metrics-client-ca\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.851846 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.851820 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-tls\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.852281 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.852238 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.852552 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.852530 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-grpc-tls\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.852862 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.852842 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.853191 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.853170 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.853683 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.853662 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb2f1375-a742-4928-93c1-b3738c69b604-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.863511 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.863483 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqcg\" (UniqueName: \"kubernetes.io/projected/bb2f1375-a742-4928-93c1-b3738c69b604-kube-api-access-xnqcg\") pod \"thanos-querier-78dd6d597c-lzrkh\" (UID: \"bb2f1375-a742-4928-93c1-b3738c69b604\") " pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:20.950357 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.950322 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" event={"ID":"b2288c22-402c-4bb6-9a41-37b9f698ac35","Type":"ContainerStarted","Data":"e1ea10ee5203ef8e390b23a85e2caf3eea20e9bdf30fef4d7dc9aca7042db4ac"} Jun 03 03:23:20.952391 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.952360 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpg6q" event={"ID":"31bab2e6-2add-4a33-90e8-0d6b9197f81e","Type":"ContainerStarted","Data":"9018d9fc97f6c75de37d4dd75b5ae4ab9e8dc7e0dc439962f42c8aba7a58d9ba"} Jun 03 03:23:20.952531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.952394 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpg6q" event={"ID":"31bab2e6-2add-4a33-90e8-0d6b9197f81e","Type":"ContainerStarted","Data":"fd7aacc59aaae11f129889d5aa1418f86f61ea4d79093d2118f977b7c7923d24"} Jun 03 03:23:20.954378 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.954352 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" event={"ID":"23f111e1-44ae-4b38-8d1c-0867feec5ecc","Type":"ContainerStarted","Data":"decae44ba4a135fc462c16053ac5e38dfcebd0ffcbffba6433f407c804056ae2"} Jun 03 03:23:20.954475 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.954386 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" event={"ID":"23f111e1-44ae-4b38-8d1c-0867feec5ecc","Type":"ContainerStarted","Data":"57d7ccc940b1b6f5bc46a5293c153f3f6c3ffac68e4c6b396371c159b1781c8f"} Jun 03 03:23:20.954475 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.954400 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" event={"ID":"23f111e1-44ae-4b38-8d1c-0867feec5ecc","Type":"ContainerStarted","Data":"655a36ec758291f6e4bffecc51d2223b8b510841b8f2aceed110fb3e163aaf6a"} Jun 03 03:23:20.967502 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.966530 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-cpntn" podStartSLOduration=2.6645737350000003 podStartE2EDuration="3.966515405s" podCreationTimestamp="2026-06-03 03:23:17 +0000 UTC" firstStartedPulling="2026-06-03 03:23:19.173678092 +0000 UTC m=+174.335401745" lastFinishedPulling="2026-06-03 03:23:20.475619755 +0000 UTC m=+175.637343415" observedRunningTime="2026-06-03 03:23:20.965287023 +0000 UTC m=+176.127010697" watchObservedRunningTime="2026-06-03 03:23:20.966515405 +0000 UTC m=+176.128239078" Jun 03 03:23:20.981386 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.981306 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-jgrfd" podStartSLOduration=2.337737691 podStartE2EDuration="3.98129426s" podCreationTimestamp="2026-06-03 03:23:17 +0000 UTC" firstStartedPulling="2026-06-03 03:23:18.829172132 +0000 UTC m=+173.990895786" lastFinishedPulling="2026-06-03 03:23:20.472728695 +0000 UTC m=+175.634452355" observedRunningTime="2026-06-03 03:23:20.980412035 +0000 UTC m=+176.142135709" watchObservedRunningTime="2026-06-03 03:23:20.98129426 +0000 UTC m=+176.143017930" Jun 03 03:23:20.996450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:20.996371 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qpg6q" podStartSLOduration=2.913617346 podStartE2EDuration="3.996357177s" podCreationTimestamp="2026-06-03 03:23:17 +0000 UTC" firstStartedPulling="2026-06-03 03:23:18.068756871 +0000 UTC m=+173.230480521" lastFinishedPulling="2026-06-03 03:23:19.1514967 +0000 UTC m=+174.313220352" observedRunningTime="2026-06-03 03:23:20.996163564 +0000 UTC m=+176.157887235" watchObservedRunningTime="2026-06-03 03:23:20.996357177 +0000 UTC m=+176.158080851" Jun 03 03:23:21.043456 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:21.043429 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:21.168734 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:21.168594 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78dd6d597c-lzrkh"] Jun 03 03:23:21.171371 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:21.171345 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2f1375_a742_4928_93c1_b3738c69b604.slice/crio-03d7742367e5dd04fa2c7bec65bbbc379278dea124dae3c60e3796d30ce3af9a WatchSource:0}: Error finding container 03d7742367e5dd04fa2c7bec65bbbc379278dea124dae3c60e3796d30ce3af9a: Status 404 returned error can't find the container with id 03d7742367e5dd04fa2c7bec65bbbc379278dea124dae3c60e3796d30ce3af9a Jun 03 03:23:21.962209 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:21.962165 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"03d7742367e5dd04fa2c7bec65bbbc379278dea124dae3c60e3796d30ce3af9a"} Jun 03 03:23:22.510808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.510777 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh"] Jun 03 03:23:22.513998 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.513976 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:22.516128 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.516103 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 03:23:22.516269 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.516250 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-dvkwp\"" Jun 03 03:23:22.523692 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.523657 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh"] Jun 03 03:23:22.568762 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.568727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dbe4b3a-f1da-4b23-b423-6a98d1d753c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-mdnkh\" (UID: \"8dbe4b3a-f1da-4b23-b423-6a98d1d753c3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:22.669284 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.669244 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dbe4b3a-f1da-4b23-b423-6a98d1d753c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-mdnkh\" (UID: \"8dbe4b3a-f1da-4b23-b423-6a98d1d753c3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:22.669457 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:22.669438 2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 03:23:22.669557 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:22.669537 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dbe4b3a-f1da-4b23-b423-6a98d1d753c3-monitoring-plugin-cert podName:8dbe4b3a-f1da-4b23-b423-6a98d1d753c3 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:23.169516861 +0000 UTC m=+178.331240513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8dbe4b3a-f1da-4b23-b423-6a98d1d753c3-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-mdnkh" (UID: "8dbe4b3a-f1da-4b23-b423-6a98d1d753c3") : secret "monitoring-plugin-cert" not found Jun 03 03:23:22.673978 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.673953 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f8b65789-xprvt"] Jun 03 03:23:22.913435 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:22.913352 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s49xc" Jun 03 03:23:23.173768 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.173681 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dbe4b3a-f1da-4b23-b423-6a98d1d753c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-mdnkh\" (UID: \"8dbe4b3a-f1da-4b23-b423-6a98d1d753c3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:23.176481 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.176447 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dbe4b3a-f1da-4b23-b423-6a98d1d753c3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-mdnkh\" (UID: \"8dbe4b3a-f1da-4b23-b423-6a98d1d753c3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:23.423883 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.423832 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:23.555705 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.555675 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh"] Jun 03 03:23:23.558766 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:23:23.558739 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbe4b3a_f1da_4b23_b423_6a98d1d753c3.slice/crio-2d8b73c9c9dd600ebbbe438283b03d64eaf6f359edf1b289c63ad4712187f551 WatchSource:0}: Error finding container 2d8b73c9c9dd600ebbbe438283b03d64eaf6f359edf1b289c63ad4712187f551: Status 404 returned error can't find the container with id 2d8b73c9c9dd600ebbbe438283b03d64eaf6f359edf1b289c63ad4712187f551 Jun 03 03:23:23.970537 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.970499 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"bbb3692c712a2891451dbba2bea6cb0b0194e8cca3b0ba0b60ba1affd3d07d7c"} Jun 03 03:23:23.970537 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.970543 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"15f5eb0ed37428feea72e2b452c829f6f58f73f193437d42ef40bc0fd7be989a"} Jun 03 03:23:23.970769 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.970556 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"88b5cc7a7f479bfd01114c85b3f063e61970ce4a97833de2b57cab482202bd0d"} Jun 03 03:23:23.971477 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:23.971455 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" event={"ID":"8dbe4b3a-f1da-4b23-b423-6a98d1d753c3","Type":"ContainerStarted","Data":"2d8b73c9c9dd600ebbbe438283b03d64eaf6f359edf1b289c63ad4712187f551"} Jun 03 03:23:24.977669 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:24.977618 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"7563dcbe15fe03e903e7b1f79707605ef94d2e5ef0c56fb3ce7eabae5979e01f"} Jun 03 03:23:24.977669 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:24.977674 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"35277ba3a80154b54f1cc3e343b056d7da4f2f64d2a7f65e3adab00704c4543b"} Jun 03 03:23:24.978147 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:24.977690 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" event={"ID":"bb2f1375-a742-4928-93c1-b3738c69b604","Type":"ContainerStarted","Data":"0a4e1d81ae83c3342bcc3dff3d424c4011f5384d64cb89e5ca31aba50300f57b"} Jun 03 03:23:24.978147 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:24.977803 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:24.998051 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:24.997978 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" podStartSLOduration=1.753490229 podStartE2EDuration="4.99796197s" podCreationTimestamp="2026-06-03 03:23:20 +0000 UTC" firstStartedPulling="2026-06-03 03:23:21.173183877 +0000 UTC m=+176.334907529" lastFinishedPulling="2026-06-03 03:23:24.417655614 +0000 UTC m=+179.579379270" observedRunningTime="2026-06-03 03:23:24.996467028 +0000 UTC m=+180.158190710" watchObservedRunningTime="2026-06-03 03:23:24.99796197 +0000 UTC m=+180.159685642" Jun 03 03:23:25.769952 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:25.769922 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:25.981486 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:25.981443 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" event={"ID":"8dbe4b3a-f1da-4b23-b423-6a98d1d753c3","Type":"ContainerStarted","Data":"e334a71cf10314147e37267274c896acb24051cdb4d0ef84aec8858045c73013"} Jun 03 03:23:25.981926 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:25.981623 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:25.986238 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:25.986186 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" Jun 03 03:23:25.995106 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:25.995066 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-mdnkh" podStartSLOduration=2.530192337 podStartE2EDuration="3.995054747s" podCreationTimestamp="2026-06-03 03:23:22 +0000 UTC" firstStartedPulling="2026-06-03 03:23:23.560628322 +0000 UTC m=+178.722351972" lastFinishedPulling="2026-06-03 03:23:25.02549073 +0000 UTC m=+180.187214382" observedRunningTime="2026-06-03 03:23:25.994628206 +0000 UTC m=+181.156351876" watchObservedRunningTime="2026-06-03 03:23:25.995054747 +0000 UTC m=+181.156778415" Jun 03 03:23:30.988001 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:30.987975 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78dd6d597c-lzrkh" Jun 03 03:23:32.135851 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.135786 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" podUID="e3814b96-d22e-48ad-b1f0-be1a7de7009b" containerName="registry" containerID="cri-o://b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16" gracePeriod=30 Jun 03 03:23:32.387518 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.387456 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:23:32.458964 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.458933 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-bound-sa-token\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.458964 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.458977 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-certificates\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459241 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459025 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-image-registry-private-configuration\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459241 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459055 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459241 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459089 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-installation-pull-secrets\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459241 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459113 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-trusted-ca\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459415 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459276 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3814b96-d22e-48ad-b1f0-be1a7de7009b-ca-trust-extracted\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459415 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459345 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2swc\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-kube-api-access-s2swc\") pod \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\" (UID: \"e3814b96-d22e-48ad-b1f0-be1a7de7009b\") " Jun 03 03:23:32.459499 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459471 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:32.459797 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459771 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:32.459797 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.459783 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-certificates\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.461723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.461688 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-kube-api-access-s2swc" (OuterVolumeSpecName: "kube-api-access-s2swc") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "kube-api-access-s2swc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:32.461823 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.461773 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:32.461907 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.461888 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:32.461950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.461903 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:32.461950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.461915 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:32.467918 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.467896 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3814b96-d22e-48ad-b1f0-be1a7de7009b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e3814b96-d22e-48ad-b1f0-be1a7de7009b" (UID: "e3814b96-d22e-48ad-b1f0-be1a7de7009b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:23:32.561130 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561096 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-installation-pull-secrets\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.561130 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561127 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3814b96-d22e-48ad-b1f0-be1a7de7009b-trusted-ca\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.561130 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561136 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3814b96-d22e-48ad-b1f0-be1a7de7009b-ca-trust-extracted\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.561378 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561145 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2swc\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-kube-api-access-s2swc\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.561378 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561154 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-bound-sa-token\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.561378 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561165 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3814b96-d22e-48ad-b1f0-be1a7de7009b-image-registry-private-configuration\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:32.561378 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:32.561175 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3814b96-d22e-48ad-b1f0-be1a7de7009b-registry-tls\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:33.002108 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.002077 2570 generic.go:358] "Generic (PLEG): container finished" podID="e3814b96-d22e-48ad-b1f0-be1a7de7009b" containerID="b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16" exitCode=0 Jun 03 03:23:33.002375 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.002133 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" Jun 03 03:23:33.002375 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.002154 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" event={"ID":"e3814b96-d22e-48ad-b1f0-be1a7de7009b","Type":"ContainerDied","Data":"b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16"} Jun 03 03:23:33.002375 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.002185 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc58fbf75-dbmv2" event={"ID":"e3814b96-d22e-48ad-b1f0-be1a7de7009b","Type":"ContainerDied","Data":"e124168c24e3173552b205b2b3f5f2bcb9ae0034a8ca3660812dd7c05e1febca"} Jun 03 03:23:33.002375 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.002202 2570 scope.go:117] "RemoveContainer" containerID="b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16" Jun 03 03:23:33.013116 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.013095 2570 scope.go:117] "RemoveContainer" containerID="b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16" Jun 03 03:23:33.013502 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:33.013476 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16\": container with ID starting with b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16 not found: ID does not exist" containerID="b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16" Jun 03 03:23:33.013589 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.013511 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16"} err="failed to get container status \"b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16\": rpc error: code = NotFound desc = could not find container \"b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16\": container with ID starting with b3969be2a0e6e450fb9a8e4415c58ad736b1ad6af70d354d5c07b7a4a8359e16 not found: ID does not exist" Jun 03 03:23:33.022112 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.022086 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bc58fbf75-dbmv2"] Jun 03 03:23:33.023926 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.023905 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bc58fbf75-dbmv2"] Jun 03 03:23:33.415873 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.415797 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3814b96-d22e-48ad-b1f0-be1a7de7009b" path="/var/lib/kubelet/pods/e3814b96-d22e-48ad-b1f0-be1a7de7009b/volumes" Jun 03 03:23:33.977530 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:33.977498 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f846bd64f-82cxh"] Jun 03 03:23:47.697587 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:47.697525 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79f8b65789-xprvt" podUID="83206ae8-a917-450b-a7be-c505d7e9a40a" containerName="console" containerID="cri-o://7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7" gracePeriod=15 Jun 03 03:23:47.936918 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:47.936896 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f8b65789-xprvt_83206ae8-a917-450b-a7be-c505d7e9a40a/console/0.log" Jun 03 03:23:47.937030 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:47.936955 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:48.048361 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.048285 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f8b65789-xprvt_83206ae8-a917-450b-a7be-c505d7e9a40a/console/0.log" Jun 03 03:23:48.048361 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.048318 2570 generic.go:358] "Generic (PLEG): container finished" podID="83206ae8-a917-450b-a7be-c505d7e9a40a" containerID="7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7" exitCode=2 Jun 03 03:23:48.048529 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.048386 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8b65789-xprvt" Jun 03 03:23:48.048529 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.048408 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8b65789-xprvt" event={"ID":"83206ae8-a917-450b-a7be-c505d7e9a40a","Type":"ContainerDied","Data":"7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7"} Jun 03 03:23:48.048529 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.048446 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8b65789-xprvt" event={"ID":"83206ae8-a917-450b-a7be-c505d7e9a40a","Type":"ContainerDied","Data":"2d5f858b34794a536c19eeef1b9188c5c275edfff0273ef18a4cae224a04f152"} Jun 03 03:23:48.048529 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.048463 2570 scope.go:117] "RemoveContainer" containerID="7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7" Jun 03 03:23:48.056129 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.056115 2570 scope.go:117] "RemoveContainer" containerID="7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7" Jun 03 03:23:48.056376 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:23:48.056356 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7\": container with ID starting with 7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7 not found: ID does not exist" containerID="7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7" Jun 03 03:23:48.056441 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.056383 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7"} err="failed to get container status \"7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7\": rpc error: code = NotFound desc = could not find container \"7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7\": container with ID starting with 7c6fc31f50c6c551460956b28a1b9a40dab45b972052661bd789a487b27ac0d7 not found: ID does not exist" Jun 03 03:23:48.086158 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086135 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-console-config\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086243 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086163 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-oauth-serving-cert\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086243 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086193 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-serving-cert\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086308 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086265 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xpqc\" (UniqueName: \"kubernetes.io/projected/83206ae8-a917-450b-a7be-c505d7e9a40a-kube-api-access-8xpqc\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086341 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086321 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-oauth-config\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086388 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086373 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-trusted-ca-bundle\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086538 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086507 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-service-ca\") pod \"83206ae8-a917-450b-a7be-c505d7e9a40a\" (UID: \"83206ae8-a917-450b-a7be-c505d7e9a40a\") " Jun 03 03:23:48.086674 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086607 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:48.086674 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086613 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-console-config" (OuterVolumeSpecName: "console-config") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:48.086823 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086706 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:48.086883 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086856 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-trusted-ca-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.086883 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086876 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-console-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.086976 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086888 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-oauth-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.086976 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.086917 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-service-ca" (OuterVolumeSpecName: "service-ca") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:48.088527 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.088499 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:48.088814 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.088785 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:48.088814 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.088796 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83206ae8-a917-450b-a7be-c505d7e9a40a-kube-api-access-8xpqc" (OuterVolumeSpecName: "kube-api-access-8xpqc") pod "83206ae8-a917-450b-a7be-c505d7e9a40a" (UID: "83206ae8-a917-450b-a7be-c505d7e9a40a"). InnerVolumeSpecName "kube-api-access-8xpqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:48.187292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.187250 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xpqc\" (UniqueName: \"kubernetes.io/projected/83206ae8-a917-450b-a7be-c505d7e9a40a-kube-api-access-8xpqc\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.187292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.187286 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-oauth-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.187292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.187297 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83206ae8-a917-450b-a7be-c505d7e9a40a-service-ca\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.187292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.187305 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83206ae8-a917-450b-a7be-c505d7e9a40a-console-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:48.366953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.366925 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f8b65789-xprvt"] Jun 03 03:23:48.371027 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:48.371006 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79f8b65789-xprvt"] Jun 03 03:23:49.417097 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:49.417063 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83206ae8-a917-450b-a7be-c505d7e9a40a" path="/var/lib/kubelet/pods/83206ae8-a917-450b-a7be-c505d7e9a40a/volumes" Jun 03 03:23:53.886595 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:53.886566 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2w2h_09234263-e48e-4dee-9de1-f9c3e2aa34fd/serve-healthcheck-canary/0.log" Jun 03 03:23:59.001117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.001074 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f846bd64f-82cxh" podUID="299b62fe-45cf-4b4a-ab12-465b2c033925" containerName="console" containerID="cri-o://48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510" gracePeriod=15 Jun 03 03:23:59.237002 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.236983 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f846bd64f-82cxh_299b62fe-45cf-4b4a-ab12-465b2c033925/console/0.log" Jun 03 03:23:59.237111 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.237040 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:23:59.372884 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.372813 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-serving-cert\") pod \"299b62fe-45cf-4b4a-ab12-465b2c033925\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " Jun 03 03:23:59.372884 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.372850 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-service-ca\") pod \"299b62fe-45cf-4b4a-ab12-465b2c033925\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " Jun 03 03:23:59.373090 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.372892 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-oauth-serving-cert\") pod \"299b62fe-45cf-4b4a-ab12-465b2c033925\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " Jun 03 03:23:59.373090 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373000 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-oauth-config\") pod \"299b62fe-45cf-4b4a-ab12-465b2c033925\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " Jun 03 03:23:59.373090 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373053 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6775\" (UniqueName: \"kubernetes.io/projected/299b62fe-45cf-4b4a-ab12-465b2c033925-kube-api-access-c6775\") pod \"299b62fe-45cf-4b4a-ab12-465b2c033925\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " Jun 03 03:23:59.373291 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373095 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-console-config\") pod \"299b62fe-45cf-4b4a-ab12-465b2c033925\" (UID: \"299b62fe-45cf-4b4a-ab12-465b2c033925\") " Jun 03 03:23:59.373291 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373278 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "299b62fe-45cf-4b4a-ab12-465b2c033925" (UID: "299b62fe-45cf-4b4a-ab12-465b2c033925"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:59.373409 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373286 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-service-ca" (OuterVolumeSpecName: "service-ca") pod "299b62fe-45cf-4b4a-ab12-465b2c033925" (UID: "299b62fe-45cf-4b4a-ab12-465b2c033925"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:59.373409 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373374 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-service-ca\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:59.373409 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373386 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-oauth-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:59.373589 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.373567 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-console-config" (OuterVolumeSpecName: "console-config") pod "299b62fe-45cf-4b4a-ab12-465b2c033925" (UID: "299b62fe-45cf-4b4a-ab12-465b2c033925"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:59.374973 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.374950 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "299b62fe-45cf-4b4a-ab12-465b2c033925" (UID: "299b62fe-45cf-4b4a-ab12-465b2c033925"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:59.375074 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.375048 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "299b62fe-45cf-4b4a-ab12-465b2c033925" (UID: "299b62fe-45cf-4b4a-ab12-465b2c033925"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:59.375117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.375087 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299b62fe-45cf-4b4a-ab12-465b2c033925-kube-api-access-c6775" (OuterVolumeSpecName: "kube-api-access-c6775") pod "299b62fe-45cf-4b4a-ab12-465b2c033925" (UID: "299b62fe-45cf-4b4a-ab12-465b2c033925"). InnerVolumeSpecName "kube-api-access-c6775". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:59.474078 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.474049 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:59.474078 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.474074 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/299b62fe-45cf-4b4a-ab12-465b2c033925-console-oauth-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:59.474213 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.474088 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6775\" (UniqueName: \"kubernetes.io/projected/299b62fe-45cf-4b4a-ab12-465b2c033925-kube-api-access-c6775\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:23:59.474213 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:23:59.474101 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/299b62fe-45cf-4b4a-ab12-465b2c033925-console-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:24:00.088074 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.088045 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f846bd64f-82cxh_299b62fe-45cf-4b4a-ab12-465b2c033925/console/0.log" Jun 03 03:24:00.088542 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.088089 2570 generic.go:358] "Generic (PLEG): container finished" podID="299b62fe-45cf-4b4a-ab12-465b2c033925" containerID="48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510" exitCode=2 Jun 03 03:24:00.088542 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.088122 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f846bd64f-82cxh" event={"ID":"299b62fe-45cf-4b4a-ab12-465b2c033925","Type":"ContainerDied","Data":"48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510"} Jun 03 03:24:00.088542 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.088149 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f846bd64f-82cxh" Jun 03 03:24:00.088542 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.088162 2570 scope.go:117] "RemoveContainer" containerID="48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510" Jun 03 03:24:00.088542 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.088149 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f846bd64f-82cxh" event={"ID":"299b62fe-45cf-4b4a-ab12-465b2c033925","Type":"ContainerDied","Data":"f981f8df2713dfb07bbac9366aeeae137e9a1a4ccf0e34a5a608f4f84bdcd582"} Jun 03 03:24:00.096036 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.096017 2570 scope.go:117] "RemoveContainer" containerID="48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510" Jun 03 03:24:00.096298 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:24:00.096279 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510\": container with ID starting with 48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510 not found: ID does not exist" containerID="48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510" Jun 03 03:24:00.096353 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.096314 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510"} err="failed to get container status \"48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510\": rpc error: code = NotFound desc = could not find container \"48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510\": container with ID starting with 48cbb9c8ce030ea0243c48152406e66d301b552d804040a29c9c7ed08e561510 not found: ID does not exist" Jun 03 03:24:00.103012 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.102990 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f846bd64f-82cxh"] Jun 03 03:24:00.107135 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:00.107114 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f846bd64f-82cxh"] Jun 03 03:24:01.091694 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:01.091662 2570 generic.go:358] "Generic (PLEG): container finished" podID="e6f21a41-add6-4434-8d54-99a932c768ea" containerID="a64de388e1252528f1ada0b6d8f6ae20758a50f46e7a2cf2fda6f0e040777330" exitCode=0 Jun 03 03:24:01.092134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:01.091739 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" event={"ID":"e6f21a41-add6-4434-8d54-99a932c768ea","Type":"ContainerDied","Data":"a64de388e1252528f1ada0b6d8f6ae20758a50f46e7a2cf2fda6f0e040777330"} Jun 03 03:24:01.092134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:01.092107 2570 scope.go:117] "RemoveContainer" containerID="a64de388e1252528f1ada0b6d8f6ae20758a50f46e7a2cf2fda6f0e040777330" Jun 03 03:24:01.415890 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:01.415849 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299b62fe-45cf-4b4a-ab12-465b2c033925" path="/var/lib/kubelet/pods/299b62fe-45cf-4b4a-ab12-465b2c033925/volumes" Jun 03 03:24:02.096796 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:02.096755 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-742kz" event={"ID":"e6f21a41-add6-4434-8d54-99a932c768ea","Type":"ContainerStarted","Data":"814d6448885aff5640a771be08a647f4fec843c63313ccfda510fd1d183e94fb"} Jun 03 03:24:37.250701 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:37.250661 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:24:37.252882 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:37.252859 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5333f73-4353-4f94-93ef-4137cf3b76e0-metrics-certs\") pod \"network-metrics-daemon-pfx99\" (UID: \"f5333f73-4353-4f94-93ef-4137cf3b76e0\") " pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:24:37.416198 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:37.416174 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwf2t\"" Jun 03 03:24:37.423999 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:37.423981 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pfx99" Jun 03 03:24:37.545347 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:37.545317 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pfx99"] Jun 03 03:24:37.548424 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:24:37.548395 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5333f73_4353_4f94_93ef_4137cf3b76e0.slice/crio-d02be145dc5e7ca7392859632509f543de95b9b4adec5a0aa0693ed85b7ea896 WatchSource:0}: Error finding container d02be145dc5e7ca7392859632509f543de95b9b4adec5a0aa0693ed85b7ea896: Status 404 returned error can't find the container with id d02be145dc5e7ca7392859632509f543de95b9b4adec5a0aa0693ed85b7ea896 Jun 03 03:24:38.197817 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:38.197784 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pfx99" event={"ID":"f5333f73-4353-4f94-93ef-4137cf3b76e0","Type":"ContainerStarted","Data":"d02be145dc5e7ca7392859632509f543de95b9b4adec5a0aa0693ed85b7ea896"} Jun 03 03:24:39.202369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:39.202331 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pfx99" event={"ID":"f5333f73-4353-4f94-93ef-4137cf3b76e0","Type":"ContainerStarted","Data":"d57547e1cff014f6fe00bfdcc004325108065865f88d99f693d2e1642e778249"} Jun 03 03:24:39.202369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:39.202361 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pfx99" event={"ID":"f5333f73-4353-4f94-93ef-4137cf3b76e0","Type":"ContainerStarted","Data":"ab32c98eecdfbb3e5b0dff14182fd74f490fd9558a8afb07724130ba65b12a23"} Jun 03 03:24:39.215642 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:39.215584 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pfx99" podStartSLOduration=253.271756381 podStartE2EDuration="4m14.215570989s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:24:37.550299252 +0000 UTC m=+252.712022901" lastFinishedPulling="2026-06-03 03:24:38.494113852 +0000 UTC m=+253.655837509" observedRunningTime="2026-06-03 03:24:39.215369804 +0000 UTC m=+254.377093490" watchObservedRunningTime="2026-06-03 03:24:39.215570989 +0000 UTC m=+254.377294661" Jun 03 03:24:40.227126 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227088 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:24:40.227550 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227534 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83206ae8-a917-450b-a7be-c505d7e9a40a" containerName="console" Jun 03 03:24:40.227604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227553 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="83206ae8-a917-450b-a7be-c505d7e9a40a" containerName="console" Jun 03 03:24:40.227604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227565 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299b62fe-45cf-4b4a-ab12-465b2c033925" containerName="console" Jun 03 03:24:40.227604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227570 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="299b62fe-45cf-4b4a-ab12-465b2c033925" containerName="console" Jun 03 03:24:40.227604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227578 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3814b96-d22e-48ad-b1f0-be1a7de7009b" containerName="registry" Jun 03 03:24:40.227604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227584 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3814b96-d22e-48ad-b1f0-be1a7de7009b" containerName="registry" Jun 03 03:24:40.227748 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227632 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="83206ae8-a917-450b-a7be-c505d7e9a40a" containerName="console" Jun 03 03:24:40.227748 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227641 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3814b96-d22e-48ad-b1f0-be1a7de7009b" containerName="registry" Jun 03 03:24:40.227748 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.227650 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="299b62fe-45cf-4b4a-ab12-465b2c033925" containerName="console" Jun 03 03:24:40.231019 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.231001 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.233379 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233356 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 03:24:40.233487 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233382 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 03:24:40.233487 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233385 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 03:24:40.233487 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233356 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 03:24:40.233487 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233475 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 03:24:40.233668 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233537 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4qqf8\"" Jun 03 03:24:40.233668 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233577 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 03:24:40.233880 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233865 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 03:24:40.233921 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.233871 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 03:24:40.239334 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.239311 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 03:24:40.240424 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.240405 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:24:40.275382 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275382 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275381 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275502 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275398 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275502 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275425 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275502 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275476 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-web-config\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275650 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275634 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnxnq\" (UniqueName: \"kubernetes.io/projected/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-kube-api-access-lnxnq\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275696 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275739 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275775 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-config-out\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275775 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275841 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275783 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275841 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275804 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.275913 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.275860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.376786 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.376729 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.376786 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.376789 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.376948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.376815 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.376948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.376843 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.376948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.376866 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377099 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.376980 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377099 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377021 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-web-config\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377099 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377064 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnxnq\" (UniqueName: \"kubernetes.io/projected/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-kube-api-access-lnxnq\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377097 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377163 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377194 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-config-out\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377249 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377260 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.377279 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.377272 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.378966 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.378150 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.378966 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.378627 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.379963 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.379941 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.380061 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.379982 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.380061 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.379991 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.380180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.380118 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.380541 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.380512 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-config-out\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.380797 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.380772 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.380966 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.380945 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.381168 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.381152 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.381881 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.381867 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-web-config\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.384103 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.384082 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnxnq\" (UniqueName: \"kubernetes.io/projected/6bc7f50f-f97c-40ea-b770-1b78cefd7fb7-kube-api-access-lnxnq\") pod \"alertmanager-main-0\" (UID: \"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.542296 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.542231 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 03:24:40.671742 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:40.671718 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 03:24:40.673310 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:24:40.673280 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc7f50f_f97c_40ea_b770_1b78cefd7fb7.slice/crio-f0314ccde2b312d8136725381406ee844e3ae983b2751176779eb7610577251f WatchSource:0}: Error finding container f0314ccde2b312d8136725381406ee844e3ae983b2751176779eb7610577251f: Status 404 returned error can't find the container with id f0314ccde2b312d8136725381406ee844e3ae983b2751176779eb7610577251f Jun 03 03:24:41.209547 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.209465 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"f0314ccde2b312d8136725381406ee844e3ae983b2751176779eb7610577251f"} Jun 03 03:24:41.970200 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.970161 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86f447b5b9-gsnjd"] Jun 03 03:24:41.973721 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.973694 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:41.976362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.976339 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 03:24:41.976362 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.976351 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 03:24:41.976623 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.976606 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 03:24:41.976686 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.976646 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 03:24:41.976686 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.976673 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qd25r\"" Jun 03 03:24:41.976787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.976727 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 03:24:41.982116 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.982053 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 03:24:41.983712 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:41.983670 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86f447b5b9-gsnjd"] Jun 03 03:24:42.091283 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-metrics-client-ca\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091459 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091310 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-federate-client-tls\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091459 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091357 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvk6n\" (UniqueName: \"kubernetes.io/projected/f867b483-1acb-466e-a376-9c2ef8ec0dfb-kube-api-access-nvk6n\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091459 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091576 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-serving-certs-ca-bundle\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091576 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-telemeter-client-tls\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091576 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-secret-telemeter-client\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.091682 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.091586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.192739 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192706 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-metrics-client-ca\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.192909 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192747 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-federate-client-tls\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.192909 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192768 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvk6n\" (UniqueName: \"kubernetes.io/projected/f867b483-1acb-466e-a376-9c2ef8ec0dfb-kube-api-access-nvk6n\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.192909 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192790 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192905 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-serving-certs-ca-bundle\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192946 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-telemeter-client-tls\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.192977 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-secret-telemeter-client\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.193040 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193701 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.193651 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-metrics-client-ca\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193819 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.193716 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-serving-certs-ca-bundle\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.193960 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.193941 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f867b483-1acb-466e-a376-9c2ef8ec0dfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.195860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.195838 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.195945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.195843 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-federate-client-tls\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.195945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.195846 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-secret-telemeter-client\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.195945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.195899 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f867b483-1acb-466e-a376-9c2ef8ec0dfb-telemeter-client-tls\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.199828 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.199807 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvk6n\" (UniqueName: \"kubernetes.io/projected/f867b483-1acb-466e-a376-9c2ef8ec0dfb-kube-api-access-nvk6n\") pod \"telemeter-client-86f447b5b9-gsnjd\" (UID: \"f867b483-1acb-466e-a376-9c2ef8ec0dfb\") " pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.214061 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.214040 2570 generic.go:358] "Generic (PLEG): container finished" podID="6bc7f50f-f97c-40ea-b770-1b78cefd7fb7" containerID="d21ee37b24dc1660f94fea3ce558a223ea0d4233589e17efd5597c4191806c9e" exitCode=0 Jun 03 03:24:42.214158 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.214120 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerDied","Data":"d21ee37b24dc1660f94fea3ce558a223ea0d4233589e17efd5597c4191806c9e"} Jun 03 03:24:42.286774 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.286345 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" Jun 03 03:24:42.422761 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:42.422728 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86f447b5b9-gsnjd"] Jun 03 03:24:43.217505 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:43.217461 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" event={"ID":"f867b483-1acb-466e-a376-9c2ef8ec0dfb","Type":"ContainerStarted","Data":"1f66ff776af9052f2ff61579cf7e60b4cda5acccd4adc1861fc469debc25096f"} Jun 03 03:24:44.223558 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.223530 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"065031a3524b3e8ac91675348027bcbfc98c20d2027535cfa7c96fc50d9cc9cd"} Jun 03 03:24:44.223558 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.223561 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"790b17032db3673dfc5e5b7bdf1d05e1b63bc18a35c6bc62a1673e307c778936"} Jun 03 03:24:44.224058 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.223573 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"587a933deab821aebc91e2e360af1fc64f9c2ab5d14f9a4cb45add101abd550f"} Jun 03 03:24:44.224058 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.223583 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"7f5b88018ff18824fd5b66bcd863a9a41e53e4b39789a827c956a7331dd24685"} Jun 03 03:24:44.224058 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.223590 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"fec517b8050a56f62de8cbb5252c384ee4a6a5f3953227ad648f792ba0282cdf"} Jun 03 03:24:44.224058 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.223598 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bc7f50f-f97c-40ea-b770-1b78cefd7fb7","Type":"ContainerStarted","Data":"4c93f129f9769622b52f8066415e716631ebdbb2175a8301240fed66fa514c87"} Jun 03 03:24:44.247483 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:44.247431 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.288529649 podStartE2EDuration="4.247418588s" podCreationTimestamp="2026-06-03 03:24:40 +0000 UTC" firstStartedPulling="2026-06-03 03:24:40.675235847 +0000 UTC m=+255.836959510" lastFinishedPulling="2026-06-03 03:24:43.634124786 +0000 UTC m=+258.795848449" observedRunningTime="2026-06-03 03:24:44.24677292 +0000 UTC m=+259.408496628" watchObservedRunningTime="2026-06-03 03:24:44.247418588 +0000 UTC m=+259.409142272" Jun 03 03:24:45.228464 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:45.228426 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" event={"ID":"f867b483-1acb-466e-a376-9c2ef8ec0dfb","Type":"ContainerStarted","Data":"544f142538be35f672d4850b208ef13634b514c3891e2e012a294e7d9d50a49b"} Jun 03 03:24:45.228464 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:45.228465 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" event={"ID":"f867b483-1acb-466e-a376-9c2ef8ec0dfb","Type":"ContainerStarted","Data":"30c1cd0c3a401bb32d399dca4b001977feaa39983630a784cb347bd355fa126f"} Jun 03 03:24:45.228884 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:45.228474 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" event={"ID":"f867b483-1acb-466e-a376-9c2ef8ec0dfb","Type":"ContainerStarted","Data":"340edcf9953908956f64cd8379ed2902b240c3e71ea1961ddf20963f667a9284"} Jun 03 03:24:45.248393 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:45.248348 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86f447b5b9-gsnjd" podStartSLOduration=1.9050648890000002 podStartE2EDuration="4.248334437s" podCreationTimestamp="2026-06-03 03:24:41 +0000 UTC" firstStartedPulling="2026-06-03 03:24:42.426629318 +0000 UTC m=+257.588352973" lastFinishedPulling="2026-06-03 03:24:44.769898855 +0000 UTC m=+259.931622521" observedRunningTime="2026-06-03 03:24:45.24741613 +0000 UTC m=+260.409139801" watchObservedRunningTime="2026-06-03 03:24:45.248334437 +0000 UTC m=+260.410058109" Jun 03 03:24:46.377466 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.377433 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-566f756998-ch96j"] Jun 03 03:24:46.380787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.380767 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.383960 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.383933 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 03:24:46.384069 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.383976 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 03:24:46.384069 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.383996 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 03:24:46.384069 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.383976 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 03:24:46.384308 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.384291 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 03:24:46.384411 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.384294 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 03:24:46.384411 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.384342 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9rp5v\"" Jun 03 03:24:46.384411 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.384328 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 03:24:46.388110 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.388085 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 03:24:46.391156 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.391128 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566f756998-ch96j"] Jun 03 03:24:46.432854 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.432825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-console-config\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.433020 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.432885 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-oauth-config\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.433020 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.432936 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-oauth-serving-cert\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.433134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.433014 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-service-ca\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.433134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.433042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-serving-cert\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.433134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.433068 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7cg\" (UniqueName: \"kubernetes.io/projected/989668be-9b23-402b-a7b3-b80ee779a218-kube-api-access-sb7cg\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.433134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.433112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-trusted-ca-bundle\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534464 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534420 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-trusted-ca-bundle\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534641 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534482 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-console-config\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534641 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534550 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-oauth-config\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534641 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534583 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-oauth-serving-cert\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534641 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534619 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-service-ca\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534884 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534649 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-serving-cert\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.534884 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.534672 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7cg\" (UniqueName: \"kubernetes.io/projected/989668be-9b23-402b-a7b3-b80ee779a218-kube-api-access-sb7cg\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.535380 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.535356 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-console-config\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.535479 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.535410 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-trusted-ca-bundle\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.535669 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.535645 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-oauth-serving-cert\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.535719 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.535669 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-service-ca\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.537156 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.537138 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-oauth-config\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.537283 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.537267 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-serving-cert\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.545087 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.545063 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7cg\" (UniqueName: \"kubernetes.io/projected/989668be-9b23-402b-a7b3-b80ee779a218-kube-api-access-sb7cg\") pod \"console-566f756998-ch96j\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.692312 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.692274 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:46.816233 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:46.816192 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566f756998-ch96j"] Jun 03 03:24:46.820039 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:24:46.820010 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989668be_9b23_402b_a7b3_b80ee779a218.slice/crio-4c0fd61c665eb96d6c1dc479ab7cd307075e3154b9caf074a0ea48a6c58d6107 WatchSource:0}: Error finding container 4c0fd61c665eb96d6c1dc479ab7cd307075e3154b9caf074a0ea48a6c58d6107: Status 404 returned error can't find the container with id 4c0fd61c665eb96d6c1dc479ab7cd307075e3154b9caf074a0ea48a6c58d6107 Jun 03 03:24:47.236719 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:47.236690 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f756998-ch96j" event={"ID":"989668be-9b23-402b-a7b3-b80ee779a218","Type":"ContainerStarted","Data":"352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8"} Jun 03 03:24:47.236719 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:47.236723 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f756998-ch96j" event={"ID":"989668be-9b23-402b-a7b3-b80ee779a218","Type":"ContainerStarted","Data":"4c0fd61c665eb96d6c1dc479ab7cd307075e3154b9caf074a0ea48a6c58d6107"} Jun 03 03:24:47.253457 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:47.253405 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-566f756998-ch96j" podStartSLOduration=1.253390123 podStartE2EDuration="1.253390123s" podCreationTimestamp="2026-06-03 03:24:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:24:47.25244556 +0000 UTC m=+262.414169231" watchObservedRunningTime="2026-06-03 03:24:47.253390123 +0000 UTC m=+262.415113791" Jun 03 03:24:56.692632 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:56.692587 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:56.692632 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:56.692638 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:56.698365 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:56.698342 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:24:57.267022 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:24:57.266996 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:25:25.342810 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:25:25.342779 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:25:25.343433 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:25:25.343042 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:25:25.347976 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:25:25.347956 2570 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 03:26:01.159103 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.159068 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-694f7494f6-76gdl"] Jun 03 03:26:01.161606 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.161587 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.170839 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.170812 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694f7494f6-76gdl"] Jun 03 03:26:01.342926 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.342884 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-oauth-config\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.343117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.342938 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-trusted-ca-bundle\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.343117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.343019 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-serving-cert\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.343117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.343047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-console-config\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.343117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.343063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-service-ca\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.343117 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.343089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6q7\" (UniqueName: \"kubernetes.io/projected/ffd8ecff-7798-4876-b912-599b51bf661a-kube-api-access-5z6q7\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.343387 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.343212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-oauth-serving-cert\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.443847 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.443814 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-oauth-config\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444035 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.443859 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-trusted-ca-bundle\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444035 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.443883 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-serving-cert\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444035 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.443898 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-console-config\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444035 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.443913 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-service-ca\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444035 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.443944 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6q7\" (UniqueName: \"kubernetes.io/projected/ffd8ecff-7798-4876-b912-599b51bf661a-kube-api-access-5z6q7\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444035 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.444016 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-oauth-serving-cert\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.444856 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.444829 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-console-config\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.445052 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.444835 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-oauth-serving-cert\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.445052 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.444835 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-service-ca\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.445184 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.445094 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-trusted-ca-bundle\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.446504 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.446485 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-oauth-config\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.446601 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.446583 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-serving-cert\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.451010 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.450987 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6q7\" (UniqueName: \"kubernetes.io/projected/ffd8ecff-7798-4876-b912-599b51bf661a-kube-api-access-5z6q7\") pod \"console-694f7494f6-76gdl\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.471039 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.471018 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:01.595556 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.595528 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694f7494f6-76gdl"] Jun 03 03:26:01.597406 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:26:01.597377 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd8ecff_7798_4876_b912_599b51bf661a.slice/crio-692c6fe3a71af0998faf26bca08ae2639ce3a0e2fd4a3b2816ef8401a9e45275 WatchSource:0}: Error finding container 692c6fe3a71af0998faf26bca08ae2639ce3a0e2fd4a3b2816ef8401a9e45275: Status 404 returned error can't find the container with id 692c6fe3a71af0998faf26bca08ae2639ce3a0e2fd4a3b2816ef8401a9e45275 Jun 03 03:26:01.599120 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:01.599105 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:26:02.451158 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:02.451120 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694f7494f6-76gdl" event={"ID":"ffd8ecff-7798-4876-b912-599b51bf661a","Type":"ContainerStarted","Data":"042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028"} Jun 03 03:26:02.451158 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:02.451154 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694f7494f6-76gdl" event={"ID":"ffd8ecff-7798-4876-b912-599b51bf661a","Type":"ContainerStarted","Data":"692c6fe3a71af0998faf26bca08ae2639ce3a0e2fd4a3b2816ef8401a9e45275"} Jun 03 03:26:02.467545 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:02.467491 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-694f7494f6-76gdl" podStartSLOduration=1.4674751289999999 podStartE2EDuration="1.467475129s" podCreationTimestamp="2026-06-03 03:26:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:26:02.466157355 +0000 UTC m=+337.627881030" watchObservedRunningTime="2026-06-03 03:26:02.467475129 +0000 UTC m=+337.629198800" Jun 03 03:26:11.471384 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:11.471346 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:11.471384 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:11.471391 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:11.476211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:11.476190 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:11.481729 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:11.481709 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:26:11.523322 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:11.523294 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566f756998-ch96j"] Jun 03 03:26:24.125720 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.125640 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t48t8"] Jun 03 03:26:24.128233 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.128200 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.130492 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.130474 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 03:26:24.133645 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.133620 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t48t8"] Jun 03 03:26:24.225874 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.225838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be38fff6-97ae-43c5-b599-f90cc9c55145-dbus\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.226051 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.225885 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be38fff6-97ae-43c5-b599-f90cc9c55145-kubelet-config\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.226051 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.225956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be38fff6-97ae-43c5-b599-f90cc9c55145-original-pull-secret\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.327070 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.327040 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be38fff6-97ae-43c5-b599-f90cc9c55145-original-pull-secret\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.327254 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.327106 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be38fff6-97ae-43c5-b599-f90cc9c55145-dbus\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.327254 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.327145 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be38fff6-97ae-43c5-b599-f90cc9c55145-kubelet-config\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.327254 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.327236 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be38fff6-97ae-43c5-b599-f90cc9c55145-kubelet-config\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.327422 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.327310 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be38fff6-97ae-43c5-b599-f90cc9c55145-dbus\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.329422 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.329402 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be38fff6-97ae-43c5-b599-f90cc9c55145-original-pull-secret\") pod \"global-pull-secret-syncer-t48t8\" (UID: \"be38fff6-97ae-43c5-b599-f90cc9c55145\") " pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.439102 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.439076 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t48t8" Jun 03 03:26:24.557391 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:24.557362 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t48t8"] Jun 03 03:26:24.560607 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:26:24.560575 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe38fff6_97ae_43c5_b599_f90cc9c55145.slice/crio-72703a9602b7301502767e5ef2f32b5c16919c7107cad56eb161eab9ef66131d WatchSource:0}: Error finding container 72703a9602b7301502767e5ef2f32b5c16919c7107cad56eb161eab9ef66131d: Status 404 returned error can't find the container with id 72703a9602b7301502767e5ef2f32b5c16919c7107cad56eb161eab9ef66131d Jun 03 03:26:25.525785 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:25.525746 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t48t8" event={"ID":"be38fff6-97ae-43c5-b599-f90cc9c55145","Type":"ContainerStarted","Data":"72703a9602b7301502767e5ef2f32b5c16919c7107cad56eb161eab9ef66131d"} Jun 03 03:26:29.538934 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:29.538895 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t48t8" event={"ID":"be38fff6-97ae-43c5-b599-f90cc9c55145","Type":"ContainerStarted","Data":"e01b909640f73ff9953c20ae73c1b3b5641fd5ae654ea0c3c850840d7e84386b"} Jun 03 03:26:29.553098 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:29.553055 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t48t8" podStartSLOduration=1.256918109 podStartE2EDuration="5.553040691s" podCreationTimestamp="2026-06-03 03:26:24 +0000 UTC" firstStartedPulling="2026-06-03 03:26:24.562400583 +0000 UTC m=+359.724124245" lastFinishedPulling="2026-06-03 03:26:28.858523174 +0000 UTC m=+364.020246827" observedRunningTime="2026-06-03 03:26:29.55156258 +0000 UTC m=+364.713286245" watchObservedRunningTime="2026-06-03 03:26:29.553040691 +0000 UTC m=+364.714764393" Jun 03 03:26:35.777182 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.777145 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk"] Jun 03 03:26:35.779829 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.779813 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.782235 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.782197 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g29c4\"" Jun 03 03:26:35.782339 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.782252 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 03:26:35.783076 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.783061 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 03:26:35.787678 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.787651 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk"] Jun 03 03:26:35.829374 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.829353 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.829478 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.829391 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vpkz\" (UniqueName: \"kubernetes.io/projected/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-kube-api-access-5vpkz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.829530 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.829480 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.930684 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.930630 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.930865 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.930709 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.930865 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.930740 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vpkz\" (UniqueName: \"kubernetes.io/projected/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-kube-api-access-5vpkz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.931053 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.931031 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.931094 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.931049 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:35.943397 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:35.943360 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vpkz\" (UniqueName: \"kubernetes.io/projected/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-kube-api-access-5vpkz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:36.089580 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.089481 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:36.213901 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.213824 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk"] Jun 03 03:26:36.216409 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:26:36.216383 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b7f47a_6c8e_4bf5_ae49_bcb2f2e1c870.slice/crio-b219a8e0f3e119045a693611867ed97f38a71edd93c460dc03888ccc125d5f94 WatchSource:0}: Error finding container b219a8e0f3e119045a693611867ed97f38a71edd93c460dc03888ccc125d5f94: Status 404 returned error can't find the container with id b219a8e0f3e119045a693611867ed97f38a71edd93c460dc03888ccc125d5f94 Jun 03 03:26:36.543212 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.543155 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-566f756998-ch96j" podUID="989668be-9b23-402b-a7b3-b80ee779a218" containerName="console" containerID="cri-o://352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8" gracePeriod=15 Jun 03 03:26:36.560628 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.560595 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" event={"ID":"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870","Type":"ContainerStarted","Data":"b219a8e0f3e119045a693611867ed97f38a71edd93c460dc03888ccc125d5f94"} Jun 03 03:26:36.772785 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.772761 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-566f756998-ch96j_989668be-9b23-402b-a7b3-b80ee779a218/console/0.log" Jun 03 03:26:36.772937 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.772833 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:26:36.840150 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840069 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-serving-cert\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840150 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840121 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-console-config\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840150 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840146 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-service-ca\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840166 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-oauth-serving-cert\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840207 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb7cg\" (UniqueName: \"kubernetes.io/projected/989668be-9b23-402b-a7b3-b80ee779a218-kube-api-access-sb7cg\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840269 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-oauth-config\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840318 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-trusted-ca-bundle\") pod \"989668be-9b23-402b-a7b3-b80ee779a218\" (UID: \"989668be-9b23-402b-a7b3-b80ee779a218\") " Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840594 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-service-ca" (OuterVolumeSpecName: "service-ca") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840648 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-console-config" (OuterVolumeSpecName: "console-config") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:26:36.840723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840654 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:26:36.841067 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.840932 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:26:36.842653 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.842627 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:26:36.842972 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.842949 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/989668be-9b23-402b-a7b3-b80ee779a218-kube-api-access-sb7cg" (OuterVolumeSpecName: "kube-api-access-sb7cg") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "kube-api-access-sb7cg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:26:36.843092 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.843063 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "989668be-9b23-402b-a7b3-b80ee779a218" (UID: "989668be-9b23-402b-a7b3-b80ee779a218"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:26:36.941701 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941658 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:36.941701 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941698 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-console-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:36.941933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941714 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-service-ca\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:36.941933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941729 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-oauth-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:36.941933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941740 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb7cg\" (UniqueName: \"kubernetes.io/projected/989668be-9b23-402b-a7b3-b80ee779a218-kube-api-access-sb7cg\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:36.941933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941750 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/989668be-9b23-402b-a7b3-b80ee779a218-console-oauth-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:36.941933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:36.941761 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989668be-9b23-402b-a7b3-b80ee779a218-trusted-ca-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:37.564420 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.564392 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-566f756998-ch96j_989668be-9b23-402b-a7b3-b80ee779a218/console/0.log" Jun 03 03:26:37.564597 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.564430 2570 generic.go:358] "Generic (PLEG): container finished" podID="989668be-9b23-402b-a7b3-b80ee779a218" containerID="352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8" exitCode=2 Jun 03 03:26:37.564597 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.564463 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f756998-ch96j" event={"ID":"989668be-9b23-402b-a7b3-b80ee779a218","Type":"ContainerDied","Data":"352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8"} Jun 03 03:26:37.564597 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.564497 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566f756998-ch96j" Jun 03 03:26:37.564597 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.564518 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566f756998-ch96j" event={"ID":"989668be-9b23-402b-a7b3-b80ee779a218","Type":"ContainerDied","Data":"4c0fd61c665eb96d6c1dc479ab7cd307075e3154b9caf074a0ea48a6c58d6107"} Jun 03 03:26:37.564597 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.564540 2570 scope.go:117] "RemoveContainer" containerID="352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8" Jun 03 03:26:37.572690 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.572675 2570 scope.go:117] "RemoveContainer" containerID="352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8" Jun 03 03:26:37.572965 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:26:37.572941 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8\": container with ID starting with 352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8 not found: ID does not exist" containerID="352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8" Jun 03 03:26:37.573017 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.572966 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8"} err="failed to get container status \"352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8\": rpc error: code = NotFound desc = could not find container \"352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8\": container with ID starting with 352afe0de6f96f12ce718209de63caafe576f49b346bef25f48f7837448762a8 not found: ID does not exist" Jun 03 03:26:37.580889 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.580870 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566f756998-ch96j"] Jun 03 03:26:37.583927 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:37.583907 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566f756998-ch96j"] Jun 03 03:26:39.418231 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:39.418188 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="989668be-9b23-402b-a7b3-b80ee779a218" path="/var/lib/kubelet/pods/989668be-9b23-402b-a7b3-b80ee779a218/volumes" Jun 03 03:26:44.588608 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:44.588567 2570 generic.go:358] "Generic (PLEG): container finished" podID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerID="5289f18124678e191d90da92ce0302989a33c4d8ef93e9aaae42273ce1f97e12" exitCode=0 Jun 03 03:26:44.588977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:44.588660 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" event={"ID":"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870","Type":"ContainerDied","Data":"5289f18124678e191d90da92ce0302989a33c4d8ef93e9aaae42273ce1f97e12"} Jun 03 03:26:47.599069 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:47.599037 2570 generic.go:358] "Generic (PLEG): container finished" podID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerID="a7c9c3eab333944a79d36a0a6a9c42d40aba81b2a4e6ec43b720ce80bcbf6cad" exitCode=0 Jun 03 03:26:47.599501 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:47.599122 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" event={"ID":"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870","Type":"ContainerDied","Data":"a7c9c3eab333944a79d36a0a6a9c42d40aba81b2a4e6ec43b720ce80bcbf6cad"} Jun 03 03:26:56.630893 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:56.630801 2570 generic.go:358] "Generic (PLEG): container finished" podID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerID="bcaf579270e55876cda329fdaa57f7b50742c8e144a40df143399591ad1117c4" exitCode=0 Jun 03 03:26:56.630893 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:56.630844 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" event={"ID":"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870","Type":"ContainerDied","Data":"bcaf579270e55876cda329fdaa57f7b50742c8e144a40df143399591ad1117c4"} Jun 03 03:26:57.751322 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.751298 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:26:57.824946 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.824906 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-util\") pod \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " Jun 03 03:26:57.825142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.824976 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vpkz\" (UniqueName: \"kubernetes.io/projected/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-kube-api-access-5vpkz\") pod \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " Jun 03 03:26:57.825142 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.825017 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-bundle\") pod \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\" (UID: \"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870\") " Jun 03 03:26:57.825744 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.825716 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-bundle" (OuterVolumeSpecName: "bundle") pod "f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" (UID: "f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:26:57.827153 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.827132 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-kube-api-access-5vpkz" (OuterVolumeSpecName: "kube-api-access-5vpkz") pod "f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" (UID: "f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870"). InnerVolumeSpecName "kube-api-access-5vpkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:26:57.829093 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.829072 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-util" (OuterVolumeSpecName: "util") pod "f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" (UID: "f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:26:57.925716 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.925662 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:57.925716 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.925686 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:57.925716 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:57.925697 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vpkz\" (UniqueName: \"kubernetes.io/projected/f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870-kube-api-access-5vpkz\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:26:58.638695 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:58.638663 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" event={"ID":"f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870","Type":"ContainerDied","Data":"b219a8e0f3e119045a693611867ed97f38a71edd93c460dc03888ccc125d5f94"} Jun 03 03:26:58.638695 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:58.638698 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b219a8e0f3e119045a693611867ed97f38a71edd93c460dc03888ccc125d5f94" Jun 03 03:26:58.638896 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:26:58.638721 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dchkbk" Jun 03 03:27:03.541682 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541607 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4"] Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541922 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="extract" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541932 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="extract" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541959 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="pull" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541965 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="pull" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541972 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="util" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541979 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="util" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541985 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989668be-9b23-402b-a7b3-b80ee779a218" containerName="console" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.541989 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="989668be-9b23-402b-a7b3-b80ee779a218" containerName="console" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.542050 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="989668be-9b23-402b-a7b3-b80ee779a218" containerName="console" Jun 03 03:27:03.542137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.542062 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6b7f47a-6c8e-4bf5-ae49-bcb2f2e1c870" containerName="extract" Jun 03 03:27:03.571518 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.571489 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4"] Jun 03 03:27:03.571644 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.571594 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.573950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.573917 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:27:03.573950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.573932 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8qsrj\"" Jun 03 03:27:03.574120 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.573920 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 03:27:03.664851 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.664820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187f0dd2-e065-42bd-9e9c-fe7f74320633-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-xlgn4\" (UID: \"187f0dd2-e065-42bd-9e9c-fe7f74320633\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.665020 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.664870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7cnr\" (UniqueName: \"kubernetes.io/projected/187f0dd2-e065-42bd-9e9c-fe7f74320633-kube-api-access-l7cnr\") pod \"cert-manager-operator-controller-manager-54b9655956-xlgn4\" (UID: \"187f0dd2-e065-42bd-9e9c-fe7f74320633\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.765407 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.765365 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187f0dd2-e065-42bd-9e9c-fe7f74320633-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-xlgn4\" (UID: \"187f0dd2-e065-42bd-9e9c-fe7f74320633\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.765596 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.765423 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7cnr\" (UniqueName: \"kubernetes.io/projected/187f0dd2-e065-42bd-9e9c-fe7f74320633-kube-api-access-l7cnr\") pod \"cert-manager-operator-controller-manager-54b9655956-xlgn4\" (UID: \"187f0dd2-e065-42bd-9e9c-fe7f74320633\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.765721 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.765700 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187f0dd2-e065-42bd-9e9c-fe7f74320633-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-xlgn4\" (UID: \"187f0dd2-e065-42bd-9e9c-fe7f74320633\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.773267 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.773239 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7cnr\" (UniqueName: \"kubernetes.io/projected/187f0dd2-e065-42bd-9e9c-fe7f74320633-kube-api-access-l7cnr\") pod \"cert-manager-operator-controller-manager-54b9655956-xlgn4\" (UID: \"187f0dd2-e065-42bd-9e9c-fe7f74320633\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:03.880524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:03.880439 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" Jun 03 03:27:04.014431 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:04.014301 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4"] Jun 03 03:27:04.016694 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:04.016670 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187f0dd2_e065_42bd_9e9c_fe7f74320633.slice/crio-97e1a77c58f1119c813de20bfea5aa5a855016775c0b24ec5349f3e1c84ce945 WatchSource:0}: Error finding container 97e1a77c58f1119c813de20bfea5aa5a855016775c0b24ec5349f3e1c84ce945: Status 404 returned error can't find the container with id 97e1a77c58f1119c813de20bfea5aa5a855016775c0b24ec5349f3e1c84ce945 Jun 03 03:27:04.658726 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:04.658693 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" event={"ID":"187f0dd2-e065-42bd-9e9c-fe7f74320633","Type":"ContainerStarted","Data":"97e1a77c58f1119c813de20bfea5aa5a855016775c0b24ec5349f3e1c84ce945"} Jun 03 03:27:06.667612 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:06.667571 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" event={"ID":"187f0dd2-e065-42bd-9e9c-fe7f74320633","Type":"ContainerStarted","Data":"2190121e9ecacff3371e89c4c18d820b502bf8c60b06795f3e0416bcf7878a3b"} Jun 03 03:27:06.688911 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:06.688860 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xlgn4" podStartSLOduration=1.9033328919999999 podStartE2EDuration="3.688846616s" podCreationTimestamp="2026-06-03 03:27:03 +0000 UTC" firstStartedPulling="2026-06-03 03:27:04.019085526 +0000 UTC m=+399.180809179" lastFinishedPulling="2026-06-03 03:27:05.804599252 +0000 UTC m=+400.966322903" observedRunningTime="2026-06-03 03:27:06.68658557 +0000 UTC m=+401.848309233" watchObservedRunningTime="2026-06-03 03:27:06.688846616 +0000 UTC m=+401.850570287" Jun 03 03:27:08.188685 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.188648 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk"] Jun 03 03:27:08.191262 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.191237 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.193524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.193502 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 03:27:08.193524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.193522 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g29c4\"" Jun 03 03:27:08.194294 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.194281 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 03:27:08.199044 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.199022 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk"] Jun 03 03:27:08.204973 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.204951 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.205077 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.204996 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.205077 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.205046 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djphp\" (UniqueName: \"kubernetes.io/projected/f644aae2-7b2e-4755-bda2-46c6d66e8647-kube-api-access-djphp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.306524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.306486 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.306524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.306530 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.306743 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.306551 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djphp\" (UniqueName: \"kubernetes.io/projected/f644aae2-7b2e-4755-bda2-46c6d66e8647-kube-api-access-djphp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.306922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.306898 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.306961 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.306911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.315713 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.315696 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djphp\" (UniqueName: \"kubernetes.io/projected/f644aae2-7b2e-4755-bda2-46c6d66e8647-kube-api-access-djphp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.501408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.501319 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:08.623791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.623765 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk"] Jun 03 03:27:08.625767 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:08.625738 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf644aae2_7b2e_4755_bda2_46c6d66e8647.slice/crio-ef2a43f264a66395d746c832245ab5deaee15883769675b80af9001d025b371c WatchSource:0}: Error finding container ef2a43f264a66395d746c832245ab5deaee15883769675b80af9001d025b371c: Status 404 returned error can't find the container with id ef2a43f264a66395d746c832245ab5deaee15883769675b80af9001d025b371c Jun 03 03:27:08.675008 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:08.674978 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" event={"ID":"f644aae2-7b2e-4755-bda2-46c6d66e8647","Type":"ContainerStarted","Data":"ef2a43f264a66395d746c832245ab5deaee15883769675b80af9001d025b371c"} Jun 03 03:27:09.679402 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:09.679376 2570 generic.go:358] "Generic (PLEG): container finished" podID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerID="d31441705908bb205393fdb81e75e4be88d52057a31cfefd14ee20fddc0fdc92" exitCode=0 Jun 03 03:27:09.679757 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:09.679470 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" event={"ID":"f644aae2-7b2e-4755-bda2-46c6d66e8647","Type":"ContainerDied","Data":"d31441705908bb205393fdb81e75e4be88d52057a31cfefd14ee20fddc0fdc92"} Jun 03 03:27:12.072869 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.072833 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-4xsg6"] Jun 03 03:27:12.075225 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.075199 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.077316 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.077289 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v5tpw\"" Jun 03 03:27:12.077430 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.077343 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 03:27:12.078099 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.078081 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 03:27:12.083058 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.082925 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-4xsg6"] Jun 03 03:27:12.139342 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.139318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnwj\" (UniqueName: \"kubernetes.io/projected/f9dedaf3-2808-468e-bd58-3253a29be5ab-kube-api-access-9bnwj\") pod \"cert-manager-cainjector-68b757865b-4xsg6\" (UID: \"f9dedaf3-2808-468e-bd58-3253a29be5ab\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.139442 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.139359 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9dedaf3-2808-468e-bd58-3253a29be5ab-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-4xsg6\" (UID: \"f9dedaf3-2808-468e-bd58-3253a29be5ab\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.240024 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.239994 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnwj\" (UniqueName: \"kubernetes.io/projected/f9dedaf3-2808-468e-bd58-3253a29be5ab-kube-api-access-9bnwj\") pod \"cert-manager-cainjector-68b757865b-4xsg6\" (UID: \"f9dedaf3-2808-468e-bd58-3253a29be5ab\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.240148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.240048 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9dedaf3-2808-468e-bd58-3253a29be5ab-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-4xsg6\" (UID: \"f9dedaf3-2808-468e-bd58-3253a29be5ab\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.247387 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.247359 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9dedaf3-2808-468e-bd58-3253a29be5ab-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-4xsg6\" (UID: \"f9dedaf3-2808-468e-bd58-3253a29be5ab\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.247475 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.247420 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnwj\" (UniqueName: \"kubernetes.io/projected/f9dedaf3-2808-468e-bd58-3253a29be5ab-kube-api-access-9bnwj\") pod \"cert-manager-cainjector-68b757865b-4xsg6\" (UID: \"f9dedaf3-2808-468e-bd58-3253a29be5ab\") " pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.396684 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.396600 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" Jun 03 03:27:12.517323 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.517288 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-4xsg6"] Jun 03 03:27:12.520078 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:12.520050 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9dedaf3_2808_468e_bd58_3253a29be5ab.slice/crio-e0d85ffc16d94dbd08d51f4c87e5ab96ecc93d913ee3b1718b96f42ee3e8c749 WatchSource:0}: Error finding container e0d85ffc16d94dbd08d51f4c87e5ab96ecc93d913ee3b1718b96f42ee3e8c749: Status 404 returned error can't find the container with id e0d85ffc16d94dbd08d51f4c87e5ab96ecc93d913ee3b1718b96f42ee3e8c749 Jun 03 03:27:12.693584 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.693551 2570 generic.go:358] "Generic (PLEG): container finished" podID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerID="177c31c8110e62abae0fcbfdf7c48bc60be0fe0bd1452040daf591118bae1a95" exitCode=0 Jun 03 03:27:12.693738 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.693635 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" event={"ID":"f644aae2-7b2e-4755-bda2-46c6d66e8647","Type":"ContainerDied","Data":"177c31c8110e62abae0fcbfdf7c48bc60be0fe0bd1452040daf591118bae1a95"} Jun 03 03:27:12.694772 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:12.694744 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" event={"ID":"f9dedaf3-2808-468e-bd58-3253a29be5ab","Type":"ContainerStarted","Data":"e0d85ffc16d94dbd08d51f4c87e5ab96ecc93d913ee3b1718b96f42ee3e8c749"} Jun 03 03:27:13.700565 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:13.700531 2570 generic.go:358] "Generic (PLEG): container finished" podID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerID="f8d22e620210da25cfad425124a3c63a4edc2fa1fa95c829c8312406c39476d9" exitCode=0 Jun 03 03:27:13.700950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:13.700594 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" event={"ID":"f644aae2-7b2e-4755-bda2-46c6d66e8647","Type":"ContainerDied","Data":"f8d22e620210da25cfad425124a3c63a4edc2fa1fa95c829c8312406c39476d9"} Jun 03 03:27:14.300077 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.300043 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-l99qd"] Jun 03 03:27:14.302728 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.302710 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.304906 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.304879 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cb75d\"" Jun 03 03:27:14.310162 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.310143 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-l99qd"] Jun 03 03:27:14.358930 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.358902 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6d2e096-9700-4dd1-88c8-b809da14b801-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-l99qd\" (UID: \"d6d2e096-9700-4dd1-88c8-b809da14b801\") " pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.359095 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.358959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4lx\" (UniqueName: \"kubernetes.io/projected/d6d2e096-9700-4dd1-88c8-b809da14b801-kube-api-access-zf4lx\") pod \"cert-manager-webhook-587ccfb98-l99qd\" (UID: \"d6d2e096-9700-4dd1-88c8-b809da14b801\") " pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.460241 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.460187 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4lx\" (UniqueName: \"kubernetes.io/projected/d6d2e096-9700-4dd1-88c8-b809da14b801-kube-api-access-zf4lx\") pod \"cert-manager-webhook-587ccfb98-l99qd\" (UID: \"d6d2e096-9700-4dd1-88c8-b809da14b801\") " pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.460422 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.460337 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6d2e096-9700-4dd1-88c8-b809da14b801-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-l99qd\" (UID: \"d6d2e096-9700-4dd1-88c8-b809da14b801\") " pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.468741 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.468705 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6d2e096-9700-4dd1-88c8-b809da14b801-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-l99qd\" (UID: \"d6d2e096-9700-4dd1-88c8-b809da14b801\") " pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.468870 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.468795 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4lx\" (UniqueName: \"kubernetes.io/projected/d6d2e096-9700-4dd1-88c8-b809da14b801-kube-api-access-zf4lx\") pod \"cert-manager-webhook-587ccfb98-l99qd\" (UID: \"d6d2e096-9700-4dd1-88c8-b809da14b801\") " pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:14.615406 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:14.615315 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:15.072200 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.072176 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:15.168116 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.168083 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djphp\" (UniqueName: \"kubernetes.io/projected/f644aae2-7b2e-4755-bda2-46c6d66e8647-kube-api-access-djphp\") pod \"f644aae2-7b2e-4755-bda2-46c6d66e8647\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " Jun 03 03:27:15.168283 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.168132 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-util\") pod \"f644aae2-7b2e-4755-bda2-46c6d66e8647\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " Jun 03 03:27:15.168283 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.168271 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-bundle\") pod \"f644aae2-7b2e-4755-bda2-46c6d66e8647\" (UID: \"f644aae2-7b2e-4755-bda2-46c6d66e8647\") " Jun 03 03:27:15.168773 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.168741 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-bundle" (OuterVolumeSpecName: "bundle") pod "f644aae2-7b2e-4755-bda2-46c6d66e8647" (UID: "f644aae2-7b2e-4755-bda2-46c6d66e8647"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:27:15.170735 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.170706 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f644aae2-7b2e-4755-bda2-46c6d66e8647-kube-api-access-djphp" (OuterVolumeSpecName: "kube-api-access-djphp") pod "f644aae2-7b2e-4755-bda2-46c6d66e8647" (UID: "f644aae2-7b2e-4755-bda2-46c6d66e8647"). InnerVolumeSpecName "kube-api-access-djphp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:27:15.173054 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.173028 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-util" (OuterVolumeSpecName: "util") pod "f644aae2-7b2e-4755-bda2-46c6d66e8647" (UID: "f644aae2-7b2e-4755-bda2-46c6d66e8647"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:27:15.186232 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.186134 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-l99qd"] Jun 03 03:27:15.188315 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:15.188291 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6d2e096_9700_4dd1_88c8_b809da14b801.slice/crio-15b3e962964093b6a6e52ec872dd84b8ff584af04e2e9c30bc279a6bac997a5d WatchSource:0}: Error finding container 15b3e962964093b6a6e52ec872dd84b8ff584af04e2e9c30bc279a6bac997a5d: Status 404 returned error can't find the container with id 15b3e962964093b6a6e52ec872dd84b8ff584af04e2e9c30bc279a6bac997a5d Jun 03 03:27:15.269305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.269276 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:27:15.269305 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.269304 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djphp\" (UniqueName: \"kubernetes.io/projected/f644aae2-7b2e-4755-bda2-46c6d66e8647-kube-api-access-djphp\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:27:15.269503 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.269319 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f644aae2-7b2e-4755-bda2-46c6d66e8647-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:27:15.709605 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.709568 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" event={"ID":"d6d2e096-9700-4dd1-88c8-b809da14b801","Type":"ContainerStarted","Data":"a0eea3a493343c2b1f8d60ce43d96e2471b606cc3a501f7b073e5702a74e145c"} Jun 03 03:27:15.709605 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.709611 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:15.709844 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.709623 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" event={"ID":"d6d2e096-9700-4dd1-88c8-b809da14b801","Type":"ContainerStarted","Data":"15b3e962964093b6a6e52ec872dd84b8ff584af04e2e9c30bc279a6bac997a5d"} Jun 03 03:27:15.711152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.711126 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" event={"ID":"f644aae2-7b2e-4755-bda2-46c6d66e8647","Type":"ContainerDied","Data":"ef2a43f264a66395d746c832245ab5deaee15883769675b80af9001d025b371c"} Jun 03 03:27:15.711152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.711151 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef2a43f264a66395d746c832245ab5deaee15883769675b80af9001d025b371c" Jun 03 03:27:15.711152 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.711150 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9cbsk" Jun 03 03:27:15.712574 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.712537 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" event={"ID":"f9dedaf3-2808-468e-bd58-3253a29be5ab","Type":"ContainerStarted","Data":"f667a7a9d5618d6a839769db458e6c6ea3782af3b728ab7c3b2d45788a934a17"} Jun 03 03:27:15.723017 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.722971 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" podStartSLOduration=1.722961433 podStartE2EDuration="1.722961433s" podCreationTimestamp="2026-06-03 03:27:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:27:15.7228638 +0000 UTC m=+410.884587493" watchObservedRunningTime="2026-06-03 03:27:15.722961433 +0000 UTC m=+410.884685103" Jun 03 03:27:15.741194 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:15.741152 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-4xsg6" podStartSLOduration=1.167622394 podStartE2EDuration="3.741141204s" podCreationTimestamp="2026-06-03 03:27:12 +0000 UTC" firstStartedPulling="2026-06-03 03:27:12.52195159 +0000 UTC m=+407.683675239" lastFinishedPulling="2026-06-03 03:27:15.095470385 +0000 UTC m=+410.257194049" observedRunningTime="2026-06-03 03:27:15.739963405 +0000 UTC m=+410.901687069" watchObservedRunningTime="2026-06-03 03:27:15.741141204 +0000 UTC m=+410.902864875" Jun 03 03:27:21.718600 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:21.718570 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-l99qd" Jun 03 03:27:27.175531 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175497 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5cpmf"] Jun 03 03:27:27.175922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175850 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="util" Jun 03 03:27:27.175922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175862 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="util" Jun 03 03:27:27.175922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175877 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="pull" Jun 03 03:27:27.175922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175887 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="pull" Jun 03 03:27:27.175922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175909 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="extract" Jun 03 03:27:27.175922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175915 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="extract" Jun 03 03:27:27.176113 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.175978 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="f644aae2-7b2e-4755-bda2-46c6d66e8647" containerName="extract" Jun 03 03:27:27.208420 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.208396 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5cpmf"] Jun 03 03:27:27.208561 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.208500 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.210758 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.210736 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5zwcz\"" Jun 03 03:27:27.275386 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.275360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5250215-e5a4-435f-8699-8c7148abf018-bound-sa-token\") pod \"cert-manager-79c8d999ff-5cpmf\" (UID: \"e5250215-e5a4-435f-8699-8c7148abf018\") " pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.275520 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.275417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74p6t\" (UniqueName: \"kubernetes.io/projected/e5250215-e5a4-435f-8699-8c7148abf018-kube-api-access-74p6t\") pod \"cert-manager-79c8d999ff-5cpmf\" (UID: \"e5250215-e5a4-435f-8699-8c7148abf018\") " pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.288612 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.288588 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt"] Jun 03 03:27:27.310677 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.310656 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt"] Jun 03 03:27:27.310783 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.310763 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.313635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.313612 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g29c4\"" Jun 03 03:27:27.313734 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.313702 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 03:27:27.313829 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.313813 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 03:27:27.376576 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.376544 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.376704 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.376598 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5250215-e5a4-435f-8699-8c7148abf018-bound-sa-token\") pod \"cert-manager-79c8d999ff-5cpmf\" (UID: \"e5250215-e5a4-435f-8699-8c7148abf018\") " pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.376704 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.376649 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.376704 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.376693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frn8x\" (UniqueName: \"kubernetes.io/projected/51ef8daf-f862-457d-adf3-444ef90819c3-kube-api-access-frn8x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.376809 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.376756 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74p6t\" (UniqueName: \"kubernetes.io/projected/e5250215-e5a4-435f-8699-8c7148abf018-kube-api-access-74p6t\") pod \"cert-manager-79c8d999ff-5cpmf\" (UID: \"e5250215-e5a4-435f-8699-8c7148abf018\") " pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.383961 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.383934 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5250215-e5a4-435f-8699-8c7148abf018-bound-sa-token\") pod \"cert-manager-79c8d999ff-5cpmf\" (UID: \"e5250215-e5a4-435f-8699-8c7148abf018\") " pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.384124 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.384107 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74p6t\" (UniqueName: \"kubernetes.io/projected/e5250215-e5a4-435f-8699-8c7148abf018-kube-api-access-74p6t\") pod \"cert-manager-79c8d999ff-5cpmf\" (UID: \"e5250215-e5a4-435f-8699-8c7148abf018\") " pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.477107 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.477081 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.477253 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.477120 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frn8x\" (UniqueName: \"kubernetes.io/projected/51ef8daf-f862-457d-adf3-444ef90819c3-kube-api-access-frn8x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.477253 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.477174 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.477506 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.477477 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.477547 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.477535 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.484564 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.484545 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frn8x\" (UniqueName: \"kubernetes.io/projected/51ef8daf-f862-457d-adf3-444ef90819c3-kube-api-access-frn8x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.517105 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.517079 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5cpmf" Jun 03 03:27:27.620390 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.620362 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:27.643534 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.643481 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5cpmf"] Jun 03 03:27:27.647027 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:27.646997 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5250215_e5a4_435f_8699_8c7148abf018.slice/crio-91a2380933755d90cdc1d4b9d47a6343533cbb2ed97fc549cde7dcf22e792c34 WatchSource:0}: Error finding container 91a2380933755d90cdc1d4b9d47a6343533cbb2ed97fc549cde7dcf22e792c34: Status 404 returned error can't find the container with id 91a2380933755d90cdc1d4b9d47a6343533cbb2ed97fc549cde7dcf22e792c34 Jun 03 03:27:27.750176 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.750156 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt"] Jun 03 03:27:27.752471 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:27.752442 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ef8daf_f862_457d_adf3_444ef90819c3.slice/crio-455fa4a27bea057660d013c069d6bc049029717e1d2ee8fa7064f9bb80c916b1 WatchSource:0}: Error finding container 455fa4a27bea057660d013c069d6bc049029717e1d2ee8fa7064f9bb80c916b1: Status 404 returned error can't find the container with id 455fa4a27bea057660d013c069d6bc049029717e1d2ee8fa7064f9bb80c916b1 Jun 03 03:27:27.753644 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:27.753615 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5cpmf" event={"ID":"e5250215-e5a4-435f-8699-8c7148abf018","Type":"ContainerStarted","Data":"91a2380933755d90cdc1d4b9d47a6343533cbb2ed97fc549cde7dcf22e792c34"} Jun 03 03:27:28.757914 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:28.757876 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5cpmf" event={"ID":"e5250215-e5a4-435f-8699-8c7148abf018","Type":"ContainerStarted","Data":"b945a5939f7f9e6b1701c980faad9370be59d990cbe51baa4c3cc2eb0e247177"} Jun 03 03:27:28.759161 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:28.759135 2570 generic.go:358] "Generic (PLEG): container finished" podID="51ef8daf-f862-457d-adf3-444ef90819c3" containerID="5f7b4b234b110037b8274583a0700011dbee60f78cc90e611754a6d223c175e5" exitCode=0 Jun 03 03:27:28.759266 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:28.759206 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" event={"ID":"51ef8daf-f862-457d-adf3-444ef90819c3","Type":"ContainerDied","Data":"5f7b4b234b110037b8274583a0700011dbee60f78cc90e611754a6d223c175e5"} Jun 03 03:27:28.759266 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:28.759252 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" event={"ID":"51ef8daf-f862-457d-adf3-444ef90819c3","Type":"ContainerStarted","Data":"455fa4a27bea057660d013c069d6bc049029717e1d2ee8fa7064f9bb80c916b1"} Jun 03 03:27:28.772951 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:28.772908 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5cpmf" podStartSLOduration=1.7728973959999998 podStartE2EDuration="1.772897396s" podCreationTimestamp="2026-06-03 03:27:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:27:28.77229162 +0000 UTC m=+423.934015290" watchObservedRunningTime="2026-06-03 03:27:28.772897396 +0000 UTC m=+423.934621067" Jun 03 03:27:29.764271 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:29.764240 2570 generic.go:358] "Generic (PLEG): container finished" podID="51ef8daf-f862-457d-adf3-444ef90819c3" containerID="0ca4e079d8d6cf3336a68ff07f149b83362698c2280d9f31da2a7db0482c232a" exitCode=0 Jun 03 03:27:29.764698 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:29.764393 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" event={"ID":"51ef8daf-f862-457d-adf3-444ef90819c3","Type":"ContainerDied","Data":"0ca4e079d8d6cf3336a68ff07f149b83362698c2280d9f31da2a7db0482c232a"} Jun 03 03:27:30.769443 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:30.769410 2570 generic.go:358] "Generic (PLEG): container finished" podID="51ef8daf-f862-457d-adf3-444ef90819c3" containerID="95f0109a73d87f2fa9a720064ea53d7d54dc96c1761bcffe3ed07bf094fa7ad9" exitCode=0 Jun 03 03:27:30.769818 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:30.769475 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" event={"ID":"51ef8daf-f862-457d-adf3-444ef90819c3","Type":"ContainerDied","Data":"95f0109a73d87f2fa9a720064ea53d7d54dc96c1761bcffe3ed07bf094fa7ad9"} Jun 03 03:27:31.893441 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:31.893411 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:32.014136 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.014111 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frn8x\" (UniqueName: \"kubernetes.io/projected/51ef8daf-f862-457d-adf3-444ef90819c3-kube-api-access-frn8x\") pod \"51ef8daf-f862-457d-adf3-444ef90819c3\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " Jun 03 03:27:32.014319 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.014149 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-bundle\") pod \"51ef8daf-f862-457d-adf3-444ef90819c3\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " Jun 03 03:27:32.014319 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.014206 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-util\") pod \"51ef8daf-f862-457d-adf3-444ef90819c3\" (UID: \"51ef8daf-f862-457d-adf3-444ef90819c3\") " Jun 03 03:27:32.014887 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.014860 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-bundle" (OuterVolumeSpecName: "bundle") pod "51ef8daf-f862-457d-adf3-444ef90819c3" (UID: "51ef8daf-f862-457d-adf3-444ef90819c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:27:32.016234 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.016196 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ef8daf-f862-457d-adf3-444ef90819c3-kube-api-access-frn8x" (OuterVolumeSpecName: "kube-api-access-frn8x") pod "51ef8daf-f862-457d-adf3-444ef90819c3" (UID: "51ef8daf-f862-457d-adf3-444ef90819c3"). InnerVolumeSpecName "kube-api-access-frn8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:27:32.021810 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.021785 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-util" (OuterVolumeSpecName: "util") pod "51ef8daf-f862-457d-adf3-444ef90819c3" (UID: "51ef8daf-f862-457d-adf3-444ef90819c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:27:32.115289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.115200 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frn8x\" (UniqueName: \"kubernetes.io/projected/51ef8daf-f862-457d-adf3-444ef90819c3-kube-api-access-frn8x\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:27:32.115289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.115264 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:27:32.115289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.115274 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51ef8daf-f862-457d-adf3-444ef90819c3-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:27:32.778450 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.778423 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" Jun 03 03:27:32.778619 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.778422 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdj2qdt" event={"ID":"51ef8daf-f862-457d-adf3-444ef90819c3","Type":"ContainerDied","Data":"455fa4a27bea057660d013c069d6bc049029717e1d2ee8fa7064f9bb80c916b1"} Jun 03 03:27:32.778619 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:32.778548 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="455fa4a27bea057660d013c069d6bc049029717e1d2ee8fa7064f9bb80c916b1" Jun 03 03:27:44.454104 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454028 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2"] Jun 03 03:27:44.454525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454418 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="extract" Jun 03 03:27:44.454525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454431 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="extract" Jun 03 03:27:44.454525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454446 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="pull" Jun 03 03:27:44.454525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454452 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="pull" Jun 03 03:27:44.454525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454479 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="util" Jun 03 03:27:44.454525 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454484 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="util" Jun 03 03:27:44.454734 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.454538 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="51ef8daf-f862-457d-adf3-444ef90819c3" containerName="extract" Jun 03 03:27:44.457772 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.457727 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.460027 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.460003 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 03:27:44.460183 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.460069 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nqt2b\"" Jun 03 03:27:44.460287 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.460073 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 03:27:44.460287 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.460173 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 03:27:44.460560 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.460539 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 03:27:44.471635 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.471615 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2"] Jun 03 03:27:44.622251 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.622176 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f12bd238-b51e-4b6c-92f9-b733f38ef32b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.622609 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.622586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c64x\" (UniqueName: \"kubernetes.io/projected/f12bd238-b51e-4b6c-92f9-b733f38ef32b-kube-api-access-2c64x\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.622918 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.622899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f12bd238-b51e-4b6c-92f9-b733f38ef32b-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.623141 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.623123 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f12bd238-b51e-4b6c-92f9-b733f38ef32b-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.623402 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.623372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f12bd238-b51e-4b6c-92f9-b733f38ef32b-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.723899 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.723808 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c64x\" (UniqueName: \"kubernetes.io/projected/f12bd238-b51e-4b6c-92f9-b733f38ef32b-kube-api-access-2c64x\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.724063 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.723908 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f12bd238-b51e-4b6c-92f9-b733f38ef32b-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.724063 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.723932 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f12bd238-b51e-4b6c-92f9-b733f38ef32b-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.724063 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.723952 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f12bd238-b51e-4b6c-92f9-b733f38ef32b-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.724063 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.724002 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f12bd238-b51e-4b6c-92f9-b733f38ef32b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.724405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.724377 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f12bd238-b51e-4b6c-92f9-b733f38ef32b-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.726324 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.726299 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f12bd238-b51e-4b6c-92f9-b733f38ef32b-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.726599 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.726539 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f12bd238-b51e-4b6c-92f9-b733f38ef32b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.726599 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.726547 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f12bd238-b51e-4b6c-92f9-b733f38ef32b-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.731312 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.731287 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c64x\" (UniqueName: \"kubernetes.io/projected/f12bd238-b51e-4b6c-92f9-b733f38ef32b-kube-api-access-2c64x\") pod \"opendatahub-operator-controller-manager-68f864588-clfk2\" (UID: \"f12bd238-b51e-4b6c-92f9-b733f38ef32b\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.769406 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.769372 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:44.910398 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:44.910374 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2"] Jun 03 03:27:44.912652 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:27:44.912624 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12bd238_b51e_4b6c_92f9_b733f38ef32b.slice/crio-529cf73fa1c0fb9e0fbef71fc6888786f1d25b8254305a5091d9990f4d4d9358 WatchSource:0}: Error finding container 529cf73fa1c0fb9e0fbef71fc6888786f1d25b8254305a5091d9990f4d4d9358: Status 404 returned error can't find the container with id 529cf73fa1c0fb9e0fbef71fc6888786f1d25b8254305a5091d9990f4d4d9358 Jun 03 03:27:45.832149 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:45.832081 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" event={"ID":"f12bd238-b51e-4b6c-92f9-b733f38ef32b","Type":"ContainerStarted","Data":"529cf73fa1c0fb9e0fbef71fc6888786f1d25b8254305a5091d9990f4d4d9358"} Jun 03 03:27:48.848280 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:48.848244 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" event={"ID":"f12bd238-b51e-4b6c-92f9-b733f38ef32b","Type":"ContainerStarted","Data":"e80491cc5ad84f5a659b46477fcd7163a19340f13e7a3ad7eb57489f730526de"} Jun 03 03:27:49.852563 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:49.852527 2570 generic.go:358] "Generic (PLEG): container finished" podID="f12bd238-b51e-4b6c-92f9-b733f38ef32b" containerID="e80491cc5ad84f5a659b46477fcd7163a19340f13e7a3ad7eb57489f730526de" exitCode=0 Jun 03 03:27:49.852947 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:49.852618 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" event={"ID":"f12bd238-b51e-4b6c-92f9-b733f38ef32b","Type":"ContainerDied","Data":"e80491cc5ad84f5a659b46477fcd7163a19340f13e7a3ad7eb57489f730526de"} Jun 03 03:27:50.857611 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:50.857570 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" event={"ID":"f12bd238-b51e-4b6c-92f9-b733f38ef32b","Type":"ContainerStarted","Data":"6b42a0ded9533a5923a13c83d7ca3ebe26a6f6dd8b850771b5683a88a9cbe218"} Jun 03 03:27:50.858009 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:50.857698 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:27:50.878383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:27:50.878336 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" podStartSLOduration=1.56113072 podStartE2EDuration="6.878321814s" podCreationTimestamp="2026-06-03 03:27:44 +0000 UTC" firstStartedPulling="2026-06-03 03:27:44.914280393 +0000 UTC m=+440.076004042" lastFinishedPulling="2026-06-03 03:27:50.231471473 +0000 UTC m=+445.393195136" observedRunningTime="2026-06-03 03:27:50.876934936 +0000 UTC m=+446.038658607" watchObservedRunningTime="2026-06-03 03:27:50.878321814 +0000 UTC m=+446.040045484" Jun 03 03:28:01.863265 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:01.863236 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-clfk2" Jun 03 03:28:04.272140 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.272110 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468"] Jun 03 03:28:04.280397 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.280375 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.285361 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.285337 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r5gnr\"" Jun 03 03:28:04.285544 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.285379 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 03:28:04.285804 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.285778 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 03:28:04.285893 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.285858 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:28:04.285945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.285926 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 03:28:04.285988 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.285948 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 03:28:04.292613 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.292592 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468"] Jun 03 03:28:04.364479 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.364447 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/854605b7-6609-4657-8fce-e6793dd94bc4-metrics-cert\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.364656 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.364485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/854605b7-6609-4657-8fce-e6793dd94bc4-manager-config\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.364656 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.364505 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qll2\" (UniqueName: \"kubernetes.io/projected/854605b7-6609-4657-8fce-e6793dd94bc4-kube-api-access-4qll2\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.364656 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.364600 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/854605b7-6609-4657-8fce-e6793dd94bc4-cert\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.465973 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.465937 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/854605b7-6609-4657-8fce-e6793dd94bc4-metrics-cert\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.466134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.466010 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/854605b7-6609-4657-8fce-e6793dd94bc4-manager-config\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.466134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.466043 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qll2\" (UniqueName: \"kubernetes.io/projected/854605b7-6609-4657-8fce-e6793dd94bc4-kube-api-access-4qll2\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.466134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.466092 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/854605b7-6609-4657-8fce-e6793dd94bc4-cert\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.466735 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.466711 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/854605b7-6609-4657-8fce-e6793dd94bc4-manager-config\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.468424 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.468403 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/854605b7-6609-4657-8fce-e6793dd94bc4-metrics-cert\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.468507 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.468471 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/854605b7-6609-4657-8fce-e6793dd94bc4-cert\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.473886 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.473864 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qll2\" (UniqueName: \"kubernetes.io/projected/854605b7-6609-4657-8fce-e6793dd94bc4-kube-api-access-4qll2\") pod \"lws-controller-manager-865bddc6b6-dl468\" (UID: \"854605b7-6609-4657-8fce-e6793dd94bc4\") " pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.590483 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.590396 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:04.735963 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.735935 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468"] Jun 03 03:28:04.737047 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:28:04.737023 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854605b7_6609_4657_8fce_e6793dd94bc4.slice/crio-3d7331ac9a1392ee1cb92ed0ab08ca2f81e8f361ce8595c97249d11518a92132 WatchSource:0}: Error finding container 3d7331ac9a1392ee1cb92ed0ab08ca2f81e8f361ce8595c97249d11518a92132: Status 404 returned error can't find the container with id 3d7331ac9a1392ee1cb92ed0ab08ca2f81e8f361ce8595c97249d11518a92132 Jun 03 03:28:04.910154 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:04.910066 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" event={"ID":"854605b7-6609-4657-8fce-e6793dd94bc4","Type":"ContainerStarted","Data":"3d7331ac9a1392ee1cb92ed0ab08ca2f81e8f361ce8595c97249d11518a92132"} Jun 03 03:28:06.822159 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.822126 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn"] Jun 03 03:28:06.825889 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.825865 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.827914 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.827890 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 03:28:06.828046 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.827987 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 03:28:06.828764 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.828741 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 03:28:06.828764 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.828752 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-52qj6\"" Jun 03 03:28:06.828940 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.828742 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 03:28:06.836406 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.836381 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn"] Jun 03 03:28:06.887008 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.886983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqdsh\" (UniqueName: \"kubernetes.io/projected/ea28913e-8a77-4641-adf5-fc78146b435d-kube-api-access-kqdsh\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.887106 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.887028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea28913e-8a77-4641-adf5-fc78146b435d-tmp\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.887148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.887113 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea28913e-8a77-4641-adf5-fc78146b435d-tls-certs\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.919943 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.919916 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" event={"ID":"854605b7-6609-4657-8fce-e6793dd94bc4","Type":"ContainerStarted","Data":"0a2398e73c7644668e5d78147a3e640aab8dcb2e8b880a29c0921014590a7619"} Jun 03 03:28:06.920082 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.920066 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:06.939162 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.939117 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" podStartSLOduration=1.503568209 podStartE2EDuration="2.939106911s" podCreationTimestamp="2026-06-03 03:28:04 +0000 UTC" firstStartedPulling="2026-06-03 03:28:04.738828136 +0000 UTC m=+459.900551788" lastFinishedPulling="2026-06-03 03:28:06.174366841 +0000 UTC m=+461.336090490" observedRunningTime="2026-06-03 03:28:06.936661913 +0000 UTC m=+462.098385586" watchObservedRunningTime="2026-06-03 03:28:06.939106911 +0000 UTC m=+462.100830582" Jun 03 03:28:06.988395 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.988374 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea28913e-8a77-4641-adf5-fc78146b435d-tls-certs\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.988524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.988425 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqdsh\" (UniqueName: \"kubernetes.io/projected/ea28913e-8a77-4641-adf5-fc78146b435d-kube-api-access-kqdsh\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.988524 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.988520 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea28913e-8a77-4641-adf5-fc78146b435d-tmp\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.990725 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.990697 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea28913e-8a77-4641-adf5-fc78146b435d-tmp\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.990867 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.990847 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea28913e-8a77-4641-adf5-fc78146b435d-tls-certs\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:06.996062 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:06.996042 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqdsh\" (UniqueName: \"kubernetes.io/projected/ea28913e-8a77-4641-adf5-fc78146b435d-kube-api-access-kqdsh\") pod \"kube-auth-proxy-6969fb6c4b-5hptn\" (UID: \"ea28913e-8a77-4641-adf5-fc78146b435d\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:07.136935 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:07.136860 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" Jun 03 03:28:07.257440 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:07.257416 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn"] Jun 03 03:28:07.259496 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:28:07.259467 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea28913e_8a77_4641_adf5_fc78146b435d.slice/crio-700b0f04792d888b61dde9aaedd78185721702df9124f083daa335374cffa523 WatchSource:0}: Error finding container 700b0f04792d888b61dde9aaedd78185721702df9124f083daa335374cffa523: Status 404 returned error can't find the container with id 700b0f04792d888b61dde9aaedd78185721702df9124f083daa335374cffa523 Jun 03 03:28:07.926184 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:07.926129 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" event={"ID":"ea28913e-8a77-4641-adf5-fc78146b435d","Type":"ContainerStarted","Data":"700b0f04792d888b61dde9aaedd78185721702df9124f083daa335374cffa523"} Jun 03 03:28:09.210166 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.210127 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct"] Jun 03 03:28:09.223161 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.223126 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct"] Jun 03 03:28:09.223341 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.223280 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.225994 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.225924 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 03:28:09.226139 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.225931 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 03:28:09.226754 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.226731 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g29c4\"" Jun 03 03:28:09.311895 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.311860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.312064 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.311899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msb8s\" (UniqueName: \"kubernetes.io/projected/7a61a420-a493-4399-b471-18573043662d-kube-api-access-msb8s\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.312064 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.312032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.412738 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.412706 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.412883 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.412770 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msb8s\" (UniqueName: \"kubernetes.io/projected/7a61a420-a493-4399-b471-18573043662d-kube-api-access-msb8s\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.412949 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.412880 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.413133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.413087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.413334 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.413312 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.420187 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.420165 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msb8s\" (UniqueName: \"kubernetes.io/projected/7a61a420-a493-4399-b471-18573043662d-kube-api-access-msb8s\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:09.535916 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:09.535852 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:10.289373 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:10.289347 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct"] Jun 03 03:28:10.291211 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:28:10.291184 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a61a420_a493_4399_b471_18573043662d.slice/crio-fdd69f268b763a5df2c09102c2f310576dac107b7c54b1be23f9ae30475cca72 WatchSource:0}: Error finding container fdd69f268b763a5df2c09102c2f310576dac107b7c54b1be23f9ae30475cca72: Status 404 returned error can't find the container with id fdd69f268b763a5df2c09102c2f310576dac107b7c54b1be23f9ae30475cca72 Jun 03 03:28:10.940151 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:10.940115 2570 generic.go:358] "Generic (PLEG): container finished" podID="7a61a420-a493-4399-b471-18573043662d" containerID="07f31f9d81a44843f003b3b0d84d3499fea3258db9f8c1778ca5c54d82e65454" exitCode=0 Jun 03 03:28:10.940370 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:10.940205 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" event={"ID":"7a61a420-a493-4399-b471-18573043662d","Type":"ContainerDied","Data":"07f31f9d81a44843f003b3b0d84d3499fea3258db9f8c1778ca5c54d82e65454"} Jun 03 03:28:10.940370 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:10.940263 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" event={"ID":"7a61a420-a493-4399-b471-18573043662d","Type":"ContainerStarted","Data":"fdd69f268b763a5df2c09102c2f310576dac107b7c54b1be23f9ae30475cca72"} Jun 03 03:28:10.941735 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:10.941700 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" event={"ID":"ea28913e-8a77-4641-adf5-fc78146b435d","Type":"ContainerStarted","Data":"ae75a856eb3c81f9532e25f1a91867f9890081356676506f8218e507fa06dc0c"} Jun 03 03:28:10.972159 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:10.972115 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-5hptn" podStartSLOduration=2.016143221 podStartE2EDuration="4.972103191s" podCreationTimestamp="2026-06-03 03:28:06 +0000 UTC" firstStartedPulling="2026-06-03 03:28:07.261326206 +0000 UTC m=+462.423049854" lastFinishedPulling="2026-06-03 03:28:10.217286157 +0000 UTC m=+465.379009824" observedRunningTime="2026-06-03 03:28:10.971379332 +0000 UTC m=+466.133103011" watchObservedRunningTime="2026-06-03 03:28:10.972103191 +0000 UTC m=+466.133826861" Jun 03 03:28:11.946364 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:11.946331 2570 generic.go:358] "Generic (PLEG): container finished" podID="7a61a420-a493-4399-b471-18573043662d" containerID="1e0727703439ab7cc6215724a230014cb66784ad064ae62b0b7582a02b58f417" exitCode=0 Jun 03 03:28:11.946736 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:11.946419 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" event={"ID":"7a61a420-a493-4399-b471-18573043662d","Type":"ContainerDied","Data":"1e0727703439ab7cc6215724a230014cb66784ad064ae62b0b7582a02b58f417"} Jun 03 03:28:12.952477 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:12.952443 2570 generic.go:358] "Generic (PLEG): container finished" podID="7a61a420-a493-4399-b471-18573043662d" containerID="9aa6e565ef36b79aa317004490409b1d2ddb74a1a0428e9e1dfd65325b0b9deb" exitCode=0 Jun 03 03:28:12.952837 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:12.952530 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" event={"ID":"7a61a420-a493-4399-b471-18573043662d","Type":"ContainerDied","Data":"9aa6e565ef36b79aa317004490409b1d2ddb74a1a0428e9e1dfd65325b0b9deb"} Jun 03 03:28:14.112184 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.112160 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:14.158788 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.158764 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-bundle\") pod \"7a61a420-a493-4399-b471-18573043662d\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " Jun 03 03:28:14.158923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.158835 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-util\") pod \"7a61a420-a493-4399-b471-18573043662d\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " Jun 03 03:28:14.158923 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.158878 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msb8s\" (UniqueName: \"kubernetes.io/projected/7a61a420-a493-4399-b471-18573043662d-kube-api-access-msb8s\") pod \"7a61a420-a493-4399-b471-18573043662d\" (UID: \"7a61a420-a493-4399-b471-18573043662d\") " Jun 03 03:28:14.159637 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.159611 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-bundle" (OuterVolumeSpecName: "bundle") pod "7a61a420-a493-4399-b471-18573043662d" (UID: "7a61a420-a493-4399-b471-18573043662d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:28:14.161014 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.160982 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a61a420-a493-4399-b471-18573043662d-kube-api-access-msb8s" (OuterVolumeSpecName: "kube-api-access-msb8s") pod "7a61a420-a493-4399-b471-18573043662d" (UID: "7a61a420-a493-4399-b471-18573043662d"). InnerVolumeSpecName "kube-api-access-msb8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:28:14.164493 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.164473 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-util" (OuterVolumeSpecName: "util") pod "7a61a420-a493-4399-b471-18573043662d" (UID: "7a61a420-a493-4399-b471-18573043662d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:28:14.260323 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.260239 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msb8s\" (UniqueName: \"kubernetes.io/projected/7a61a420-a493-4399-b471-18573043662d-kube-api-access-msb8s\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:28:14.260323 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.260273 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:28:14.260323 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.260289 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a61a420-a493-4399-b471-18573043662d-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:28:14.960821 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.960796 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" Jun 03 03:28:14.961045 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.960796 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835bgfct" event={"ID":"7a61a420-a493-4399-b471-18573043662d","Type":"ContainerDied","Data":"fdd69f268b763a5df2c09102c2f310576dac107b7c54b1be23f9ae30475cca72"} Jun 03 03:28:14.961045 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:14.960901 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdd69f268b763a5df2c09102c2f310576dac107b7c54b1be23f9ae30475cca72" Jun 03 03:28:17.928573 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:17.928541 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-865bddc6b6-dl468" Jun 03 03:28:23.785292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.785253 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb"] Jun 03 03:28:23.786446 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.786420 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="util" Jun 03 03:28:23.786588 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.786578 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="util" Jun 03 03:28:23.786670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.786661 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="pull" Jun 03 03:28:23.786739 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.786729 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="pull" Jun 03 03:28:23.786806 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.786797 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="extract" Jun 03 03:28:23.786876 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.786868 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="extract" Jun 03 03:28:23.787069 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.787058 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a61a420-a493-4399-b471-18573043662d" containerName="extract" Jun 03 03:28:23.796127 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.796103 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.797543 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.797517 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb"] Jun 03 03:28:23.798454 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.798433 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 03:28:23.798577 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.798502 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 03:28:23.799203 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.799188 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g29c4\"" Jun 03 03:28:23.848166 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.848130 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.848373 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.848270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dff27\" (UniqueName: \"kubernetes.io/projected/9990d3d1-56ca-440f-b108-f90ba55c98b4-kube-api-access-dff27\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.848373 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.848313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.949343 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.949205 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dff27\" (UniqueName: \"kubernetes.io/projected/9990d3d1-56ca-440f-b108-f90ba55c98b4-kube-api-access-dff27\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.949500 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.949388 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.949500 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.949459 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.949781 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.949760 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.949826 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.949813 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:23.958937 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:23.958911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dff27\" (UniqueName: \"kubernetes.io/projected/9990d3d1-56ca-440f-b108-f90ba55c98b4-kube-api-access-dff27\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:24.107656 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:24.107575 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:24.255881 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:24.255854 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb"] Jun 03 03:28:24.257699 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:28:24.257663 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9990d3d1_56ca_440f_b108_f90ba55c98b4.slice/crio-4800be047319e018b33f32d358028d8917977a67da9a168031733314cb28f9aa WatchSource:0}: Error finding container 4800be047319e018b33f32d358028d8917977a67da9a168031733314cb28f9aa: Status 404 returned error can't find the container with id 4800be047319e018b33f32d358028d8917977a67da9a168031733314cb28f9aa Jun 03 03:28:24.997421 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:24.997386 2570 generic.go:358] "Generic (PLEG): container finished" podID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerID="4a3258625bae2e541c0dafda0242b2a2662caee8c021fdecc5dd0f03c80d912e" exitCode=0 Jun 03 03:28:24.997791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:24.997468 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" event={"ID":"9990d3d1-56ca-440f-b108-f90ba55c98b4","Type":"ContainerDied","Data":"4a3258625bae2e541c0dafda0242b2a2662caee8c021fdecc5dd0f03c80d912e"} Jun 03 03:28:24.997791 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:24.997514 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" event={"ID":"9990d3d1-56ca-440f-b108-f90ba55c98b4","Type":"ContainerStarted","Data":"4800be047319e018b33f32d358028d8917977a67da9a168031733314cb28f9aa"} Jun 03 03:28:30.019716 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:30.019678 2570 generic.go:358] "Generic (PLEG): container finished" podID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerID="1791fbd4df29f5e2e8d45e1314c1d55c4df75191cea1aaf1a21916409aaaab82" exitCode=0 Jun 03 03:28:30.020121 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:30.019765 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" event={"ID":"9990d3d1-56ca-440f-b108-f90ba55c98b4","Type":"ContainerDied","Data":"1791fbd4df29f5e2e8d45e1314c1d55c4df75191cea1aaf1a21916409aaaab82"} Jun 03 03:28:31.025618 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:31.025579 2570 generic.go:358] "Generic (PLEG): container finished" podID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerID="c0549ffa0b97a15273fcd158bc6e179c9159f21ff9f5a65876e8db22150ccb94" exitCode=0 Jun 03 03:28:31.026066 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:31.025615 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" event={"ID":"9990d3d1-56ca-440f-b108-f90ba55c98b4","Type":"ContainerDied","Data":"c0549ffa0b97a15273fcd158bc6e179c9159f21ff9f5a65876e8db22150ccb94"} Jun 03 03:28:32.156010 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.155989 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:28:32.227519 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.227479 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-util\") pod \"9990d3d1-56ca-440f-b108-f90ba55c98b4\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " Jun 03 03:28:32.227684 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.227556 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dff27\" (UniqueName: \"kubernetes.io/projected/9990d3d1-56ca-440f-b108-f90ba55c98b4-kube-api-access-dff27\") pod \"9990d3d1-56ca-440f-b108-f90ba55c98b4\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " Jun 03 03:28:32.227684 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.227627 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-bundle\") pod \"9990d3d1-56ca-440f-b108-f90ba55c98b4\" (UID: \"9990d3d1-56ca-440f-b108-f90ba55c98b4\") " Jun 03 03:28:32.228574 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.228539 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-bundle" (OuterVolumeSpecName: "bundle") pod "9990d3d1-56ca-440f-b108-f90ba55c98b4" (UID: "9990d3d1-56ca-440f-b108-f90ba55c98b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:28:32.229718 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.229695 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9990d3d1-56ca-440f-b108-f90ba55c98b4-kube-api-access-dff27" (OuterVolumeSpecName: "kube-api-access-dff27") pod "9990d3d1-56ca-440f-b108-f90ba55c98b4" (UID: "9990d3d1-56ca-440f-b108-f90ba55c98b4"). InnerVolumeSpecName "kube-api-access-dff27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:28:32.234134 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.234090 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-util" (OuterVolumeSpecName: "util") pod "9990d3d1-56ca-440f-b108-f90ba55c98b4" (UID: "9990d3d1-56ca-440f-b108-f90ba55c98b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:28:32.328928 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.328852 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:28:32.328928 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.328879 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dff27\" (UniqueName: \"kubernetes.io/projected/9990d3d1-56ca-440f-b108-f90ba55c98b4-kube-api-access-dff27\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:28:32.328928 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:32.328891 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9990d3d1-56ca-440f-b108-f90ba55c98b4-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:28:33.034008 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:33.033974 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" event={"ID":"9990d3d1-56ca-440f-b108-f90ba55c98b4","Type":"ContainerDied","Data":"4800be047319e018b33f32d358028d8917977a67da9a168031733314cb28f9aa"} Jun 03 03:28:33.034008 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:33.034006 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4800be047319e018b33f32d358028d8917977a67da9a168031733314cb28f9aa" Jun 03 03:28:33.034323 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:28:33.034023 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a56hqb" Jun 03 03:29:20.216147 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216068 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p"] Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216455 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="util" Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216466 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="util" Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216475 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="extract" Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216480 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="extract" Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216487 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="pull" Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216494 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="pull" Jun 03 03:29:20.216639 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.216561 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="9990d3d1-56ca-440f-b108-f90ba55c98b4" containerName="extract" Jun 03 03:29:20.219547 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.219531 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.222515 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.222494 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 03:29:20.223133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.223120 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 03:29:20.223803 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.223787 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxdrd\"" Jun 03 03:29:20.234097 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.234076 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p"] Jun 03 03:29:20.344728 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.344702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.344864 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.344746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.344864 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.344770 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjz5x\" (UniqueName: \"kubernetes.io/projected/bca53924-d1ef-4049-a661-645bbdc43411-kube-api-access-bjz5x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.446000 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.445970 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjz5x\" (UniqueName: \"kubernetes.io/projected/bca53924-d1ef-4049-a661-645bbdc43411-kube-api-access-bjz5x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.446115 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.446040 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.446115 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.446071 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.446534 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.446511 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.446578 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.446541 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.453929 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.453911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjz5x\" (UniqueName: \"kubernetes.io/projected/bca53924-d1ef-4049-a661-645bbdc43411-kube-api-access-bjz5x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.528566 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.528503 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:20.655031 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.655005 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p"] Jun 03 03:29:20.656572 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:29:20.656538 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca53924_d1ef_4049_a661_645bbdc43411.slice/crio-09ade7b1fa97652a7cf04df1c55a2f6cc5709a450a2873117db79e7c6d008b46 WatchSource:0}: Error finding container 09ade7b1fa97652a7cf04df1c55a2f6cc5709a450a2873117db79e7c6d008b46: Status 404 returned error can't find the container with id 09ade7b1fa97652a7cf04df1c55a2f6cc5709a450a2873117db79e7c6d008b46 Jun 03 03:29:20.778004 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.777979 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q"] Jun 03 03:29:20.781366 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.781331 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.786977 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.786956 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q"] Jun 03 03:29:20.850148 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.850124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.850255 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.850161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.850255 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.850187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65m6d\" (UniqueName: \"kubernetes.io/projected/f7ea567f-8b89-4577-8967-57c331dbd4e6-kube-api-access-65m6d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.951404 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.951380 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.951497 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.951415 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.951497 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.951443 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65m6d\" (UniqueName: \"kubernetes.io/projected/f7ea567f-8b89-4577-8967-57c331dbd4e6-kube-api-access-65m6d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.951730 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.951713 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.951767 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.951746 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:20.958593 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:20.958574 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65m6d\" (UniqueName: \"kubernetes.io/projected/f7ea567f-8b89-4577-8967-57c331dbd4e6-kube-api-access-65m6d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:21.132931 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.132854 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:21.205541 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.205508 2570 generic.go:358] "Generic (PLEG): container finished" podID="bca53924-d1ef-4049-a661-645bbdc43411" containerID="4a40ccb422dbce838a1799a34b04b4c0b5fe3f62a77542bee30dcca678024692" exitCode=0 Jun 03 03:29:21.205688 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.205585 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" event={"ID":"bca53924-d1ef-4049-a661-645bbdc43411","Type":"ContainerDied","Data":"4a40ccb422dbce838a1799a34b04b4c0b5fe3f62a77542bee30dcca678024692"} Jun 03 03:29:21.205688 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.205621 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" event={"ID":"bca53924-d1ef-4049-a661-645bbdc43411","Type":"ContainerStarted","Data":"09ade7b1fa97652a7cf04df1c55a2f6cc5709a450a2873117db79e7c6d008b46"} Jun 03 03:29:21.260926 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.260903 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q"] Jun 03 03:29:21.262900 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:29:21.262865 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ea567f_8b89_4577_8967_57c331dbd4e6.slice/crio-edbfba034dbaf532e2cfdae1a2f92c7d2e63b35cd27181b30db8417ceadd5084 WatchSource:0}: Error finding container edbfba034dbaf532e2cfdae1a2f92c7d2e63b35cd27181b30db8417ceadd5084: Status 404 returned error can't find the container with id edbfba034dbaf532e2cfdae1a2f92c7d2e63b35cd27181b30db8417ceadd5084 Jun 03 03:29:21.379327 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.379304 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k"] Jun 03 03:29:21.382760 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.382744 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.389129 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.389075 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k"] Jun 03 03:29:21.456108 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.456078 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmfmt\" (UniqueName: \"kubernetes.io/projected/fddc18bd-5dc4-4782-a6f9-28284c32b49e-kube-api-access-cmfmt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.456238 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.456112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.456284 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.456235 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.557111 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.557076 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.557291 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.557123 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmfmt\" (UniqueName: \"kubernetes.io/projected/fddc18bd-5dc4-4782-a6f9-28284c32b49e-kube-api-access-cmfmt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.557291 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.557143 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.557494 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.557467 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.557583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.557562 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.564534 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.564509 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmfmt\" (UniqueName: \"kubernetes.io/projected/fddc18bd-5dc4-4782-a6f9-28284c32b49e-kube-api-access-cmfmt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.723658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.723628 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:21.854766 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.854741 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k"] Jun 03 03:29:21.856188 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:29:21.856161 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddc18bd_5dc4_4782_a6f9_28284c32b49e.slice/crio-c27da46ca8df74704d2b4de2d5e63329ddd43efb2b0bdd0743057ff43b709a7a WatchSource:0}: Error finding container c27da46ca8df74704d2b4de2d5e63329ddd43efb2b0bdd0743057ff43b709a7a: Status 404 returned error can't find the container with id c27da46ca8df74704d2b4de2d5e63329ddd43efb2b0bdd0743057ff43b709a7a Jun 03 03:29:21.985618 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.985592 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7"] Jun 03 03:29:21.989276 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.989260 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:21.995728 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:21.995708 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7"] Jun 03 03:29:22.062544 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.062519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.062645 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.062555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.062645 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.062576 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bjmj\" (UniqueName: \"kubernetes.io/projected/432cd8b7-a015-44df-a40d-c947137d1f03-kube-api-access-2bjmj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.163707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.163681 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.163815 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.163718 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.163815 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.163742 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bjmj\" (UniqueName: \"kubernetes.io/projected/432cd8b7-a015-44df-a40d-c947137d1f03-kube-api-access-2bjmj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.164038 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.164015 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.164075 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.164051 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.173151 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.173126 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bjmj\" (UniqueName: \"kubernetes.io/projected/432cd8b7-a015-44df-a40d-c947137d1f03-kube-api-access-2bjmj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.213602 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.213575 2570 generic.go:358] "Generic (PLEG): container finished" podID="bca53924-d1ef-4049-a661-645bbdc43411" containerID="59e3d13714cfcb0ae2f97bb74c985af94a633497783123109a13921f7d09e5fd" exitCode=0 Jun 03 03:29:22.213726 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.213647 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" event={"ID":"bca53924-d1ef-4049-a661-645bbdc43411","Type":"ContainerDied","Data":"59e3d13714cfcb0ae2f97bb74c985af94a633497783123109a13921f7d09e5fd"} Jun 03 03:29:22.215130 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.215106 2570 generic.go:358] "Generic (PLEG): container finished" podID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerID="dbd45a6ed9f2a063d654bec83f88119debe69b0c4609edcfa03318fb965828e1" exitCode=0 Jun 03 03:29:22.215250 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.215136 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" event={"ID":"fddc18bd-5dc4-4782-a6f9-28284c32b49e","Type":"ContainerDied","Data":"dbd45a6ed9f2a063d654bec83f88119debe69b0c4609edcfa03318fb965828e1"} Jun 03 03:29:22.215250 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.215164 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" event={"ID":"fddc18bd-5dc4-4782-a6f9-28284c32b49e","Type":"ContainerStarted","Data":"c27da46ca8df74704d2b4de2d5e63329ddd43efb2b0bdd0743057ff43b709a7a"} Jun 03 03:29:22.216745 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.216719 2570 generic.go:358] "Generic (PLEG): container finished" podID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerID="38f3f11c0fcd13bcf1bfbec67c54760a8dba6243909cb1fff5b1a381dc10f9b2" exitCode=0 Jun 03 03:29:22.216851 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.216747 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" event={"ID":"f7ea567f-8b89-4577-8967-57c331dbd4e6","Type":"ContainerDied","Data":"38f3f11c0fcd13bcf1bfbec67c54760a8dba6243909cb1fff5b1a381dc10f9b2"} Jun 03 03:29:22.216851 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.216791 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" event={"ID":"f7ea567f-8b89-4577-8967-57c331dbd4e6","Type":"ContainerStarted","Data":"edbfba034dbaf532e2cfdae1a2f92c7d2e63b35cd27181b30db8417ceadd5084"} Jun 03 03:29:22.341723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.341696 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:22.468039 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:22.468016 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7"] Jun 03 03:29:22.469940 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:29:22.469909 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432cd8b7_a015_44df_a40d_c947137d1f03.slice/crio-b43518669d02d69c0045e2f48a9147d6d5ed38437fe6ecc001c4326ff2bf33ef WatchSource:0}: Error finding container b43518669d02d69c0045e2f48a9147d6d5ed38437fe6ecc001c4326ff2bf33ef: Status 404 returned error can't find the container with id b43518669d02d69c0045e2f48a9147d6d5ed38437fe6ecc001c4326ff2bf33ef Jun 03 03:29:23.221438 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.221407 2570 generic.go:358] "Generic (PLEG): container finished" podID="432cd8b7-a015-44df-a40d-c947137d1f03" containerID="9e25bd7fdeb9f48aae004e795a16d2f823ba7ca0612b23b1ec14a5548f151c38" exitCode=0 Jun 03 03:29:23.221560 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.221499 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" event={"ID":"432cd8b7-a015-44df-a40d-c947137d1f03","Type":"ContainerDied","Data":"9e25bd7fdeb9f48aae004e795a16d2f823ba7ca0612b23b1ec14a5548f151c38"} Jun 03 03:29:23.221560 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.221543 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" event={"ID":"432cd8b7-a015-44df-a40d-c947137d1f03","Type":"ContainerStarted","Data":"b43518669d02d69c0045e2f48a9147d6d5ed38437fe6ecc001c4326ff2bf33ef"} Jun 03 03:29:23.223439 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.223416 2570 generic.go:358] "Generic (PLEG): container finished" podID="bca53924-d1ef-4049-a661-645bbdc43411" containerID="26fa18bc2a964ac5a41a0c2216a47de50691c2e35e5ff946623bdf2c4849fb08" exitCode=0 Jun 03 03:29:23.223533 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.223494 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" event={"ID":"bca53924-d1ef-4049-a661-645bbdc43411","Type":"ContainerDied","Data":"26fa18bc2a964ac5a41a0c2216a47de50691c2e35e5ff946623bdf2c4849fb08"} Jun 03 03:29:23.225123 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.225101 2570 generic.go:358] "Generic (PLEG): container finished" podID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerID="b313d438bfd50115e34d19400ab210d3def3119c403a739a9501271358b311b1" exitCode=0 Jun 03 03:29:23.225249 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.225174 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" event={"ID":"fddc18bd-5dc4-4782-a6f9-28284c32b49e","Type":"ContainerDied","Data":"b313d438bfd50115e34d19400ab210d3def3119c403a739a9501271358b311b1"} Jun 03 03:29:23.226861 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.226842 2570 generic.go:358] "Generic (PLEG): container finished" podID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerID="b3d9b647154ee9bb61c83bd0be6e1fd009c0c63253831ec8e1c8d13a61a60891" exitCode=0 Jun 03 03:29:23.226950 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:23.226928 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" event={"ID":"f7ea567f-8b89-4577-8967-57c331dbd4e6","Type":"ContainerDied","Data":"b3d9b647154ee9bb61c83bd0be6e1fd009c0c63253831ec8e1c8d13a61a60891"} Jun 03 03:29:24.238383 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.238347 2570 generic.go:358] "Generic (PLEG): container finished" podID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerID="45e49fff981313336ecd78ae573685b942ea095d0bd2a7b4b3560a1bbd868c32" exitCode=0 Jun 03 03:29:24.238684 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.238418 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" event={"ID":"fddc18bd-5dc4-4782-a6f9-28284c32b49e","Type":"ContainerDied","Data":"45e49fff981313336ecd78ae573685b942ea095d0bd2a7b4b3560a1bbd868c32"} Jun 03 03:29:24.240151 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.240130 2570 generic.go:358] "Generic (PLEG): container finished" podID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerID="0bc757270d1a9052f1ce737f4e15ed5186d8e60cae3514e9012e952dfd343426" exitCode=0 Jun 03 03:29:24.240267 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.240205 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" event={"ID":"f7ea567f-8b89-4577-8967-57c331dbd4e6","Type":"ContainerDied","Data":"0bc757270d1a9052f1ce737f4e15ed5186d8e60cae3514e9012e952dfd343426"} Jun 03 03:29:24.241725 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.241705 2570 generic.go:358] "Generic (PLEG): container finished" podID="432cd8b7-a015-44df-a40d-c947137d1f03" containerID="c056f93faf488a4f17bd6b9314fc15284e3c009265b7671b6cd5dee7dc8e072e" exitCode=0 Jun 03 03:29:24.241805 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.241778 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" event={"ID":"432cd8b7-a015-44df-a40d-c947137d1f03","Type":"ContainerDied","Data":"c056f93faf488a4f17bd6b9314fc15284e3c009265b7671b6cd5dee7dc8e072e"} Jun 03 03:29:24.370381 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.370358 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:24.490877 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.490841 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-bundle\") pod \"bca53924-d1ef-4049-a661-645bbdc43411\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " Jun 03 03:29:24.490996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.490901 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjz5x\" (UniqueName: \"kubernetes.io/projected/bca53924-d1ef-4049-a661-645bbdc43411-kube-api-access-bjz5x\") pod \"bca53924-d1ef-4049-a661-645bbdc43411\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " Jun 03 03:29:24.490996 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.490919 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-util\") pod \"bca53924-d1ef-4049-a661-645bbdc43411\" (UID: \"bca53924-d1ef-4049-a661-645bbdc43411\") " Jun 03 03:29:24.491479 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.491450 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-bundle" (OuterVolumeSpecName: "bundle") pod "bca53924-d1ef-4049-a661-645bbdc43411" (UID: "bca53924-d1ef-4049-a661-645bbdc43411"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:24.493064 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.493044 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca53924-d1ef-4049-a661-645bbdc43411-kube-api-access-bjz5x" (OuterVolumeSpecName: "kube-api-access-bjz5x") pod "bca53924-d1ef-4049-a661-645bbdc43411" (UID: "bca53924-d1ef-4049-a661-645bbdc43411"). InnerVolumeSpecName "kube-api-access-bjz5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:29:24.496173 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.496147 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-util" (OuterVolumeSpecName: "util") pod "bca53924-d1ef-4049-a661-645bbdc43411" (UID: "bca53924-d1ef-4049-a661-645bbdc43411"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:24.591809 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.591782 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjz5x\" (UniqueName: \"kubernetes.io/projected/bca53924-d1ef-4049-a661-645bbdc43411-kube-api-access-bjz5x\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:24.591809 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.591808 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:24.591932 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:24.591822 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca53924-d1ef-4049-a661-645bbdc43411-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:25.247166 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.247125 2570 generic.go:358] "Generic (PLEG): container finished" podID="432cd8b7-a015-44df-a40d-c947137d1f03" containerID="3680ea76e133123669f592a9536db97e0b7de6162f1c07259e595d7677654362" exitCode=0 Jun 03 03:29:25.247571 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.247202 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" event={"ID":"432cd8b7-a015-44df-a40d-c947137d1f03","Type":"ContainerDied","Data":"3680ea76e133123669f592a9536db97e0b7de6162f1c07259e595d7677654362"} Jun 03 03:29:25.248655 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.248629 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" event={"ID":"bca53924-d1ef-4049-a661-645bbdc43411","Type":"ContainerDied","Data":"09ade7b1fa97652a7cf04df1c55a2f6cc5709a450a2873117db79e7c6d008b46"} Jun 03 03:29:25.248773 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.248659 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09ade7b1fa97652a7cf04df1c55a2f6cc5709a450a2873117db79e7c6d008b46" Jun 03 03:29:25.248773 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.248674 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p" Jun 03 03:29:25.388595 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.388574 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:25.419252 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.419229 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:25.499445 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.499381 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-util\") pod \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " Jun 03 03:29:25.499445 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.499422 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65m6d\" (UniqueName: \"kubernetes.io/projected/f7ea567f-8b89-4577-8967-57c331dbd4e6-kube-api-access-65m6d\") pod \"f7ea567f-8b89-4577-8967-57c331dbd4e6\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " Jun 03 03:29:25.499620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.499492 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-bundle\") pod \"f7ea567f-8b89-4577-8967-57c331dbd4e6\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " Jun 03 03:29:25.499620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.499532 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-util\") pod \"f7ea567f-8b89-4577-8967-57c331dbd4e6\" (UID: \"f7ea567f-8b89-4577-8967-57c331dbd4e6\") " Jun 03 03:29:25.499620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.499552 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-bundle\") pod \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " Jun 03 03:29:25.499620 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.499581 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmfmt\" (UniqueName: \"kubernetes.io/projected/fddc18bd-5dc4-4782-a6f9-28284c32b49e-kube-api-access-cmfmt\") pod \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\" (UID: \"fddc18bd-5dc4-4782-a6f9-28284c32b49e\") " Jun 03 03:29:25.500145 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.500113 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-bundle" (OuterVolumeSpecName: "bundle") pod "fddc18bd-5dc4-4782-a6f9-28284c32b49e" (UID: "fddc18bd-5dc4-4782-a6f9-28284c32b49e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:25.500289 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.500209 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-bundle" (OuterVolumeSpecName: "bundle") pod "f7ea567f-8b89-4577-8967-57c331dbd4e6" (UID: "f7ea567f-8b89-4577-8967-57c331dbd4e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:25.501739 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.501710 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ea567f-8b89-4577-8967-57c331dbd4e6-kube-api-access-65m6d" (OuterVolumeSpecName: "kube-api-access-65m6d") pod "f7ea567f-8b89-4577-8967-57c331dbd4e6" (UID: "f7ea567f-8b89-4577-8967-57c331dbd4e6"). InnerVolumeSpecName "kube-api-access-65m6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:29:25.501861 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.501793 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddc18bd-5dc4-4782-a6f9-28284c32b49e-kube-api-access-cmfmt" (OuterVolumeSpecName: "kube-api-access-cmfmt") pod "fddc18bd-5dc4-4782-a6f9-28284c32b49e" (UID: "fddc18bd-5dc4-4782-a6f9-28284c32b49e"). InnerVolumeSpecName "kube-api-access-cmfmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:29:25.504943 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.504908 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-util" (OuterVolumeSpecName: "util") pod "fddc18bd-5dc4-4782-a6f9-28284c32b49e" (UID: "fddc18bd-5dc4-4782-a6f9-28284c32b49e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:25.505356 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.505339 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-util" (OuterVolumeSpecName: "util") pod "f7ea567f-8b89-4577-8967-57c331dbd4e6" (UID: "f7ea567f-8b89-4577-8967-57c331dbd4e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:25.601066 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.601043 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:25.601066 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.601065 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ea567f-8b89-4577-8967-57c331dbd4e6-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:25.601203 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.601075 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:25.601203 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.601086 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmfmt\" (UniqueName: \"kubernetes.io/projected/fddc18bd-5dc4-4782-a6f9-28284c32b49e-kube-api-access-cmfmt\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:25.601203 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.601095 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fddc18bd-5dc4-4782-a6f9-28284c32b49e-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:25.601203 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:25.601104 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65m6d\" (UniqueName: \"kubernetes.io/projected/f7ea567f-8b89-4577-8967-57c331dbd4e6-kube-api-access-65m6d\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:26.253789 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.253744 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" event={"ID":"fddc18bd-5dc4-4782-a6f9-28284c32b49e","Type":"ContainerDied","Data":"c27da46ca8df74704d2b4de2d5e63329ddd43efb2b0bdd0743057ff43b709a7a"} Jun 03 03:29:26.253789 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.253788 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c27da46ca8df74704d2b4de2d5e63329ddd43efb2b0bdd0743057ff43b709a7a" Jun 03 03:29:26.254260 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.253801 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k" Jun 03 03:29:26.255497 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.255478 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" Jun 03 03:29:26.255605 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.255498 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q" event={"ID":"f7ea567f-8b89-4577-8967-57c331dbd4e6","Type":"ContainerDied","Data":"edbfba034dbaf532e2cfdae1a2f92c7d2e63b35cd27181b30db8417ceadd5084"} Jun 03 03:29:26.255605 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.255526 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edbfba034dbaf532e2cfdae1a2f92c7d2e63b35cd27181b30db8417ceadd5084" Jun 03 03:29:26.381855 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.381832 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:26.508243 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.508127 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-util\") pod \"432cd8b7-a015-44df-a40d-c947137d1f03\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " Jun 03 03:29:26.508243 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.508212 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bjmj\" (UniqueName: \"kubernetes.io/projected/432cd8b7-a015-44df-a40d-c947137d1f03-kube-api-access-2bjmj\") pod \"432cd8b7-a015-44df-a40d-c947137d1f03\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " Jun 03 03:29:26.508467 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.508301 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-bundle\") pod \"432cd8b7-a015-44df-a40d-c947137d1f03\" (UID: \"432cd8b7-a015-44df-a40d-c947137d1f03\") " Jun 03 03:29:26.508782 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.508752 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-bundle" (OuterVolumeSpecName: "bundle") pod "432cd8b7-a015-44df-a40d-c947137d1f03" (UID: "432cd8b7-a015-44df-a40d-c947137d1f03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:26.510307 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.510277 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432cd8b7-a015-44df-a40d-c947137d1f03-kube-api-access-2bjmj" (OuterVolumeSpecName: "kube-api-access-2bjmj") pod "432cd8b7-a015-44df-a40d-c947137d1f03" (UID: "432cd8b7-a015-44df-a40d-c947137d1f03"). InnerVolumeSpecName "kube-api-access-2bjmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:29:26.515732 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.515706 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-util" (OuterVolumeSpecName: "util") pod "432cd8b7-a015-44df-a40d-c947137d1f03" (UID: "432cd8b7-a015-44df-a40d-c947137d1f03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:29:26.609371 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.609346 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:26.609371 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.609368 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bjmj\" (UniqueName: \"kubernetes.io/projected/432cd8b7-a015-44df-a40d-c947137d1f03-kube-api-access-2bjmj\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:26.609496 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:26.609380 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432cd8b7-a015-44df-a40d-c947137d1f03-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:29:27.260705 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:27.260671 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" event={"ID":"432cd8b7-a015-44df-a40d-c947137d1f03","Type":"ContainerDied","Data":"b43518669d02d69c0045e2f48a9147d6d5ed38437fe6ecc001c4326ff2bf33ef"} Jun 03 03:29:27.260705 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:27.260704 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b43518669d02d69c0045e2f48a9147d6d5ed38437fe6ecc001c4326ff2bf33ef" Jun 03 03:29:27.260705 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:27.260680 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7" Jun 03 03:29:48.233926 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.233883 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c7c99655d-7txzk"] Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234314 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="pull" Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234328 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="pull" Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234340 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="extract" Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234346 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="extract" Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234354 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="util" Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234360 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="util" Jun 03 03:29:48.234369 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234372 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="pull" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234378 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="pull" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234389 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234394 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234401 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="util" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234406 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="util" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234411 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="pull" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234416 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="pull" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234423 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234428 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234435 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="util" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234440 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="util" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234446 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="util" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234451 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="util" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234457 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234461 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234469 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="pull" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234474 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="pull" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234528 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="bca53924-d1ef-4049-a661-645bbdc43411" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234535 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7ea567f-8b89-4577-8967-57c331dbd4e6" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234543 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="fddc18bd-5dc4-4782-a6f9-28284c32b49e" containerName="extract" Jun 03 03:29:48.234583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.234550 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="432cd8b7-a015-44df-a40d-c947137d1f03" containerName="extract" Jun 03 03:29:48.237669 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.237652 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.248976 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.248941 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7c99655d-7txzk"] Jun 03 03:29:48.299768 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.299728 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-trusted-ca-bundle\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.299953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.299798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-console-config\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.299953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.299846 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-oauth-serving-cert\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.299953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.299888 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfc47\" (UniqueName: \"kubernetes.io/projected/b5026a23-1496-46ad-81ce-ce588df00f01-kube-api-access-bfc47\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.299953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.299916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5026a23-1496-46ad-81ce-ce588df00f01-console-serving-cert\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.299953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.299933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-service-ca\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.300112 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.300015 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5026a23-1496-46ad-81ce-ce588df00f01-console-oauth-config\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401269 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401191 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-trusted-ca-bundle\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401304 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-console-config\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401345 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-oauth-serving-cert\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401388 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfc47\" (UniqueName: \"kubernetes.io/projected/b5026a23-1496-46ad-81ce-ce588df00f01-kube-api-access-bfc47\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401422 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5026a23-1496-46ad-81ce-ce588df00f01-console-serving-cert\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401448 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-service-ca\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.401495 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.401477 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5026a23-1496-46ad-81ce-ce588df00f01-console-oauth-config\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.402125 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.402094 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-console-config\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.402257 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.402171 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-trusted-ca-bundle\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.402257 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.402204 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-oauth-serving-cert\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.402393 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.402204 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5026a23-1496-46ad-81ce-ce588df00f01-service-ca\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.404114 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.404094 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5026a23-1496-46ad-81ce-ce588df00f01-console-oauth-config\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.404205 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.404155 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5026a23-1496-46ad-81ce-ce588df00f01-console-serving-cert\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.410520 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.410494 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfc47\" (UniqueName: \"kubernetes.io/projected/b5026a23-1496-46ad-81ce-ce588df00f01-kube-api-access-bfc47\") pod \"console-c7c99655d-7txzk\" (UID: \"b5026a23-1496-46ad-81ce-ce588df00f01\") " pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.548558 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.548461 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:48.683507 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:48.683477 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7c99655d-7txzk"] Jun 03 03:29:48.685058 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:29:48.685031 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5026a23_1496_46ad_81ce_ce588df00f01.slice/crio-ed978a73da47280603f4e8c457617ab89789614f371bfb96ebf11eb53b07c5b0 WatchSource:0}: Error finding container ed978a73da47280603f4e8c457617ab89789614f371bfb96ebf11eb53b07c5b0: Status 404 returned error can't find the container with id ed978a73da47280603f4e8c457617ab89789614f371bfb96ebf11eb53b07c5b0 Jun 03 03:29:49.352454 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:49.352416 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7c99655d-7txzk" event={"ID":"b5026a23-1496-46ad-81ce-ce588df00f01","Type":"ContainerStarted","Data":"c0871787954204da662ed14ff47ec45105b851c3c97c45653f893b13d0892461"} Jun 03 03:29:49.352454 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:49.352460 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7c99655d-7txzk" event={"ID":"b5026a23-1496-46ad-81ce-ce588df00f01","Type":"ContainerStarted","Data":"ed978a73da47280603f4e8c457617ab89789614f371bfb96ebf11eb53b07c5b0"} Jun 03 03:29:49.369438 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:49.369388 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c7c99655d-7txzk" podStartSLOduration=1.369372893 podStartE2EDuration="1.369372893s" podCreationTimestamp="2026-06-03 03:29:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:29:49.368534341 +0000 UTC m=+564.530258015" watchObservedRunningTime="2026-06-03 03:29:49.369372893 +0000 UTC m=+564.531096564" Jun 03 03:29:53.812481 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.812434 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928"] Jun 03 03:29:53.816978 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.816954 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:53.819589 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.819559 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 03:29:53.819839 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.819808 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxdrd\"" Jun 03 03:29:53.819958 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.819831 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 03:29:53.820135 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.820114 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 03:29:53.820292 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.820271 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 03:29:53.822760 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.822732 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928"] Jun 03 03:29:53.957810 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.957773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bba0c57-08f5-422e-9890-72b33bad8758-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:53.958006 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.957902 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xhbt\" (UniqueName: \"kubernetes.io/projected/9bba0c57-08f5-422e-9890-72b33bad8758-kube-api-access-5xhbt\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:53.958006 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:53.957958 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bba0c57-08f5-422e-9890-72b33bad8758-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.058585 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.058547 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bba0c57-08f5-422e-9890-72b33bad8758-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.058777 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.058613 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bba0c57-08f5-422e-9890-72b33bad8758-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.058777 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.058720 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xhbt\" (UniqueName: \"kubernetes.io/projected/9bba0c57-08f5-422e-9890-72b33bad8758-kube-api-access-5xhbt\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.059322 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.059298 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bba0c57-08f5-422e-9890-72b33bad8758-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.061081 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.061059 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bba0c57-08f5-422e-9890-72b33bad8758-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.066123 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.066061 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xhbt\" (UniqueName: \"kubernetes.io/projected/9bba0c57-08f5-422e-9890-72b33bad8758-kube-api-access-5xhbt\") pod \"kuadrant-console-plugin-6cb54b5c86-74928\" (UID: \"9bba0c57-08f5-422e-9890-72b33bad8758\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.128815 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.128760 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" Jun 03 03:29:54.270420 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.270392 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928"] Jun 03 03:29:54.272506 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:29:54.272475 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bba0c57_08f5_422e_9890_72b33bad8758.slice/crio-3322f5668a08c56e435172f8497e3e5590bc995be06ae92c8c0defe812438a98 WatchSource:0}: Error finding container 3322f5668a08c56e435172f8497e3e5590bc995be06ae92c8c0defe812438a98: Status 404 returned error can't find the container with id 3322f5668a08c56e435172f8497e3e5590bc995be06ae92c8c0defe812438a98 Jun 03 03:29:54.376177 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:54.376088 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" event={"ID":"9bba0c57-08f5-422e-9890-72b33bad8758","Type":"ContainerStarted","Data":"3322f5668a08c56e435172f8497e3e5590bc995be06ae92c8c0defe812438a98"} Jun 03 03:29:58.549120 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:58.549076 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:58.549120 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:58.549131 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:58.554179 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:58.554150 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:59.406389 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:59.406334 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c7c99655d-7txzk" Jun 03 03:29:59.452866 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:29:59.452818 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694f7494f6-76gdl"] Jun 03 03:30:04.188107 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.188065 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n"] Jun 03 03:30:04.196474 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.196441 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:04.203354 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.200554 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bxn2f\"" Jun 03 03:30:04.205114 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.205059 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n"] Jun 03 03:30:04.363110 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.363059 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9s28\" (UniqueName: \"kubernetes.io/projected/7ccde92c-5a62-4d39-a279-338c6f283458-kube-api-access-g9s28\") pod \"limitador-operator-controller-manager-85c4996f8c-d4j6n\" (UID: \"7ccde92c-5a62-4d39-a279-338c6f283458\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:04.464587 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.464482 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9s28\" (UniqueName: \"kubernetes.io/projected/7ccde92c-5a62-4d39-a279-338c6f283458-kube-api-access-g9s28\") pod \"limitador-operator-controller-manager-85c4996f8c-d4j6n\" (UID: \"7ccde92c-5a62-4d39-a279-338c6f283458\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:04.481835 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.481793 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9s28\" (UniqueName: \"kubernetes.io/projected/7ccde92c-5a62-4d39-a279-338c6f283458-kube-api-access-g9s28\") pod \"limitador-operator-controller-manager-85c4996f8c-d4j6n\" (UID: \"7ccde92c-5a62-4d39-a279-338c6f283458\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:04.514917 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:04.514875 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:18.317252 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:18.317200 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n"] Jun 03 03:30:18.319051 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:30:18.319022 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccde92c_5a62_4d39_a279_338c6f283458.slice/crio-cd8caad5ae83c007278626a3f962b1b4ca3791b85f51627fc46c7c4b96be195e WatchSource:0}: Error finding container cd8caad5ae83c007278626a3f962b1b4ca3791b85f51627fc46c7c4b96be195e: Status 404 returned error can't find the container with id cd8caad5ae83c007278626a3f962b1b4ca3791b85f51627fc46c7c4b96be195e Jun 03 03:30:18.493137 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:18.493037 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" event={"ID":"9bba0c57-08f5-422e-9890-72b33bad8758","Type":"ContainerStarted","Data":"ef208040ad45d70201d28262ff7871b87e3bcf07db1a1f49661efcd384f704b8"} Jun 03 03:30:18.494317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:18.494289 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" event={"ID":"7ccde92c-5a62-4d39-a279-338c6f283458","Type":"ContainerStarted","Data":"cd8caad5ae83c007278626a3f962b1b4ca3791b85f51627fc46c7c4b96be195e"} Jun 03 03:30:18.522933 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:18.522877 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-74928" podStartSLOduration=1.527881162 podStartE2EDuration="25.522860573s" podCreationTimestamp="2026-06-03 03:29:53 +0000 UTC" firstStartedPulling="2026-06-03 03:29:54.273862388 +0000 UTC m=+569.435586036" lastFinishedPulling="2026-06-03 03:30:18.268841786 +0000 UTC m=+593.430565447" observedRunningTime="2026-06-03 03:30:18.521514937 +0000 UTC m=+593.683238589" watchObservedRunningTime="2026-06-03 03:30:18.522860573 +0000 UTC m=+593.684584280" Jun 03 03:30:20.503629 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:20.503574 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" event={"ID":"7ccde92c-5a62-4d39-a279-338c6f283458","Type":"ContainerStarted","Data":"9ab8c4cdac151d4c98f9443af5c6c83dc9de558f8395f2c76a428b17bc881037"} Jun 03 03:30:20.504129 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:20.503691 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:20.532365 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:20.532305 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" podStartSLOduration=14.923295722 podStartE2EDuration="16.53228824s" podCreationTimestamp="2026-06-03 03:30:04 +0000 UTC" firstStartedPulling="2026-06-03 03:30:18.320950497 +0000 UTC m=+593.482674147" lastFinishedPulling="2026-06-03 03:30:19.929943013 +0000 UTC m=+595.091666665" observedRunningTime="2026-06-03 03:30:20.530377725 +0000 UTC m=+595.692101397" watchObservedRunningTime="2026-06-03 03:30:20.53228824 +0000 UTC m=+595.694011910" Jun 03 03:30:24.482103 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.482064 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-694f7494f6-76gdl" podUID="ffd8ecff-7798-4876-b912-599b51bf661a" containerName="console" containerID="cri-o://042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028" gracePeriod=15 Jun 03 03:30:24.735244 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.735157 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-694f7494f6-76gdl_ffd8ecff-7798-4876-b912-599b51bf661a/console/0.log" Jun 03 03:30:24.735244 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.735238 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:30:24.769021 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.768987 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-trusted-ca-bundle\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769248 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769053 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-serving-cert\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769248 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769092 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-oauth-serving-cert\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769248 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769147 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z6q7\" (UniqueName: \"kubernetes.io/projected/ffd8ecff-7798-4876-b912-599b51bf661a-kube-api-access-5z6q7\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769248 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769180 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-service-ca\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769248 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769241 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-oauth-config\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769506 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769287 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-console-config\") pod \"ffd8ecff-7798-4876-b912-599b51bf661a\" (UID: \"ffd8ecff-7798-4876-b912-599b51bf661a\") " Jun 03 03:30:24.769602 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769452 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:30:24.769664 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769628 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:30:24.769915 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.769880 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-console-config" (OuterVolumeSpecName: "console-config") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:30:24.770056 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.770031 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:30:24.771907 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.771877 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:30:24.772014 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.771939 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd8ecff-7798-4876-b912-599b51bf661a-kube-api-access-5z6q7" (OuterVolumeSpecName: "kube-api-access-5z6q7") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "kube-api-access-5z6q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:30:24.772014 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.771945 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffd8ecff-7798-4876-b912-599b51bf661a" (UID: "ffd8ecff-7798-4876-b912-599b51bf661a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:30:24.870819 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870779 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z6q7\" (UniqueName: \"kubernetes.io/projected/ffd8ecff-7798-4876-b912-599b51bf661a-kube-api-access-5z6q7\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:24.870819 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870813 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-service-ca\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:24.870819 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870823 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-oauth-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:24.871133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870832 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-console-config\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:24.871133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870841 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-trusted-ca-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:24.871133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870850 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffd8ecff-7798-4876-b912-599b51bf661a-console-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:24.871133 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:24.870858 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffd8ecff-7798-4876-b912-599b51bf661a-oauth-serving-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:30:25.376631 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.376597 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-694f7494f6-76gdl_ffd8ecff-7798-4876-b912-599b51bf661a/console/0.log" Jun 03 03:30:25.376847 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.376775 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-694f7494f6-76gdl_ffd8ecff-7798-4876-b912-599b51bf661a/console/0.log" Jun 03 03:30:25.391253 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.391212 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:30:25.391433 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.391276 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:30:25.526230 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.526181 2570 generic.go:358] "Generic (PLEG): container finished" podID="ffd8ecff-7798-4876-b912-599b51bf661a" containerID="042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028" exitCode=2 Jun 03 03:30:25.526649 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.526264 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694f7494f6-76gdl" event={"ID":"ffd8ecff-7798-4876-b912-599b51bf661a","Type":"ContainerDied","Data":"042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028"} Jun 03 03:30:25.526649 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.526280 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694f7494f6-76gdl" Jun 03 03:30:25.526649 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.526313 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694f7494f6-76gdl" event={"ID":"ffd8ecff-7798-4876-b912-599b51bf661a","Type":"ContainerDied","Data":"692c6fe3a71af0998faf26bca08ae2639ce3a0e2fd4a3b2816ef8401a9e45275"} Jun 03 03:30:25.526649 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.526333 2570 scope.go:117] "RemoveContainer" containerID="042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028" Jun 03 03:30:25.535403 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.535296 2570 scope.go:117] "RemoveContainer" containerID="042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028" Jun 03 03:30:25.535634 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:30:25.535614 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028\": container with ID starting with 042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028 not found: ID does not exist" containerID="042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028" Jun 03 03:30:25.535682 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.535644 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028"} err="failed to get container status \"042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028\": rpc error: code = NotFound desc = could not find container \"042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028\": container with ID starting with 042f141816239e5b10379272eed017e187fca28d95ff14f8e0817c24710fb028 not found: ID does not exist" Jun 03 03:30:25.562455 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.562415 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694f7494f6-76gdl"] Jun 03 03:30:25.565061 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:25.565030 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-694f7494f6-76gdl"] Jun 03 03:30:27.418037 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:27.418001 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd8ecff-7798-4876-b912-599b51bf661a" path="/var/lib/kubelet/pods/ffd8ecff-7798-4876-b912-599b51bf661a/volumes" Jun 03 03:30:31.510309 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:31.510277 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d4j6n" Jun 03 03:30:53.822269 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.822198 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-64grg"] Jun 03 03:30:53.822707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.822686 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd8ecff-7798-4876-b912-599b51bf661a" containerName="console" Jun 03 03:30:53.822707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.822701 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd8ecff-7798-4876-b912-599b51bf661a" containerName="console" Jun 03 03:30:53.822787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.822757 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffd8ecff-7798-4876-b912-599b51bf661a" containerName="console" Jun 03 03:30:53.920877 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.920832 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-64grg"] Jun 03 03:30:53.921057 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.920977 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:30:53.923556 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.923513 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8f24r\"" Jun 03 03:30:53.945342 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:53.945306 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9n7\" (UniqueName: \"kubernetes.io/projected/6b48215e-48f5-4dc4-ad8e-cca287a0abc4-kube-api-access-cx9n7\") pod \"authorino-f99f4b5cd-64grg\" (UID: \"6b48215e-48f5-4dc4-ad8e-cca287a0abc4\") " pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:30:54.046486 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:54.046442 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9n7\" (UniqueName: \"kubernetes.io/projected/6b48215e-48f5-4dc4-ad8e-cca287a0abc4-kube-api-access-cx9n7\") pod \"authorino-f99f4b5cd-64grg\" (UID: \"6b48215e-48f5-4dc4-ad8e-cca287a0abc4\") " pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:30:54.054911 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:54.054873 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9n7\" (UniqueName: \"kubernetes.io/projected/6b48215e-48f5-4dc4-ad8e-cca287a0abc4-kube-api-access-cx9n7\") pod \"authorino-f99f4b5cd-64grg\" (UID: \"6b48215e-48f5-4dc4-ad8e-cca287a0abc4\") " pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:30:54.230914 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:54.230876 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:30:54.362646 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:54.362619 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-64grg"] Jun 03 03:30:54.364691 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:30:54.364655 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b48215e_48f5_4dc4_ad8e_cca287a0abc4.slice/crio-18c716c83d17a66c48ae33db9f115dde8cd5bc98267b09e7ba5f3699bb3dd00b WatchSource:0}: Error finding container 18c716c83d17a66c48ae33db9f115dde8cd5bc98267b09e7ba5f3699bb3dd00b: Status 404 returned error can't find the container with id 18c716c83d17a66c48ae33db9f115dde8cd5bc98267b09e7ba5f3699bb3dd00b Jun 03 03:30:54.658341 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:54.658239 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-64grg" event={"ID":"6b48215e-48f5-4dc4-ad8e-cca287a0abc4","Type":"ContainerStarted","Data":"18c716c83d17a66c48ae33db9f115dde8cd5bc98267b09e7ba5f3699bb3dd00b"} Jun 03 03:30:58.677873 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:58.677835 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-64grg" event={"ID":"6b48215e-48f5-4dc4-ad8e-cca287a0abc4","Type":"ContainerStarted","Data":"dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69"} Jun 03 03:30:58.692642 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:58.692589 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-64grg" podStartSLOduration=2.393905172 podStartE2EDuration="5.692573314s" podCreationTimestamp="2026-06-03 03:30:53 +0000 UTC" firstStartedPulling="2026-06-03 03:30:54.366268379 +0000 UTC m=+629.527992029" lastFinishedPulling="2026-06-03 03:30:57.664936523 +0000 UTC m=+632.826660171" observedRunningTime="2026-06-03 03:30:58.691195005 +0000 UTC m=+633.852918677" watchObservedRunningTime="2026-06-03 03:30:58.692573314 +0000 UTC m=+633.854296984" Jun 03 03:30:59.438626 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:30:59.438576 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-64grg"] Jun 03 03:31:00.685614 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:00.685550 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-64grg" podUID="6b48215e-48f5-4dc4-ad8e-cca287a0abc4" containerName="authorino" containerID="cri-o://dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69" gracePeriod=30 Jun 03 03:31:00.940023 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:00.939954 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:31:01.016022 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.015983 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx9n7\" (UniqueName: \"kubernetes.io/projected/6b48215e-48f5-4dc4-ad8e-cca287a0abc4-kube-api-access-cx9n7\") pod \"6b48215e-48f5-4dc4-ad8e-cca287a0abc4\" (UID: \"6b48215e-48f5-4dc4-ad8e-cca287a0abc4\") " Jun 03 03:31:01.018166 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.018118 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b48215e-48f5-4dc4-ad8e-cca287a0abc4-kube-api-access-cx9n7" (OuterVolumeSpecName: "kube-api-access-cx9n7") pod "6b48215e-48f5-4dc4-ad8e-cca287a0abc4" (UID: "6b48215e-48f5-4dc4-ad8e-cca287a0abc4"). InnerVolumeSpecName "kube-api-access-cx9n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:31:01.117280 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.117230 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx9n7\" (UniqueName: \"kubernetes.io/projected/6b48215e-48f5-4dc4-ad8e-cca287a0abc4-kube-api-access-cx9n7\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:31:01.690697 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.690656 2570 generic.go:358] "Generic (PLEG): container finished" podID="6b48215e-48f5-4dc4-ad8e-cca287a0abc4" containerID="dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69" exitCode=0 Jun 03 03:31:01.691180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.690708 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-64grg" Jun 03 03:31:01.691180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.690708 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-64grg" event={"ID":"6b48215e-48f5-4dc4-ad8e-cca287a0abc4","Type":"ContainerDied","Data":"dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69"} Jun 03 03:31:01.691180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.690809 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-64grg" event={"ID":"6b48215e-48f5-4dc4-ad8e-cca287a0abc4","Type":"ContainerDied","Data":"18c716c83d17a66c48ae33db9f115dde8cd5bc98267b09e7ba5f3699bb3dd00b"} Jun 03 03:31:01.691180 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.690825 2570 scope.go:117] "RemoveContainer" containerID="dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69" Jun 03 03:31:01.700014 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.699993 2570 scope.go:117] "RemoveContainer" containerID="dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69" Jun 03 03:31:01.700336 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:31:01.700314 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69\": container with ID starting with dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69 not found: ID does not exist" containerID="dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69" Jun 03 03:31:01.700423 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.700345 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69"} err="failed to get container status \"dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69\": rpc error: code = NotFound desc = could not find container \"dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69\": container with ID starting with dea6d7998bf93f0bf7e08096e73fcd6d592e8c4bd5c6d6517a748943a77a1f69 not found: ID does not exist" Jun 03 03:31:01.706102 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.706073 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-64grg"] Jun 03 03:31:01.708413 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:01.708391 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-64grg"] Jun 03 03:31:03.417139 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:03.417103 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b48215e-48f5-4dc4-ad8e-cca287a0abc4" path="/var/lib/kubelet/pods/6b48215e-48f5-4dc4-ad8e-cca287a0abc4/volumes" Jun 03 03:31:22.882309 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.882270 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s"] Jun 03 03:31:22.882717 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.882691 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b48215e-48f5-4dc4-ad8e-cca287a0abc4" containerName="authorino" Jun 03 03:31:22.882717 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.882705 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b48215e-48f5-4dc4-ad8e-cca287a0abc4" containerName="authorino" Jun 03 03:31:22.882807 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.882769 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b48215e-48f5-4dc4-ad8e-cca287a0abc4" containerName="authorino" Jun 03 03:31:22.885605 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.885588 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:22.887980 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.887956 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 03:31:22.888794 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.888774 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g29c4\"" Jun 03 03:31:22.888862 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.888774 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 03:31:22.894554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:22.894530 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s"] Jun 03 03:31:23.026844 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.026808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.026844 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.026857 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.027055 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.026933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw52v\" (UniqueName: \"kubernetes.io/projected/b517e112-1ae6-4a91-b191-5ed8d635619f-kube-api-access-gw52v\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.127852 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.127805 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gw52v\" (UniqueName: \"kubernetes.io/projected/b517e112-1ae6-4a91-b191-5ed8d635619f-kube-api-access-gw52v\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.128040 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.127902 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.128040 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.127928 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.128322 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.128306 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.128389 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.128370 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.142504 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.142428 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw52v\" (UniqueName: \"kubernetes.io/projected/b517e112-1ae6-4a91-b191-5ed8d635619f-kube-api-access-gw52v\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.196578 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.196539 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:23.330325 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.330295 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s"] Jun 03 03:31:23.332081 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:31:23.332053 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb517e112_1ae6_4a91_b191_5ed8d635619f.slice/crio-77edd494fbfef2c6e4607e41cb3193c9e09cc0787a844f1d57414dc8c6d22ab2 WatchSource:0}: Error finding container 77edd494fbfef2c6e4607e41cb3193c9e09cc0787a844f1d57414dc8c6d22ab2: Status 404 returned error can't find the container with id 77edd494fbfef2c6e4607e41cb3193c9e09cc0787a844f1d57414dc8c6d22ab2 Jun 03 03:31:23.334003 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.333986 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:31:23.780405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.780299 2570 generic.go:358] "Generic (PLEG): container finished" podID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerID="89ae43954f18d5a1af5a8bf8060db476a17bca208096e93a9388bb944846e151" exitCode=0 Jun 03 03:31:23.780405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.780354 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" event={"ID":"b517e112-1ae6-4a91-b191-5ed8d635619f","Type":"ContainerDied","Data":"89ae43954f18d5a1af5a8bf8060db476a17bca208096e93a9388bb944846e151"} Jun 03 03:31:23.780405 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:23.780383 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" event={"ID":"b517e112-1ae6-4a91-b191-5ed8d635619f","Type":"ContainerStarted","Data":"77edd494fbfef2c6e4607e41cb3193c9e09cc0787a844f1d57414dc8c6d22ab2"} Jun 03 03:31:24.786284 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:24.786244 2570 generic.go:358] "Generic (PLEG): container finished" podID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerID="fd86cd064f28bbf061e76929dd06fa6d77b57049a72d54f3925d446c52b7c1d0" exitCode=0 Jun 03 03:31:24.786284 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:24.786288 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" event={"ID":"b517e112-1ae6-4a91-b191-5ed8d635619f","Type":"ContainerDied","Data":"fd86cd064f28bbf061e76929dd06fa6d77b57049a72d54f3925d446c52b7c1d0"} Jun 03 03:31:25.792186 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:25.792148 2570 generic.go:358] "Generic (PLEG): container finished" podID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerID="62a0ade6efb5d0fef421f539daa222f19763351c726f1ac013ac9ee203438e5f" exitCode=0 Jun 03 03:31:25.792627 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:25.792255 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" event={"ID":"b517e112-1ae6-4a91-b191-5ed8d635619f","Type":"ContainerDied","Data":"62a0ade6efb5d0fef421f539daa222f19763351c726f1ac013ac9ee203438e5f"} Jun 03 03:31:26.930179 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:26.930154 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:27.068981 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.068876 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-util\") pod \"b517e112-1ae6-4a91-b191-5ed8d635619f\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " Jun 03 03:31:27.068981 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.068978 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-bundle\") pod \"b517e112-1ae6-4a91-b191-5ed8d635619f\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " Jun 03 03:31:27.069190 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.069009 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw52v\" (UniqueName: \"kubernetes.io/projected/b517e112-1ae6-4a91-b191-5ed8d635619f-kube-api-access-gw52v\") pod \"b517e112-1ae6-4a91-b191-5ed8d635619f\" (UID: \"b517e112-1ae6-4a91-b191-5ed8d635619f\") " Jun 03 03:31:27.069488 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.069459 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-bundle" (OuterVolumeSpecName: "bundle") pod "b517e112-1ae6-4a91-b191-5ed8d635619f" (UID: "b517e112-1ae6-4a91-b191-5ed8d635619f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:31:27.071228 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.071191 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b517e112-1ae6-4a91-b191-5ed8d635619f-kube-api-access-gw52v" (OuterVolumeSpecName: "kube-api-access-gw52v") pod "b517e112-1ae6-4a91-b191-5ed8d635619f" (UID: "b517e112-1ae6-4a91-b191-5ed8d635619f"). InnerVolumeSpecName "kube-api-access-gw52v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:31:27.074947 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.074922 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-util" (OuterVolumeSpecName: "util") pod "b517e112-1ae6-4a91-b191-5ed8d635619f" (UID: "b517e112-1ae6-4a91-b191-5ed8d635619f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:31:27.169864 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.169818 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-bundle\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:31:27.169864 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.169856 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw52v\" (UniqueName: \"kubernetes.io/projected/b517e112-1ae6-4a91-b191-5ed8d635619f-kube-api-access-gw52v\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:31:27.169864 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.169868 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b517e112-1ae6-4a91-b191-5ed8d635619f-util\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:31:27.801458 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.801427 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" Jun 03 03:31:27.801646 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.801426 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gsj6s" event={"ID":"b517e112-1ae6-4a91-b191-5ed8d635619f","Type":"ContainerDied","Data":"77edd494fbfef2c6e4607e41cb3193c9e09cc0787a844f1d57414dc8c6d22ab2"} Jun 03 03:31:27.801646 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:27.801542 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77edd494fbfef2c6e4607e41cb3193c9e09cc0787a844f1d57414dc8c6d22ab2" Jun 03 03:31:45.891166 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891127 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:31:45.891658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891564 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="util" Jun 03 03:31:45.891658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891576 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="util" Jun 03 03:31:45.891658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891595 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="pull" Jun 03 03:31:45.891658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891600 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="pull" Jun 03 03:31:45.891658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891607 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="extract" Jun 03 03:31:45.891658 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891612 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="extract" Jun 03 03:31:45.891844 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.891674 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="b517e112-1ae6-4a91-b191-5ed8d635619f" containerName="extract" Jun 03 03:31:45.894686 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.894669 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:45.896914 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.896889 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 03:31:45.897053 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.896889 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 03:31:45.897653 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.897638 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6lp6w\"" Jun 03 03:31:45.897729 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.897704 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 03:31:45.901855 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.901831 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:31:45.944704 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:45.944662 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnv5f\" (UniqueName: \"kubernetes.io/projected/d99bf1ec-88fe-4294-a844-bad0b227536f-kube-api-access-nnv5f\") pod \"maas-keycloak-0\" (UID: \"d99bf1ec-88fe-4294-a844-bad0b227536f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:46.045246 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:46.045184 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnv5f\" (UniqueName: \"kubernetes.io/projected/d99bf1ec-88fe-4294-a844-bad0b227536f-kube-api-access-nnv5f\") pod \"maas-keycloak-0\" (UID: \"d99bf1ec-88fe-4294-a844-bad0b227536f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:46.053210 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:46.053185 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnv5f\" (UniqueName: \"kubernetes.io/projected/d99bf1ec-88fe-4294-a844-bad0b227536f-kube-api-access-nnv5f\") pod \"maas-keycloak-0\" (UID: \"d99bf1ec-88fe-4294-a844-bad0b227536f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:46.205720 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:46.205679 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:46.346385 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:46.346351 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:31:46.347488 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:31:46.347448 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99bf1ec_88fe_4294_a844_bad0b227536f.slice/crio-79b23f0443f3a01267f27abeac212930fd490ae6b846708de9f84de2d1908764 WatchSource:0}: Error finding container 79b23f0443f3a01267f27abeac212930fd490ae6b846708de9f84de2d1908764: Status 404 returned error can't find the container with id 79b23f0443f3a01267f27abeac212930fd490ae6b846708de9f84de2d1908764 Jun 03 03:31:46.883140 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:46.883101 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d99bf1ec-88fe-4294-a844-bad0b227536f","Type":"ContainerStarted","Data":"79b23f0443f3a01267f27abeac212930fd490ae6b846708de9f84de2d1908764"} Jun 03 03:31:52.911999 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:52.911961 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d99bf1ec-88fe-4294-a844-bad0b227536f","Type":"ContainerStarted","Data":"d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666"} Jun 03 03:31:52.931520 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:52.931443 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.59073937 podStartE2EDuration="7.93142182s" podCreationTimestamp="2026-06-03 03:31:45 +0000 UTC" firstStartedPulling="2026-06-03 03:31:46.348839296 +0000 UTC m=+681.510562945" lastFinishedPulling="2026-06-03 03:31:52.689521734 +0000 UTC m=+687.851245395" observedRunningTime="2026-06-03 03:31:52.927051532 +0000 UTC m=+688.088775214" watchObservedRunningTime="2026-06-03 03:31:52.93142182 +0000 UTC m=+688.093145503" Jun 03 03:31:53.206380 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:53.206325 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:53.208235 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:53.208172 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:31:54.206883 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:54.206827 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:31:55.207335 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:55.207272 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:31:56.206861 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:56.206811 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 03:31:56.207175 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:56.207129 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:31:57.207261 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:57.207181 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:31:58.206533 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:58.206479 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:31:59.206307 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:31:59.206209 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:00.206734 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:00.206672 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:01.206804 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:01.206756 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:02.206277 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:02.206199 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:03.206879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:03.206823 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:04.206969 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:04.206909 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:05.206750 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:05.206679 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:06.206228 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:06.206164 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.47:9000/health/started\": dial tcp 10.134.0.47:9000: connect: connection refused" Jun 03 03:32:07.344114 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:07.344060 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 03:32:07.365617 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:07.365569 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 03:32:17.351351 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:17.351246 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 03:32:18.447126 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.447082 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66f76b575d-5zmr9"] Jun 03 03:32:18.450624 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.450606 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:18.452967 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.452941 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8f24r\"" Jun 03 03:32:18.458196 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.458166 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f76b575d-5zmr9"] Jun 03 03:32:18.470179 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.470144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnpb\" (UniqueName: \"kubernetes.io/projected/3297acf2-a801-4ad2-871e-be9250a012e1-kube-api-access-wtnpb\") pod \"authorino-66f76b575d-5zmr9\" (UID: \"3297acf2-a801-4ad2-871e-be9250a012e1\") " pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:18.546764 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.546723 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66f76b575d-5zmr9"] Jun 03 03:32:18.547023 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:32:18.547002 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wtnpb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-66f76b575d-5zmr9" podUID="3297acf2-a801-4ad2-871e-be9250a012e1" Jun 03 03:32:18.571021 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.570985 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c7ddfdb46-m9wn8"] Jun 03 03:32:18.571473 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.571449 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnpb\" (UniqueName: \"kubernetes.io/projected/3297acf2-a801-4ad2-871e-be9250a012e1-kube-api-access-wtnpb\") pod \"authorino-66f76b575d-5zmr9\" (UID: \"3297acf2-a801-4ad2-871e-be9250a012e1\") " pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:18.574507 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.574485 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.576897 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.576833 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 03:32:18.579958 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.579926 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7ddfdb46-m9wn8"] Jun 03 03:32:18.586048 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.586020 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnpb\" (UniqueName: \"kubernetes.io/projected/3297acf2-a801-4ad2-871e-be9250a012e1-kube-api-access-wtnpb\") pod \"authorino-66f76b575d-5zmr9\" (UID: \"3297acf2-a801-4ad2-871e-be9250a012e1\") " pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:18.672637 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.672591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6914dc2a-05e2-46e6-9b5c-497190b0d667-tls-cert\") pod \"authorino-7c7ddfdb46-m9wn8\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.672838 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.672658 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmltb\" (UniqueName: \"kubernetes.io/projected/6914dc2a-05e2-46e6-9b5c-497190b0d667-kube-api-access-wmltb\") pod \"authorino-7c7ddfdb46-m9wn8\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.774128 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.774025 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6914dc2a-05e2-46e6-9b5c-497190b0d667-tls-cert\") pod \"authorino-7c7ddfdb46-m9wn8\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.774347 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.774175 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmltb\" (UniqueName: \"kubernetes.io/projected/6914dc2a-05e2-46e6-9b5c-497190b0d667-kube-api-access-wmltb\") pod \"authorino-7c7ddfdb46-m9wn8\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.776625 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.776603 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6914dc2a-05e2-46e6-9b5c-497190b0d667-tls-cert\") pod \"authorino-7c7ddfdb46-m9wn8\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.781682 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.781657 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmltb\" (UniqueName: \"kubernetes.io/projected/6914dc2a-05e2-46e6-9b5c-497190b0d667-kube-api-access-wmltb\") pod \"authorino-7c7ddfdb46-m9wn8\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:18.885604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:18.885565 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:32:19.019254 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.019201 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7ddfdb46-m9wn8"] Jun 03 03:32:19.020698 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:32:19.020669 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6914dc2a_05e2_46e6_9b5c_497190b0d667.slice/crio-de38940e90f4dca4285fd8c733c883384f3d704c7facb5121511a630dbbd1aa1 WatchSource:0}: Error finding container de38940e90f4dca4285fd8c733c883384f3d704c7facb5121511a630dbbd1aa1: Status 404 returned error can't find the container with id de38940e90f4dca4285fd8c733c883384f3d704c7facb5121511a630dbbd1aa1 Jun 03 03:32:19.041055 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.041030 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:19.041055 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.041035 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" event={"ID":"6914dc2a-05e2-46e6-9b5c-497190b0d667","Type":"ContainerStarted","Data":"de38940e90f4dca4285fd8c733c883384f3d704c7facb5121511a630dbbd1aa1"} Jun 03 03:32:19.046264 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.046241 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:19.077002 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.076962 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtnpb\" (UniqueName: \"kubernetes.io/projected/3297acf2-a801-4ad2-871e-be9250a012e1-kube-api-access-wtnpb\") pod \"3297acf2-a801-4ad2-871e-be9250a012e1\" (UID: \"3297acf2-a801-4ad2-871e-be9250a012e1\") " Jun 03 03:32:19.079204 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.079177 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3297acf2-a801-4ad2-871e-be9250a012e1-kube-api-access-wtnpb" (OuterVolumeSpecName: "kube-api-access-wtnpb") pod "3297acf2-a801-4ad2-871e-be9250a012e1" (UID: "3297acf2-a801-4ad2-871e-be9250a012e1"). InnerVolumeSpecName "kube-api-access-wtnpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:32:19.178340 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:19.178297 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtnpb\" (UniqueName: \"kubernetes.io/projected/3297acf2-a801-4ad2-871e-be9250a012e1-kube-api-access-wtnpb\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:32:20.047198 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:20.047152 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" event={"ID":"6914dc2a-05e2-46e6-9b5c-497190b0d667","Type":"ContainerStarted","Data":"912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12"} Jun 03 03:32:20.047628 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:20.047201 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f76b575d-5zmr9" Jun 03 03:32:20.064999 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:20.064939 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" podStartSLOduration=1.720714334 podStartE2EDuration="2.064922857s" podCreationTimestamp="2026-06-03 03:32:18 +0000 UTC" firstStartedPulling="2026-06-03 03:32:19.021961816 +0000 UTC m=+714.183685465" lastFinishedPulling="2026-06-03 03:32:19.366170335 +0000 UTC m=+714.527893988" observedRunningTime="2026-06-03 03:32:20.064142845 +0000 UTC m=+715.225866516" watchObservedRunningTime="2026-06-03 03:32:20.064922857 +0000 UTC m=+715.226646527" Jun 03 03:32:20.085087 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:20.085044 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66f76b575d-5zmr9"] Jun 03 03:32:20.091288 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:20.091257 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66f76b575d-5zmr9"] Jun 03 03:32:21.417581 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:32:21.417545 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3297acf2-a801-4ad2-871e-be9250a012e1" path="/var/lib/kubelet/pods/3297acf2-a801-4ad2-871e-be9250a012e1/volumes" Jun 03 03:33:07.878111 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:07.878076 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:33:07.878669 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:07.878333 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" containerID="cri-o://d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666" gracePeriod=30 Jun 03 03:33:09.927026 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:09.927001 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.048789 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.048694 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnv5f\" (UniqueName: \"kubernetes.io/projected/d99bf1ec-88fe-4294-a844-bad0b227536f-kube-api-access-nnv5f\") pod \"d99bf1ec-88fe-4294-a844-bad0b227536f\" (UID: \"d99bf1ec-88fe-4294-a844-bad0b227536f\") " Jun 03 03:33:10.050994 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.050965 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99bf1ec-88fe-4294-a844-bad0b227536f-kube-api-access-nnv5f" (OuterVolumeSpecName: "kube-api-access-nnv5f") pod "d99bf1ec-88fe-4294-a844-bad0b227536f" (UID: "d99bf1ec-88fe-4294-a844-bad0b227536f"). InnerVolumeSpecName "kube-api-access-nnv5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:33:10.149901 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.149860 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnv5f\" (UniqueName: \"kubernetes.io/projected/d99bf1ec-88fe-4294-a844-bad0b227536f-kube-api-access-nnv5f\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:33:10.255654 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.255610 2570 generic.go:358] "Generic (PLEG): container finished" podID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerID="d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666" exitCode=143 Jun 03 03:33:10.255829 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.255701 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d99bf1ec-88fe-4294-a844-bad0b227536f","Type":"ContainerDied","Data":"d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666"} Jun 03 03:33:10.255829 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.255711 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.255829 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.255753 2570 scope.go:117] "RemoveContainer" containerID="d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666" Jun 03 03:33:10.255945 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.255743 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d99bf1ec-88fe-4294-a844-bad0b227536f","Type":"ContainerDied","Data":"79b23f0443f3a01267f27abeac212930fd490ae6b846708de9f84de2d1908764"} Jun 03 03:33:10.265953 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.265930 2570 scope.go:117] "RemoveContainer" containerID="d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666" Jun 03 03:33:10.266243 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:33:10.266204 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666\": container with ID starting with d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666 not found: ID does not exist" containerID="d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666" Jun 03 03:33:10.266329 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.266249 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666"} err="failed to get container status \"d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666\": rpc error: code = NotFound desc = could not find container \"d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666\": container with ID starting with d495386249ba661b593c421fe10943a36b0d1eb6f52395ff8c904c0ff52b8666 not found: ID does not exist" Jun 03 03:33:10.277649 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.277619 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:33:10.280065 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.280043 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:33:10.298124 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.298083 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:33:10.298554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.298537 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" Jun 03 03:33:10.298554 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.298555 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" Jun 03 03:33:10.298650 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.298641 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" containerName="keycloak" Jun 03 03:33:10.303337 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.303286 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.305747 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.305723 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 03:33:10.305882 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.305723 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6lp6w\"" Jun 03 03:33:10.305968 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.305948 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 03:33:10.306030 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.305993 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 03:33:10.306082 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.305954 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 03:33:10.309847 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.309823 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:33:10.352718 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.352676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0bc09225-8f87-46da-b95f-340c1f3d9693-test-realms\") pod \"maas-keycloak-0\" (UID: \"0bc09225-8f87-46da-b95f-340c1f3d9693\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.352910 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.352743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76w75\" (UniqueName: \"kubernetes.io/projected/0bc09225-8f87-46da-b95f-340c1f3d9693-kube-api-access-76w75\") pod \"maas-keycloak-0\" (UID: \"0bc09225-8f87-46da-b95f-340c1f3d9693\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.453989 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.453947 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76w75\" (UniqueName: \"kubernetes.io/projected/0bc09225-8f87-46da-b95f-340c1f3d9693-kube-api-access-76w75\") pod \"maas-keycloak-0\" (UID: \"0bc09225-8f87-46da-b95f-340c1f3d9693\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.454159 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.454056 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0bc09225-8f87-46da-b95f-340c1f3d9693-test-realms\") pod \"maas-keycloak-0\" (UID: \"0bc09225-8f87-46da-b95f-340c1f3d9693\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.454714 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.454694 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0bc09225-8f87-46da-b95f-340c1f3d9693-test-realms\") pod \"maas-keycloak-0\" (UID: \"0bc09225-8f87-46da-b95f-340c1f3d9693\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.462737 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.462709 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76w75\" (UniqueName: \"kubernetes.io/projected/0bc09225-8f87-46da-b95f-340c1f3d9693-kube-api-access-76w75\") pod \"maas-keycloak-0\" (UID: \"0bc09225-8f87-46da-b95f-340c1f3d9693\") " pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.614575 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.614472 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:10.747721 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:10.747687 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 03:33:10.751104 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:33:10.751070 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc09225_8f87_46da_b95f_340c1f3d9693.slice/crio-2f768efa729dead5e4e0fe7443fb80a4b6b7515673e645f11fc2c4730f2ae5e4 WatchSource:0}: Error finding container 2f768efa729dead5e4e0fe7443fb80a4b6b7515673e645f11fc2c4730f2ae5e4: Status 404 returned error can't find the container with id 2f768efa729dead5e4e0fe7443fb80a4b6b7515673e645f11fc2c4730f2ae5e4 Jun 03 03:33:11.263465 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:11.263428 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0bc09225-8f87-46da-b95f-340c1f3d9693","Type":"ContainerStarted","Data":"22609565455e3997a571f81d0dbe2bc365a993ccf7751a27b276b220c2e807c4"} Jun 03 03:33:11.263465 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:11.263467 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0bc09225-8f87-46da-b95f-340c1f3d9693","Type":"ContainerStarted","Data":"2f768efa729dead5e4e0fe7443fb80a4b6b7515673e645f11fc2c4730f2ae5e4"} Jun 03 03:33:11.281637 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:11.281573 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.948096088 podStartE2EDuration="1.28155505s" podCreationTimestamp="2026-06-03 03:33:10 +0000 UTC" firstStartedPulling="2026-06-03 03:33:10.752328794 +0000 UTC m=+765.914052443" lastFinishedPulling="2026-06-03 03:33:11.085787753 +0000 UTC m=+766.247511405" observedRunningTime="2026-06-03 03:33:11.278344596 +0000 UTC m=+766.440068268" watchObservedRunningTime="2026-06-03 03:33:11.28155505 +0000 UTC m=+766.443278721" Jun 03 03:33:11.421029 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:11.420927 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99bf1ec-88fe-4294-a844-bad0b227536f" path="/var/lib/kubelet/pods/d99bf1ec-88fe-4294-a844-bad0b227536f/volumes" Jun 03 03:33:11.615057 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:11.614996 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:11.617082 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:11.617036 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:12.615906 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:12.615850 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:13.615479 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:13.615434 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:14.616067 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:14.616022 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:15.615722 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:15.615665 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:16.615744 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:16.615679 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:17.615610 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:17.615556 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:18.615757 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:18.615704 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:19.615651 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:19.615586 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:20.615583 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:20.615536 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:20.616097 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:20.615787 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:21.615357 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:21.615295 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:22.615384 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:22.615341 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:23.615231 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:23.615155 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:24.615451 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:24.615386 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 03:33:25.711838 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:25.711792 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:25.727373 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:25.727320 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0bc09225-8f87-46da-b95f-340c1f3d9693" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 03:33:35.718442 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:35.718405 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 03:33:48.038997 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.038904 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c7ddfdb46-m9wn8"] Jun 03 03:33:48.039576 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.039130 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" podUID="6914dc2a-05e2-46e6-9b5c-497190b0d667" containerName="authorino" containerID="cri-o://912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12" gracePeriod=30 Jun 03 03:33:48.292971 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.292902 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:33:48.329574 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.329534 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmltb\" (UniqueName: \"kubernetes.io/projected/6914dc2a-05e2-46e6-9b5c-497190b0d667-kube-api-access-wmltb\") pod \"6914dc2a-05e2-46e6-9b5c-497190b0d667\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " Jun 03 03:33:48.329779 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.329599 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6914dc2a-05e2-46e6-9b5c-497190b0d667-tls-cert\") pod \"6914dc2a-05e2-46e6-9b5c-497190b0d667\" (UID: \"6914dc2a-05e2-46e6-9b5c-497190b0d667\") " Jun 03 03:33:48.331837 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.331807 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6914dc2a-05e2-46e6-9b5c-497190b0d667-kube-api-access-wmltb" (OuterVolumeSpecName: "kube-api-access-wmltb") pod "6914dc2a-05e2-46e6-9b5c-497190b0d667" (UID: "6914dc2a-05e2-46e6-9b5c-497190b0d667"). InnerVolumeSpecName "kube-api-access-wmltb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:33:48.341243 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.341191 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6914dc2a-05e2-46e6-9b5c-497190b0d667-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6914dc2a-05e2-46e6-9b5c-497190b0d667" (UID: "6914dc2a-05e2-46e6-9b5c-497190b0d667"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:33:48.430811 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.430769 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmltb\" (UniqueName: \"kubernetes.io/projected/6914dc2a-05e2-46e6-9b5c-497190b0d667-kube-api-access-wmltb\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:33:48.430811 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.430804 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6914dc2a-05e2-46e6-9b5c-497190b0d667-tls-cert\") on node \"ip-10-0-132-105.ec2.internal\" DevicePath \"\"" Jun 03 03:33:48.464691 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.464655 2570 generic.go:358] "Generic (PLEG): container finished" podID="6914dc2a-05e2-46e6-9b5c-497190b0d667" containerID="912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12" exitCode=0 Jun 03 03:33:48.464879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.464714 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" Jun 03 03:33:48.464879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.464725 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" event={"ID":"6914dc2a-05e2-46e6-9b5c-497190b0d667","Type":"ContainerDied","Data":"912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12"} Jun 03 03:33:48.464879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.464768 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7ddfdb46-m9wn8" event={"ID":"6914dc2a-05e2-46e6-9b5c-497190b0d667","Type":"ContainerDied","Data":"de38940e90f4dca4285fd8c733c883384f3d704c7facb5121511a630dbbd1aa1"} Jun 03 03:33:48.464879 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.464791 2570 scope.go:117] "RemoveContainer" containerID="912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12" Jun 03 03:33:48.481737 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.481715 2570 scope.go:117] "RemoveContainer" containerID="912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12" Jun 03 03:33:48.482046 ip-10-0-132-105 kubenswrapper[2570]: E0603 03:33:48.482024 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12\": container with ID starting with 912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12 not found: ID does not exist" containerID="912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12" Jun 03 03:33:48.482138 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.482055 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12"} err="failed to get container status \"912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12\": rpc error: code = NotFound desc = could not find container \"912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12\": container with ID starting with 912b077e99c335c4cecb4246bbf2c998461aaf6e443c181bad81c9ea418d5c12 not found: ID does not exist" Jun 03 03:33:48.490328 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.490293 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c7ddfdb46-m9wn8"] Jun 03 03:33:48.492709 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:48.492684 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c7ddfdb46-m9wn8"] Jun 03 03:33:49.417425 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:49.417390 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6914dc2a-05e2-46e6-9b5c-497190b0d667" path="/var/lib/kubelet/pods/6914dc2a-05e2-46e6-9b5c-497190b0d667/volumes" Jun 03 03:33:51.772185 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.772148 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg"] Jun 03 03:33:51.772787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.772765 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6914dc2a-05e2-46e6-9b5c-497190b0d667" containerName="authorino" Jun 03 03:33:51.772862 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.772790 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6914dc2a-05e2-46e6-9b5c-497190b0d667" containerName="authorino" Jun 03 03:33:51.772927 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.772916 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="6914dc2a-05e2-46e6-9b5c-497190b0d667" containerName="authorino" Jun 03 03:33:51.778080 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.778052 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.780523 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.780499 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 03:33:51.780758 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.780677 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 03:33:51.781350 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.781326 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-26bdz\"" Jun 03 03:33:51.781473 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.781359 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 03:33:51.782860 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.782834 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg"] Jun 03 03:33:51.861775 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.861734 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.861962 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.861816 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.861962 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.861857 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.861962 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.861891 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.861962 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.861908 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db13ca06-0a72-4740-947d-454199fcbd6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.861962 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.861940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d22lj\" (UniqueName: \"kubernetes.io/projected/db13ca06-0a72-4740-947d-454199fcbd6a-kube-api-access-d22lj\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963086 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963047 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963290 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963115 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963290 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963145 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963290 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963173 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963290 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963196 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db13ca06-0a72-4740-947d-454199fcbd6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963290 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963273 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d22lj\" (UniqueName: \"kubernetes.io/projected/db13ca06-0a72-4740-947d-454199fcbd6a-kube-api-access-d22lj\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963595 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963571 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963662 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963606 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.963662 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.963650 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.965493 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.965474 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db13ca06-0a72-4740-947d-454199fcbd6a-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.965936 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.965918 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db13ca06-0a72-4740-947d-454199fcbd6a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:51.970320 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:51.970296 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d22lj\" (UniqueName: \"kubernetes.io/projected/db13ca06-0a72-4740-947d-454199fcbd6a-kube-api-access-d22lj\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg\" (UID: \"db13ca06-0a72-4740-947d-454199fcbd6a\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:52.091308 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:52.091174 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:33:52.227508 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:52.227476 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg"] Jun 03 03:33:52.229532 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:33:52.229491 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb13ca06_0a72_4740_947d_454199fcbd6a.slice/crio-59bf4090439ecf8e1bc71a5c88d6287bf6430861d27a1edaed12dbed50ef703f WatchSource:0}: Error finding container 59bf4090439ecf8e1bc71a5c88d6287bf6430861d27a1edaed12dbed50ef703f: Status 404 returned error can't find the container with id 59bf4090439ecf8e1bc71a5c88d6287bf6430861d27a1edaed12dbed50ef703f Jun 03 03:33:52.482895 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:52.482859 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" event={"ID":"db13ca06-0a72-4740-947d-454199fcbd6a","Type":"ContainerStarted","Data":"59bf4090439ecf8e1bc71a5c88d6287bf6430861d27a1edaed12dbed50ef703f"} Jun 03 03:33:56.505317 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:56.505271 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" event={"ID":"db13ca06-0a72-4740-947d-454199fcbd6a","Type":"ContainerStarted","Data":"8aa2bca74a7b2948319982ed44538c4e8c12b23485df414b5b28dc57f1b9a48d"} Jun 03 03:33:57.510944 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.510908 2570 generic.go:358] "Generic (PLEG): container finished" podID="db13ca06-0a72-4740-947d-454199fcbd6a" containerID="8aa2bca74a7b2948319982ed44538c4e8c12b23485df414b5b28dc57f1b9a48d" exitCode=0 Jun 03 03:33:57.511355 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.510991 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" event={"ID":"db13ca06-0a72-4740-947d-454199fcbd6a","Type":"ContainerDied","Data":"8aa2bca74a7b2948319982ed44538c4e8c12b23485df414b5b28dc57f1b9a48d"} Jun 03 03:33:57.571061 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.571016 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd"] Jun 03 03:33:57.575135 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.575106 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd"] Jun 03 03:33:57.575331 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.575260 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.577591 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.577565 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 03:33:57.726618 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.726473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e24ff3c-d838-432a-bcc0-501a51645478-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.726618 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.726542 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.726618 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.726615 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5cw4\" (UniqueName: \"kubernetes.io/projected/7e24ff3c-d838-432a-bcc0-501a51645478-kube-api-access-p5cw4\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.726948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.726703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.726948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.726740 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.726948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.726769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.828358 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828316 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.828565 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828430 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e24ff3c-d838-432a-bcc0-501a51645478-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.828565 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828485 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.828565 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828519 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5cw4\" (UniqueName: \"kubernetes.io/projected/7e24ff3c-d838-432a-bcc0-501a51645478-kube-api-access-p5cw4\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.828565 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828563 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.828885 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828615 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.829012 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.828973 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.829109 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.829082 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.829179 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.829134 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.831599 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.831553 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e24ff3c-d838-432a-bcc0-501a51645478-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.831861 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.831844 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e24ff3c-d838-432a-bcc0-501a51645478-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.837642 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.837599 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5cw4\" (UniqueName: \"kubernetes.io/projected/7e24ff3c-d838-432a-bcc0-501a51645478-kube-api-access-p5cw4\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-z84fd\" (UID: \"7e24ff3c-d838-432a-bcc0-501a51645478\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:57.886614 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:57.886573 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:33:58.273862 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:58.273826 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd"] Jun 03 03:33:58.513673 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:33:58.513626 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e24ff3c_d838_432a_bcc0_501a51645478.slice/crio-be93130e78c447d1922aeb4a9f484261db64acf2a4ec74ad8d1fa15637d125b1 WatchSource:0}: Error finding container be93130e78c447d1922aeb4a9f484261db64acf2a4ec74ad8d1fa15637d125b1: Status 404 returned error can't find the container with id be93130e78c447d1922aeb4a9f484261db64acf2a4ec74ad8d1fa15637d125b1 Jun 03 03:33:59.523045 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:59.523004 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" event={"ID":"db13ca06-0a72-4740-947d-454199fcbd6a","Type":"ContainerStarted","Data":"a2067a1d75c5bf1e22fcc32e7b50d47fff0360eade7be99dd7e2239d651ca7ee"} Jun 03 03:33:59.524673 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:59.524647 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" event={"ID":"7e24ff3c-d838-432a-bcc0-501a51645478","Type":"ContainerStarted","Data":"3ce0afec9aeaa9c7646b2b5ad03d6135a2ab42ce78fd93fc44724f94a7f34244"} Jun 03 03:33:59.524808 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:59.524681 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" event={"ID":"7e24ff3c-d838-432a-bcc0-501a51645478","Type":"ContainerStarted","Data":"be93130e78c447d1922aeb4a9f484261db64acf2a4ec74ad8d1fa15637d125b1"} Jun 03 03:33:59.541812 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:33:59.541754 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" podStartSLOduration=2.205593102 podStartE2EDuration="8.541739095s" podCreationTimestamp="2026-06-03 03:33:51 +0000 UTC" firstStartedPulling="2026-06-03 03:33:52.23125809 +0000 UTC m=+807.392981743" lastFinishedPulling="2026-06-03 03:33:58.567404084 +0000 UTC m=+813.729127736" observedRunningTime="2026-06-03 03:33:59.538400811 +0000 UTC m=+814.700124480" watchObservedRunningTime="2026-06-03 03:33:59.541739095 +0000 UTC m=+814.703462860" Jun 03 03:34:00.531408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:00.531365 2570 generic.go:358] "Generic (PLEG): container finished" podID="7e24ff3c-d838-432a-bcc0-501a51645478" containerID="3ce0afec9aeaa9c7646b2b5ad03d6135a2ab42ce78fd93fc44724f94a7f34244" exitCode=0 Jun 03 03:34:00.531801 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:00.531408 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" event={"ID":"7e24ff3c-d838-432a-bcc0-501a51645478","Type":"ContainerDied","Data":"3ce0afec9aeaa9c7646b2b5ad03d6135a2ab42ce78fd93fc44724f94a7f34244"} Jun 03 03:34:01.537225 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:01.537177 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" event={"ID":"7e24ff3c-d838-432a-bcc0-501a51645478","Type":"ContainerStarted","Data":"b29c415dd3bff281738541ef168adcc580e25a4657c8e81723f0b30cb8651d67"} Jun 03 03:34:01.559090 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:01.559033 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" podStartSLOduration=4.334124184 podStartE2EDuration="4.559017408s" podCreationTimestamp="2026-06-03 03:33:57 +0000 UTC" firstStartedPulling="2026-06-03 03:34:00.531989336 +0000 UTC m=+815.693712989" lastFinishedPulling="2026-06-03 03:34:00.75688256 +0000 UTC m=+815.918606213" observedRunningTime="2026-06-03 03:34:01.558281449 +0000 UTC m=+816.720005124" watchObservedRunningTime="2026-06-03 03:34:01.559017408 +0000 UTC m=+816.720741078" Jun 03 03:34:02.091870 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:02.091830 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:34:02.092089 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:02.091880 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:34:02.105256 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:02.105203 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:34:02.552794 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:02.552762 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg" Jun 03 03:34:07.886965 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:07.886922 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:34:07.886965 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:07.886970 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:34:07.900088 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:07.900054 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:34:08.575211 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:08.575177 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-z84fd" Jun 03 03:34:32.163233 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.163190 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67"] Jun 03 03:34:32.168107 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.168086 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.170379 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.170361 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 03:34:32.177513 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.177483 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67"] Jun 03 03:34:32.260436 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.260412 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.260566 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.260447 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5beb76b-40cf-47c0-bc93-d6785bab77b4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.260566 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.260470 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.260566 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.260553 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.260689 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.260632 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz6nq\" (UniqueName: \"kubernetes.io/projected/d5beb76b-40cf-47c0-bc93-d6785bab77b4-kube-api-access-hz6nq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.260689 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.260651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.361871 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.361840 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.361984 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.361890 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.361984 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.361931 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hz6nq\" (UniqueName: \"kubernetes.io/projected/d5beb76b-40cf-47c0-bc93-d6785bab77b4-kube-api-access-hz6nq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.361984 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.361948 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.361984 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.361969 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.362192 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.361999 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5beb76b-40cf-47c0-bc93-d6785bab77b4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.362341 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.362317 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.362404 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.362341 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.362404 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.362364 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.364339 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.364314 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5beb76b-40cf-47c0-bc93-d6785bab77b4-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.364605 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.364590 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5beb76b-40cf-47c0-bc93-d6785bab77b4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.375441 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.369182 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz6nq\" (UniqueName: \"kubernetes.io/projected/d5beb76b-40cf-47c0-bc93-d6785bab77b4-kube-api-access-hz6nq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67\" (UID: \"d5beb76b-40cf-47c0-bc93-d6785bab77b4\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.479697 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.479669 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:32.607123 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.607094 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67"] Jun 03 03:34:32.608922 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:34:32.608891 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5beb76b_40cf_47c0_bc93_d6785bab77b4.slice/crio-4c2b10ce3fd85f791b8696d98ff269a7e2306406b1a0eb3d7cf32beebc881a07 WatchSource:0}: Error finding container 4c2b10ce3fd85f791b8696d98ff269a7e2306406b1a0eb3d7cf32beebc881a07: Status 404 returned error can't find the container with id 4c2b10ce3fd85f791b8696d98ff269a7e2306406b1a0eb3d7cf32beebc881a07 Jun 03 03:34:32.660740 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:32.660717 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" event={"ID":"d5beb76b-40cf-47c0-bc93-d6785bab77b4","Type":"ContainerStarted","Data":"4c2b10ce3fd85f791b8696d98ff269a7e2306406b1a0eb3d7cf32beebc881a07"} Jun 03 03:34:33.666414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:33.666380 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" event={"ID":"d5beb76b-40cf-47c0-bc93-d6785bab77b4","Type":"ContainerStarted","Data":"1b4b3dfa7e5a5894008099097dce3325c17dccdab3ebe32a523b9702cb1f5830"} Jun 03 03:34:34.671704 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:34.671669 2570 generic.go:358] "Generic (PLEG): container finished" podID="d5beb76b-40cf-47c0-bc93-d6785bab77b4" containerID="1b4b3dfa7e5a5894008099097dce3325c17dccdab3ebe32a523b9702cb1f5830" exitCode=0 Jun 03 03:34:34.672123 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:34.671717 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" event={"ID":"d5beb76b-40cf-47c0-bc93-d6785bab77b4","Type":"ContainerDied","Data":"1b4b3dfa7e5a5894008099097dce3325c17dccdab3ebe32a523b9702cb1f5830"} Jun 03 03:34:35.677155 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:35.677121 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" event={"ID":"d5beb76b-40cf-47c0-bc93-d6785bab77b4","Type":"ContainerStarted","Data":"212d1229b4266bfcd8602912efb1bcb562becb4d8ed6f547a47c2244717d3de8"} Jun 03 03:34:35.695471 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:35.695416 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" podStartSLOduration=3.517865584 podStartE2EDuration="3.695402229s" podCreationTimestamp="2026-06-03 03:34:32 +0000 UTC" firstStartedPulling="2026-06-03 03:34:34.672281283 +0000 UTC m=+849.834004932" lastFinishedPulling="2026-06-03 03:34:34.849817918 +0000 UTC m=+850.011541577" observedRunningTime="2026-06-03 03:34:35.693099454 +0000 UTC m=+850.854823124" watchObservedRunningTime="2026-06-03 03:34:35.695402229 +0000 UTC m=+850.857125899" Jun 03 03:34:42.480356 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:42.480318 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:42.480356 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:42.480365 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:42.492619 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:42.492591 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:34:42.716756 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:34:42.716731 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67" Jun 03 03:35:25.426526 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:35:25.426458 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:35:25.428963 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:35:25.428940 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:40:25.461489 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:40:25.461454 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:40:25.465477 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:40:25.465445 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:45:25.496755 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:45:25.496723 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:45:25.503171 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:45:25.503153 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:50:25.538906 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:50:25.538876 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:50:25.548843 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:50:25.548821 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:55:25.574552 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:55:25.574520 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:55:25.585194 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:55:25.585170 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:59:15.867688 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:15.867615 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-clfk2_f12bd238-b51e-4b6c-92f9-b733f38ef32b/copy-manifests/0.log" Jun 03 03:59:15.873401 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:15.873376 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-clfk2_f12bd238-b51e-4b6c-92f9-b733f38ef32b/manager/0.log" Jun 03 03:59:16.929048 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:16.929015 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7_432cd8b7-a015-44df-a40d-c947137d1f03/util/0.log" Jun 03 03:59:16.935024 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:16.934999 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7_432cd8b7-a015-44df-a40d-c947137d1f03/pull/0.log" Jun 03 03:59:16.940311 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:16.940295 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7_432cd8b7-a015-44df-a40d-c947137d1f03/extract/0.log" Jun 03 03:59:17.045955 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.045918 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p_bca53924-d1ef-4049-a661-645bbdc43411/util/0.log" Jun 03 03:59:17.051723 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.051695 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p_bca53924-d1ef-4049-a661-645bbdc43411/pull/0.log" Jun 03 03:59:17.057617 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.057593 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p_bca53924-d1ef-4049-a661-645bbdc43411/extract/0.log" Jun 03 03:59:17.162285 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.162256 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q_f7ea567f-8b89-4577-8967-57c331dbd4e6/util/0.log" Jun 03 03:59:17.167787 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.167768 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q_f7ea567f-8b89-4577-8967-57c331dbd4e6/pull/0.log" Jun 03 03:59:17.173709 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.173690 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q_f7ea567f-8b89-4577-8967-57c331dbd4e6/extract/0.log" Jun 03 03:59:17.278622 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.278551 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k_fddc18bd-5dc4-4782-a6f9-28284c32b49e/util/0.log" Jun 03 03:59:17.284094 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.284068 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k_fddc18bd-5dc4-4782-a6f9-28284c32b49e/pull/0.log" Jun 03 03:59:17.291208 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.291187 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k_fddc18bd-5dc4-4782-a6f9-28284c32b49e/extract/0.log" Jun 03 03:59:17.734274 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:17.734245 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-74928_9bba0c57-08f5-422e-9890-72b33bad8758/kuadrant-console-plugin/0.log" Jun 03 03:59:18.193887 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:18.193855 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-d4j6n_7ccde92c-5a62-4d39-a279-338c6f283458/manager/0.log" Jun 03 03:59:18.761572 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:18.761542 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6969fb6c4b-5hptn_ea28913e-8a77-4641-adf5-fc78146b435d/kube-auth-proxy/0.log" Jun 03 03:59:19.536764 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:19.536732 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg_db13ca06-0a72-4740-947d-454199fcbd6a/storage-initializer/0.log" Jun 03 03:59:19.542993 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:19.542971 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-jtfqg_db13ca06-0a72-4740-947d-454199fcbd6a/main/0.log" Jun 03 03:59:19.650424 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:19.650401 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-z84fd_7e24ff3c-d838-432a-bcc0-501a51645478/storage-initializer/0.log" Jun 03 03:59:19.658381 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:19.658365 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-z84fd_7e24ff3c-d838-432a-bcc0-501a51645478/main/0.log" Jun 03 03:59:20.007355 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:20.007332 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67_d5beb76b-40cf-47c0-bc93-d6785bab77b4/storage-initializer/0.log" Jun 03 03:59:20.013518 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:20.013500 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-xrq67_d5beb76b-40cf-47c0-bc93-d6785bab77b4/main/0.log" Jun 03 03:59:27.289631 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:27.289599 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t48t8_be38fff6-97ae-43c5-b599-f90cc9c55145/global-pull-secret-syncer/0.log" Jun 03 03:59:27.381939 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:27.381910 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sv9jl_3b6c8dec-0ca2-4629-a47c-12917d920f65/konnectivity-agent/0.log" Jun 03 03:59:27.418872 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:27.418847 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-105.ec2.internal_2437879e208ceb33c4ad964cb808c2a3/haproxy/0.log" Jun 03 03:59:31.874662 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:31.874635 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7_432cd8b7-a015-44df-a40d-c947137d1f03/extract/0.log" Jun 03 03:59:31.895407 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:31.895382 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7_432cd8b7-a015-44df-a40d-c947137d1f03/util/0.log" Jun 03 03:59:31.913853 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:31.913834 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594s9s7_432cd8b7-a015-44df-a40d-c947137d1f03/pull/0.log" Jun 03 03:59:31.936094 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:31.936072 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p_bca53924-d1ef-4049-a661-645bbdc43411/extract/0.log" Jun 03 03:59:31.959946 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:31.959929 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p_bca53924-d1ef-4049-a661-645bbdc43411/util/0.log" Jun 03 03:59:31.979234 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:31.979198 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cxd6p_bca53924-d1ef-4049-a661-645bbdc43411/pull/0.log" Jun 03 03:59:32.001699 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.001677 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q_f7ea567f-8b89-4577-8967-57c331dbd4e6/extract/0.log" Jun 03 03:59:32.019311 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.019292 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q_f7ea567f-8b89-4577-8967-57c331dbd4e6/util/0.log" Jun 03 03:59:32.046425 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.046405 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73s9h8q_f7ea567f-8b89-4577-8967-57c331dbd4e6/pull/0.log" Jun 03 03:59:32.077716 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.077695 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k_fddc18bd-5dc4-4782-a6f9-28284c32b49e/extract/0.log" Jun 03 03:59:32.094948 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.094928 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k_fddc18bd-5dc4-4782-a6f9-28284c32b49e/util/0.log" Jun 03 03:59:32.113836 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.113817 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cxq7k_fddc18bd-5dc4-4782-a6f9-28284c32b49e/pull/0.log" Jun 03 03:59:32.483786 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.483762 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-74928_9bba0c57-08f5-422e-9890-72b33bad8758/kuadrant-console-plugin/0.log" Jun 03 03:59:32.698998 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:32.698970 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-d4j6n_7ccde92c-5a62-4d39-a279-338c6f283458/manager/0.log" Jun 03 03:59:34.249504 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.249423 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/alertmanager/0.log" Jun 03 03:59:34.269209 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.269188 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/config-reloader/0.log" Jun 03 03:59:34.286252 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.286228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/kube-rbac-proxy-web/0.log" Jun 03 03:59:34.303314 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.303293 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/kube-rbac-proxy/0.log" Jun 03 03:59:34.320981 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.320965 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/kube-rbac-proxy-metric/0.log" Jun 03 03:59:34.340315 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.340293 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/prom-label-proxy/0.log" Jun 03 03:59:34.362941 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.362924 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bc7f50f-f97c-40ea-b770-1b78cefd7fb7/init-config-reloader/0.log" Jun 03 03:59:34.404159 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.404141 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-f947k_2fb03ea5-da4e-463d-948d-27f4cbf1fbfa/cluster-monitoring-operator/0.log" Jun 03 03:59:34.440558 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.440540 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-jgrfd_23f111e1-44ae-4b38-8d1c-0867feec5ecc/kube-state-metrics/0.log" Jun 03 03:59:34.455008 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.454989 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-jgrfd_23f111e1-44ae-4b38-8d1c-0867feec5ecc/kube-rbac-proxy-main/0.log" Jun 03 03:59:34.473017 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.472999 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-jgrfd_23f111e1-44ae-4b38-8d1c-0867feec5ecc/kube-rbac-proxy-self/0.log" Jun 03 03:59:34.522127 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.522074 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-mdnkh_8dbe4b3a-f1da-4b23-b423-6a98d1d753c3/monitoring-plugin/0.log" Jun 03 03:59:34.682158 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.682136 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpg6q_31bab2e6-2add-4a33-90e8-0d6b9197f81e/node-exporter/0.log" Jun 03 03:59:34.698698 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.698675 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpg6q_31bab2e6-2add-4a33-90e8-0d6b9197f81e/kube-rbac-proxy/0.log" Jun 03 03:59:34.715479 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.715460 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpg6q_31bab2e6-2add-4a33-90e8-0d6b9197f81e/init-textfile/0.log" Jun 03 03:59:34.753482 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.753460 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cpntn_b2288c22-402c-4bb6-9a41-37b9f698ac35/kube-rbac-proxy-main/0.log" Jun 03 03:59:34.771600 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.771580 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cpntn_b2288c22-402c-4bb6-9a41-37b9f698ac35/kube-rbac-proxy-self/0.log" Jun 03 03:59:34.794858 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.794805 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-cpntn_b2288c22-402c-4bb6-9a41-37b9f698ac35/openshift-state-metrics/0.log" Jun 03 03:59:34.969763 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.969733 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-xqbn6_9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c/prometheus-operator/0.log" Jun 03 03:59:34.985308 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:34.985285 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-xqbn6_9c88a1ad-6fd6-4819-ab66-fcbcfcd3093c/kube-rbac-proxy/0.log" Jun 03 03:59:35.028672 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.028651 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86f447b5b9-gsnjd_f867b483-1acb-466e-a376-9c2ef8ec0dfb/telemeter-client/0.log" Jun 03 03:59:35.044825 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.044805 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86f447b5b9-gsnjd_f867b483-1acb-466e-a376-9c2ef8ec0dfb/reload/0.log" Jun 03 03:59:35.061910 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.061860 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86f447b5b9-gsnjd_f867b483-1acb-466e-a376-9c2ef8ec0dfb/kube-rbac-proxy/0.log" Jun 03 03:59:35.084549 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.084532 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dd6d597c-lzrkh_bb2f1375-a742-4928-93c1-b3738c69b604/thanos-query/0.log" Jun 03 03:59:35.100423 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.100406 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dd6d597c-lzrkh_bb2f1375-a742-4928-93c1-b3738c69b604/kube-rbac-proxy-web/0.log" Jun 03 03:59:35.116906 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.116889 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dd6d597c-lzrkh_bb2f1375-a742-4928-93c1-b3738c69b604/kube-rbac-proxy/0.log" Jun 03 03:59:35.135819 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.135802 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dd6d597c-lzrkh_bb2f1375-a742-4928-93c1-b3738c69b604/prom-label-proxy/0.log" Jun 03 03:59:35.155114 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.155099 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dd6d597c-lzrkh_bb2f1375-a742-4928-93c1-b3738c69b604/kube-rbac-proxy-rules/0.log" Jun 03 03:59:35.175252 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:35.175231 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dd6d597c-lzrkh_bb2f1375-a742-4928-93c1-b3738c69b604/kube-rbac-proxy-metrics/0.log" Jun 03 03:59:37.277964 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:37.277939 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c7c99655d-7txzk_b5026a23-1496-46ad-81ce-ce588df00f01/console/0.log" Jun 03 03:59:38.179520 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.179485 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8"] Jun 03 03:59:38.183233 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.183205 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.185748 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.185723 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsqd8\"/\"openshift-service-ca.crt\"" Jun 03 03:59:38.185846 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.185730 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsqd8\"/\"kube-root-ca.crt\"" Jun 03 03:59:38.186548 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.186533 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsqd8\"/\"default-dockercfg-x9tf6\"" Jun 03 03:59:38.191965 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.191942 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8"] Jun 03 03:59:38.308990 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.308961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-sys\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.309414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.309007 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-proc\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.309414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.309044 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-podres\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.309414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.309155 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-lib-modules\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.309414 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.309201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66mf8\" (UniqueName: \"kubernetes.io/projected/3ef81b18-ad9b-400f-ad03-19bce72e641f-kube-api-access-66mf8\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410262 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410240 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-sys\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410280 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-proc\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410311 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-podres\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410356 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-sys\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410364 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-lib-modules\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410408 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410374 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-proc\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410428 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66mf8\" (UniqueName: \"kubernetes.io/projected/3ef81b18-ad9b-400f-ad03-19bce72e641f-kube-api-access-66mf8\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410470 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-lib-modules\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.410707 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.410470 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ef81b18-ad9b-400f-ad03-19bce72e641f-podres\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.417594 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.417571 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66mf8\" (UniqueName: \"kubernetes.io/projected/3ef81b18-ad9b-400f-ad03-19bce72e641f-kube-api-access-66mf8\") pod \"perf-node-gather-daemonset-vnpd8\" (UID: \"3ef81b18-ad9b-400f-ad03-19bce72e641f\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.494756 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.494697 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.627718 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.627690 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8"] Jun 03 03:59:38.628735 ip-10-0-132-105 kubenswrapper[2570]: W0603 03:59:38.628707 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ef81b18_ad9b_400f_ad03_19bce72e641f.slice/crio-2b9fba857fde0295eb50591268de046f17bb5097c8c3c0544f7026eddc7db1ef WatchSource:0}: Error finding container 2b9fba857fde0295eb50591268de046f17bb5097c8c3c0544f7026eddc7db1ef: Status 404 returned error can't find the container with id 2b9fba857fde0295eb50591268de046f17bb5097c8c3c0544f7026eddc7db1ef Jun 03 03:59:38.630372 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.630355 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:59:38.776454 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.776400 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s49xc_5e1d24a3-cee0-447f-a190-b720f7c532b0/dns/0.log" Jun 03 03:59:38.789153 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.789130 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" event={"ID":"3ef81b18-ad9b-400f-ad03-19bce72e641f","Type":"ContainerStarted","Data":"cc9b79be9a237eadf2c3cffe04fa8fe2598df8ad531baf3ca8e93a6b845e816f"} Jun 03 03:59:38.789304 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.789160 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" event={"ID":"3ef81b18-ad9b-400f-ad03-19bce72e641f","Type":"ContainerStarted","Data":"2b9fba857fde0295eb50591268de046f17bb5097c8c3c0544f7026eddc7db1ef"} Jun 03 03:59:38.789304 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.789252 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:38.794638 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.794619 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s49xc_5e1d24a3-cee0-447f-a190-b720f7c532b0/kube-rbac-proxy/0.log" Jun 03 03:59:38.807315 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.807282 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" podStartSLOduration=0.807270106 podStartE2EDuration="807.270106ms" podCreationTimestamp="2026-06-03 03:59:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:59:38.805045669 +0000 UTC m=+2353.966769344" watchObservedRunningTime="2026-06-03 03:59:38.807270106 +0000 UTC m=+2353.968993777" Jun 03 03:59:38.877466 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:38.877437 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jv4k5_0a37bf2d-821f-4f29-9448-ba501e17bc7d/dns-node-resolver/0.log" Jun 03 03:59:39.376074 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:39.376044 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pmfhp_e15bac92-028f-4cf2-b21b-625c36a65398/node-ca/0.log" Jun 03 03:59:40.314381 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:40.314349 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6969fb6c4b-5hptn_ea28913e-8a77-4641-adf5-fc78146b435d/kube-auth-proxy/0.log" Jun 03 03:59:40.994670 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:40.994641 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2w2h_09234263-e48e-4dee-9de1-f9c3e2aa34fd/serve-healthcheck-canary/0.log" Jun 03 03:59:41.487872 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:41.487842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq6qr_e4458a55-e71e-4e08-bb30-8a2175d9aec6/kube-rbac-proxy/0.log" Jun 03 03:59:41.505082 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:41.505053 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq6qr_e4458a55-e71e-4e08-bb30-8a2175d9aec6/exporter/0.log" Jun 03 03:59:41.522552 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:41.522529 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq6qr_e4458a55-e71e-4e08-bb30-8a2175d9aec6/extractor/0.log" Jun 03 03:59:43.825752 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:43.825717 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-clfk2_f12bd238-b51e-4b6c-92f9-b733f38ef32b/manager/0.log" Jun 03 03:59:43.841979 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:43.841955 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-clfk2_f12bd238-b51e-4b6c-92f9-b733f38ef32b/copy-manifests/0.log" Jun 03 03:59:44.804247 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:44.804208 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-vnpd8" Jun 03 03:59:45.295482 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:45.295448 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-865bddc6b6-dl468_854605b7-6609-4657-8fce-e6793dd94bc4/manager/0.log" Jun 03 03:59:51.346549 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.346511 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5k7w8_49fc9946-f022-453f-a020-09c5e1771327/kube-multus/0.log" Jun 03 03:59:51.366604 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.366581 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/kube-multus-additional-cni-plugins/0.log" Jun 03 03:59:51.384534 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.384512 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/egress-router-binary-copy/0.log" Jun 03 03:59:51.402175 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.402126 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/cni-plugins/0.log" Jun 03 03:59:51.419095 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.419076 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/bond-cni-plugin/0.log" Jun 03 03:59:51.436059 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.436040 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/routeoverride-cni/0.log" Jun 03 03:59:51.458037 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.458018 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/whereabouts-cni-bincopy/0.log" Jun 03 03:59:51.475232 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.475197 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48thb_eba5ed4f-2b75-43ab-bcd4-741cf348ff43/whereabouts-cni/0.log" Jun 03 03:59:51.832687 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.832661 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pfx99_f5333f73-4353-4f94-93ef-4137cf3b76e0/network-metrics-daemon/0.log" Jun 03 03:59:51.849318 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:51.849294 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pfx99_f5333f73-4353-4f94-93ef-4137cf3b76e0/kube-rbac-proxy/0.log" Jun 03 03:59:53.250922 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.250895 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-controller/0.log" Jun 03 03:59:53.265413 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.265390 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/0.log" Jun 03 03:59:53.279030 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.279007 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovn-acl-logging/1.log" Jun 03 03:59:53.296193 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.296174 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/kube-rbac-proxy-node/0.log" Jun 03 03:59:53.313118 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.313093 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 03:59:53.328314 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.328296 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/northd/0.log" Jun 03 03:59:53.346344 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.346326 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/nbdb/0.log" Jun 03 03:59:53.364827 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.364809 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/sbdb/0.log" Jun 03 03:59:53.471236 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:53.471190 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vdbxv_1295a97b-a599-4291-8f8a-1d160a77d700/ovnkube-controller/0.log" Jun 03 03:59:54.513146 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:54.513116 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-9792g_ee03b01d-e424-4007-88d3-4cca049d1824/check-endpoints/0.log" Jun 03 03:59:54.531855 ip-10-0-132-105 kubenswrapper[2570]: I0603 03:59:54.531832 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gmwjq_dbb1cda1-6b28-4b7d-9208-55c8b91fdcc5/network-check-target-container/0.log"