Jun 02 01:38:24.703999 ip-10-0-136-21 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:38:24.704011 ip-10-0-136-21 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:38:24.704021 ip-10-0-136-21 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:38:24.704336 ip-10-0-136-21 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:38:36.094953 ip-10-0-136-21 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 01:38:36.094968 ip-10-0-136-21 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2c2f26a9f8b54ed88ae3ded840436d57 -- Jun 02 01:41:10.544987 ip-10-0-136-21 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:41:10.975101 ip-10-0-136-21 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:41:10.975101 ip-10-0-136-21 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:41:10.975101 ip-10-0-136-21 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:41:10.975101 ip-10-0-136-21 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:41:10.975101 ip-10-0-136-21 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:41:10.978235 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.978094 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:41:10.983586 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983570 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983589 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983593 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983596 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983599 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983602 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983605 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983608 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983611 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983614 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983622 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983625 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983628 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983630 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983633 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:41:10.983629 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983636 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983639 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983642 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983644 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983647 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983650 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983654 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983657 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983660 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983663 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983665 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983668 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983671 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983674 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983677 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983680 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983682 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983702 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983706 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983711 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:41:10.984004 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983715 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983718 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983720 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983723 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983725 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983728 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983730 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983733 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983735 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983737 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983740 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983743 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983746 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983748 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983753 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983756 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983759 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983763 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983765 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983768 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:41:10.984486 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983770 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983773 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983775 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983778 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983780 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983783 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983786 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983790 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983794 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983797 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983800 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983803 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983806 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983809 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983811 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983814 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983817 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983819 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983822 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:41:10.985032 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983824 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983828 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983830 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983833 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983835 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983838 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983841 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983844 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983847 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983850 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983853 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.983855 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984278 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984285 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984287 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984290 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984294 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984298 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984301 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:41:10.985576 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984304 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984306 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984309 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984311 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984314 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984316 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984320 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984322 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984325 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984327 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984330 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984332 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984336 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984338 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984341 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984343 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984346 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984348 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984351 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:41:10.986272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984353 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984357 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984360 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984362 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984366 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984369 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984373 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984375 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984378 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984381 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984384 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984386 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984389 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984393 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984396 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984399 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984402 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984405 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984407 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:41:10.986769 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984410 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984413 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984416 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984419 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984421 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984424 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984427 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984429 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984432 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984434 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984439 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984442 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984444 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984446 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984449 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984452 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984454 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984457 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984460 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984462 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:41:10.987262 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984465 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984467 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984470 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984472 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984475 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984477 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984480 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984482 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984485 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984487 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984490 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984493 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984496 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984498 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984504 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984506 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984509 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984511 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984514 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984516 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:41:10.987819 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.984518 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985174 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985185 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985283 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985290 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985298 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985304 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985314 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985322 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985328 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985340 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.985346 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987193 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987319 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987324 2563 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987328 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987331 2563 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987334 2563 flags.go:64] FLAG: --cloud-config="" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987337 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987341 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987348 2563 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987351 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987355 2563 flags.go:64] FLAG: --config-dir="" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987358 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987363 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:41:10.988310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987376 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987379 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987382 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987386 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987389 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987393 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987396 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987400 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987403 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987407 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987411 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987413 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987417 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987421 2563 flags.go:64] FLAG: --enable-server="true" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987424 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987430 2563 flags.go:64] FLAG: --event-burst="100" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987434 2563 flags.go:64] FLAG: --event-qps="50" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987437 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987440 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987443 2563 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987454 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987458 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987461 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987464 2563 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987467 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:41:10.988949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987470 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987473 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987476 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987479 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987482 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987485 2563 flags.go:64] FLAG: --feature-gates="" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987489 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987492 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987495 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987498 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987502 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987505 2563 flags.go:64] FLAG: --help="false" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987508 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-21.ec2.internal" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987511 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987514 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987517 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987520 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987524 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987527 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987530 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987533 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987536 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987539 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987542 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:41:10.989556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987545 2563 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987548 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987551 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987555 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987558 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987561 2563 flags.go:64] FLAG: --lock-file="" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987563 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987567 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987570 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987575 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987578 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987581 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987584 2563 flags.go:64] FLAG: --logging-format="text" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987587 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987590 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987606 2563 flags.go:64] FLAG: --manifest-url="" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987611 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987616 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987620 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987625 2563 flags.go:64] FLAG: --max-pods="110" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987628 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987630 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987633 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987636 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987640 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:41:10.990158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987643 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987646 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987656 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987659 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987662 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987665 2563 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987668 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987674 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987677 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987681 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987684 2563 flags.go:64] FLAG: --port="10250" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987704 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987709 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0180a8651e4cceb17" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987715 2563 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987718 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987721 2563 flags.go:64] FLAG: --register-node="true" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987724 2563 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987727 2563 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987731 2563 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987734 2563 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987737 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987740 2563 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987744 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987747 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987751 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:41:10.990766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987754 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987757 2563 flags.go:64] FLAG: --runonce="false" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987760 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987763 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987766 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987769 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987772 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987775 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987778 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987781 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987784 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987788 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987791 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987794 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987797 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987800 2563 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987803 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987810 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987814 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987817 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987821 2563 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987825 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987827 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987837 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987840 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:41:10.991423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987844 2563 flags.go:64] FLAG: --v="2" Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987848 2563 flags.go:64] FLAG: --version="false" Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987853 2563 flags.go:64] FLAG: --vmodule="" Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987857 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.987860 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987965 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987969 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987973 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987976 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987980 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987984 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987986 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987989 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987991 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987994 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.987997 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988000 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988003 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988006 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988008 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988011 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:41:10.992025 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988013 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988016 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988019 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988021 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988028 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988030 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988033 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988035 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988038 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988041 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988049 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988052 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988054 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988058 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988061 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988063 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988066 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988068 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988071 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:41:10.992554 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988074 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988076 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988079 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988081 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988084 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988087 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988089 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988092 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988094 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988097 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988100 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988102 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988105 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988107 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988110 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988112 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988115 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988119 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988122 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988124 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:41:10.993097 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988127 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988130 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988132 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988135 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988143 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988146 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988148 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988150 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988153 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988155 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988158 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988160 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988163 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988165 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988168 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988170 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988173 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988175 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988178 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:41:10.993606 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988180 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988183 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988186 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988190 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988194 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988197 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988199 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988202 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988205 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988208 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988212 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.988215 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:41:10.994120 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.988835 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:41:10.995506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.995462 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:41:10.995506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.995482 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995528 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995532 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995536 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995539 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995542 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995544 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995547 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995550 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995553 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995557 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995561 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995564 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995567 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995570 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995572 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995575 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:41:10.995570 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995578 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995581 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995584 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995587 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995589 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995592 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995595 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995597 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995600 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995602 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995605 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995608 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995610 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995613 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995615 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995619 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995621 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995624 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995626 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995629 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:41:10.996052 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995632 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995634 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995637 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995639 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995642 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995644 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995647 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995650 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995652 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995655 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995657 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995660 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995662 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995665 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995668 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995671 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995673 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995676 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995680 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995685 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:41:10.996545 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995704 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995709 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995714 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995718 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995721 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995724 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995726 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995729 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995733 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995735 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995739 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995742 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995744 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995747 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995749 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995752 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995754 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995757 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995760 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:41:10.997059 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995762 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995765 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995767 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995770 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995772 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995775 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995777 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995780 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995783 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995786 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995788 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.995794 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995895 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995900 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995903 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995906 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:41:10.997537 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995909 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995912 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995914 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995917 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995919 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995922 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995928 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995931 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995933 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995936 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995938 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995941 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995944 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995946 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995949 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995951 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995954 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995957 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995959 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:41:10.997960 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995962 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995964 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995966 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995969 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995972 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995974 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995977 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995979 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995982 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995984 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995987 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995989 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995992 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995996 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.995999 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996002 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996004 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996007 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996009 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:41:10.998421 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996012 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996015 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996018 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996020 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996023 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996025 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996027 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996030 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996032 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996035 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996037 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996040 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996042 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996046 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996049 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996052 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996055 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996058 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996061 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996064 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:41:10.998899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996067 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996069 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996072 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996074 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996077 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996079 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996082 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996085 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996087 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996090 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996092 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996095 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996097 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996100 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996103 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996105 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996108 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996110 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996113 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996115 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:41:10.999388 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996117 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:41:10.999899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996120 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:41:10.999899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996122 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:41:10.999899 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:10.996125 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:41:10.999899 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.996129 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:41:10.999899 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.996819 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:41:10.999899 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:10.999513 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:41:11.000740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.000728 2563 server.go:1019] "Starting client certificate rotation" Jun 02 01:41:11.000852 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.000838 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:41:11.000886 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.000875 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:41:11.025509 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.025488 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:41:11.026711 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.026680 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:41:11.045929 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.045902 2563 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:41:11.052487 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.052469 2563 log.go:25] "Validated CRI v1 image API" Jun 02 01:41:11.053865 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.053846 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:41:11.055522 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.055500 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:41:11.059122 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.059100 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7efadcd3-6426-453e-90a7-a783a2b9e4be:/dev/nvme0n1p3 be147188-16bc-4697-bf55-25db4242c445:/dev/nvme0n1p4] Jun 02 01:41:11.059184 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.059122 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:41:11.063459 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.063347 2563 manager.go:217] Machine: {Timestamp:2026-06-02 01:41:11.062856325 +0000 UTC m=+0.400538112 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103426 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208745ea892af674532a54c28d7752 SystemUUID:ec208745-ea89-2af6-7453-2a54c28d7752 BootID:2c2f26a9-f8b5-4ed8-8ae3-ded840436d57 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:05:7a:cc:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:05:7a:cc:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:14:e7:d6:28:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:41:11.063459 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.063456 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:41:11.063562 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.063535 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:41:11.065275 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.065250 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:41:11.065429 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.065277 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:41:11.065475 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.065440 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:41:11.065475 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.065449 2563 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:41:11.065475 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.065461 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:41:11.066174 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.066163 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:41:11.066937 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.066927 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:41:11.067045 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.067037 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:41:11.069082 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.069071 2563 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:41:11.069119 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.069092 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:41:11.069119 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.069107 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:41:11.069119 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.069117 2563 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:41:11.069241 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.069130 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:41:11.070892 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.070877 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:41:11.070892 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.070895 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:41:11.073920 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.073898 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:41:11.075841 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.075829 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:41:11.077953 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077934 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:41:11.077953 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077952 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077958 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077964 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077973 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077982 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.077998 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078004 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078011 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078018 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078029 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:41:11.078057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078035 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:41:11.078923 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078911 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:41:11.078923 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.078922 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:41:11.081994 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.081982 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:41:11.082028 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.082018 2563 server.go:1295] "Started kubelet" Jun 02 01:41:11.082590 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.082531 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:41:11.082655 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.082622 2563 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:41:11.082814 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.082782 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:41:11.082877 ip-10-0-136-21 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:41:11.082983 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.082885 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kd24j" Jun 02 01:41:11.083275 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.083180 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:41:11.083362 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.083325 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:41:11.083362 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.083326 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:41:11.084020 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.084001 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:41:11.086719 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.086682 2563 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:41:11.089615 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.089581 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:41:11.089908 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.089886 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:41:11.090026 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090013 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:41:11.090364 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090088 2563 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:41:11.090364 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090103 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:41:11.090364 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090154 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:41:11.090364 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090210 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:41:11.090364 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090218 2563 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:41:11.090783 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.090763 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.090857 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090783 2563 factory.go:55] Registering systemd factory Jun 02 01:41:11.090857 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090800 2563 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:41:11.091004 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.090991 2563 factory.go:153] Registering CRI-O factory Jun 02 01:41:11.091004 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.091005 2563 factory.go:223] Registration of the crio container factory successfully Jun 02 01:41:11.091098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.091046 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:41:11.091098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.091061 2563 factory.go:103] Registering Raw factory Jun 02 01:41:11.091098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.091071 2563 manager.go:1196] Started watching for new ooms in manager Jun 02 01:41:11.091650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.091631 2563 manager.go:319] Starting recovery of all containers Jun 02 01:41:11.093558 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.093537 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kd24j" Jun 02 01:41:11.098158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.098034 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:41:11.101347 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.101326 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:41:11.102531 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.102516 2563 manager.go:324] Recovery completed Jun 02 01:41:11.105090 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.104957 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-21.ec2.internal\" not found" node="ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.106778 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.106762 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:41:11.108972 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.108957 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:41:11.109033 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.108985 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:41:11.109033 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.108995 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:41:11.110953 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.110932 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:41:11.110953 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.110951 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:41:11.111087 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.110971 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:41:11.113186 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.113174 2563 policy_none.go:49] "None policy: Start" Jun 02 01:41:11.113225 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.113190 2563 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:41:11.113225 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.113201 2563 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:41:11.160366 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160313 2563 manager.go:341] "Starting Device Plugin manager" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.160383 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160397 2563 server.go:85] "Starting device plugin registration server" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160666 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160679 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160812 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160924 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.160933 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.161512 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:41:11.161650 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.161551 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.231810 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.231777 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:41:11.231810 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.231811 2563 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:41:11.232022 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.231884 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:41:11.232022 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.231891 2563 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:41:11.232022 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.231929 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:41:11.234054 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.234035 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:41:11.261735 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.261672 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:41:11.263177 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.263161 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:41:11.263257 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.263190 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:41:11.263257 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.263200 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:41:11.263257 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.263225 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.270759 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.270742 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.270858 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.270768 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-21.ec2.internal\": node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.287944 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.287920 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.332372 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.332343 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal"] Jun 02 01:41:11.332453 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.332442 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:41:11.334586 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.334566 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:41:11.334669 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.334596 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:41:11.334669 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.334607 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:41:11.335772 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.335759 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:41:11.335984 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.335967 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.336051 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336006 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:41:11.336479 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336466 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:41:11.336479 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336478 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:41:11.336595 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336507 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:41:11.336595 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336520 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:41:11.336595 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336520 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:41:11.336595 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.336540 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:41:11.337766 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.337754 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.337816 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.337777 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:41:11.338476 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.338454 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:41:11.338556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.338483 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:41:11.338556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.338495 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:41:11.363365 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.363345 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-21.ec2.internal\" not found" node="ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.367849 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.367832 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-21.ec2.internal\" not found" node="ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.388988 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.388959 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.392700 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.392675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/384fbc8d4420caadff09155e9add6c26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal\" (UID: \"384fbc8d4420caadff09155e9add6c26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.392785 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.392715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384fbc8d4420caadff09155e9add6c26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal\" (UID: \"384fbc8d4420caadff09155e9add6c26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.392785 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.392741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c1d0764ab816f2414eebb439f0782a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-21.ec2.internal\" (UID: \"60c1d0764ab816f2414eebb439f0782a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.490041 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.490004 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.493324 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.493308 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c1d0764ab816f2414eebb439f0782a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-21.ec2.internal\" (UID: \"60c1d0764ab816f2414eebb439f0782a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.493401 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.493333 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/384fbc8d4420caadff09155e9add6c26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal\" (UID: \"384fbc8d4420caadff09155e9add6c26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.493401 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.493361 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384fbc8d4420caadff09155e9add6c26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal\" (UID: \"384fbc8d4420caadff09155e9add6c26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.493494 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.493421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/384fbc8d4420caadff09155e9add6c26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal\" (UID: \"384fbc8d4420caadff09155e9add6c26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.493542 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.493502 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c1d0764ab816f2414eebb439f0782a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-21.ec2.internal\" (UID: \"60c1d0764ab816f2414eebb439f0782a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.493584 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.493554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384fbc8d4420caadff09155e9add6c26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal\" (UID: \"384fbc8d4420caadff09155e9add6c26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.590771 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.590709 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.667041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.667008 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.671538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.671517 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" Jun 02 01:41:11.691217 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.691188 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.791643 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.791606 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.892094 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.892013 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.992653 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:11.992621 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-21.ec2.internal\" not found" Jun 02 01:41:11.999914 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:11.999898 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:41:12.000057 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.000027 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:41:12.000126 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.000075 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:41:12.050781 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.050756 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:41:12.070162 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.070137 2563 apiserver.go:52] "Watching apiserver" Jun 02 01:41:12.079783 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.079760 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:41:12.081700 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.081660 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-fz4zd","openshift-network-operator/iptables-alerter-87lq2","openshift-ovn-kubernetes/ovnkube-node-b25gz","openshift-dns/node-resolver-q7tsb","openshift-multus/multus-27lt8","openshift-network-diagnostics/network-check-target-595j9","kube-system/konnectivity-agent-7lw8m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv","openshift-cluster-node-tuning-operator/tuned-4n5p9","openshift-image-registry/node-ca-2fvx9","openshift-multus/multus-additional-cni-plugins-p82jm"] Jun 02 01:41:12.084074 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.084051 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.084176 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.084138 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:12.085203 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.085183 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.086195 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.086170 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.087118 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.087097 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.087223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.087192 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.087853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.087800 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.087938 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.087911 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.088580 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.088562 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:41:12.089073 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089051 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:41:12.089176 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089140 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxtc8\"" Jun 02 01:41:12.089238 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089223 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:41:12.089295 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089254 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.090182 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089765 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:41:12.090182 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089863 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tr5xm\"" Jun 02 01:41:12.090182 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.089961 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:12.090182 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.090043 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:12.090506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.090219 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.090506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.090471 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:41:12.090661 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.090471 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.090761 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.090516 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" Jun 02 01:41:12.090874 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.090853 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-29sxf\"" Jun 02 01:41:12.091252 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.091232 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.091391 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.091369 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:41:12.091452 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.091402 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.091606 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.091589 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:41:12.091879 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.091858 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p4mwz\"" Jun 02 01:41:12.092096 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.092078 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.094340 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.094323 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:41:12.094504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.094490 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.095095 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095010 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:36:11 +0000 UTC" deadline="2028-03-12 15:59:31.40846334 +0000 UTC" Jun 02 01:41:12.095095 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095040 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15590h18m19.31342799s" Jun 02 01:41:12.095878 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095862 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.095965 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.095965 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-run-ovn-kubernetes\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.095965 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-env-overrides\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.095978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-cni-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37486945-b5e9-492b-a3b6-5e6fc8387821-cni-binary-copy\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-conf-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-etc-kubernetes\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/315d2a53-8aa4-4253-af06-7589c3b7e1e4-host-slash\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-ovnkube-script-lib\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-system-cni-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-os-release\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-daemon-config\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4wg\" (UniqueName: \"kubernetes.io/projected/37486945-b5e9-492b-a3b6-5e6fc8387821-kube-api-access-lt4wg\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-node-log\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-cni-bin\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-kubelet\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0e444de-8842-4b03-9636-c1bdc905be11-ovn-node-metrics-cert\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bff18d3-6203-492f-80f3-64b9af1944dc-konnectivity-ca\") pod \"konnectivity-agent-7lw8m\" (UID: \"9bff18d3-6203-492f-80f3-64b9af1944dc\") " pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-run-netns\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-var-lib-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-ovn\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-k8s-cni-cncf-io\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-cni-multus\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-multus-certs\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvls\" (UniqueName: \"kubernetes.io/projected/315d2a53-8aa4-4253-af06-7589c3b7e1e4-kube-api-access-8wvls\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-kubelet\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-systemd-units\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-etc-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-cni-netd\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-ovnkube-config\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlgwr\" (UniqueName: \"kubernetes.io/projected/643acb0c-7c2f-44ae-b679-debd7548436e-kube-api-access-nlgwr\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/315d2a53-8aa4-4253-af06-7589c3b7e1e4-iptables-alerter-script\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-log-socket\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlg2p\" (UniqueName: \"kubernetes.io/projected/e0e444de-8842-4b03-9636-c1bdc905be11-kube-api-access-wlg2p\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/643acb0c-7c2f-44ae-b679-debd7548436e-hosts-file\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/643acb0c-7c2f-44ae-b679-debd7548436e-tmp-dir\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.096853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-cnibin\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-socket-dir-parent\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p4wk\" (UniqueName: \"kubernetes.io/projected/c961f928-3c35-495d-b28c-0e59d04c8e3a-kube-api-access-4p4wk\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-systemd\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-cni-bin\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-netns\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-hostroot\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.096963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.097009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bff18d3-6203-492f-80f3-64b9af1944dc-agent-certs\") pod \"konnectivity-agent-7lw8m\" (UID: \"9bff18d3-6203-492f-80f3-64b9af1944dc\") " pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.097038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-slash\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.097140 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9pqwn\"" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.097155 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.097211 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:41:12.097466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.097253 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.098103 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.098089 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:41:12.098206 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.098192 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.098257 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.098217 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.098257 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.098231 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vcwnn\"" Jun 02 01:41:12.098990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.098467 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.099646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.099624 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.099646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.099645 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.099817 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.099672 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.099817 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.099720 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wd4bz\"" Jun 02 01:41:12.100870 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.100852 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:41:12.100972 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.100901 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qlxkf\"" Jun 02 01:41:12.100972 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.100905 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:41:12.101084 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.101033 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:41:12.101929 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.101907 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gwhgw\"" Jun 02 01:41:12.102070 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.102051 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:41:12.102147 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.102061 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:41:12.111441 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.111423 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:41:12.114089 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.114074 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:41:12.114148 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.114135 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" Jun 02 01:41:12.114188 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.114153 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal"] Jun 02 01:41:12.123415 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.123397 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal"] Jun 02 01:41:12.123979 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.123965 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:41:12.130159 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.130145 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zh9pd" Jun 02 01:41:12.137275 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.137259 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zh9pd" Jun 02 01:41:12.152411 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.152387 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c1d0764ab816f2414eebb439f0782a.slice/crio-0b7eb3bb0e042e8f7502b605c7232c43941f86cfca563c0f7a9b08600cbb356c WatchSource:0}: Error finding container 0b7eb3bb0e042e8f7502b605c7232c43941f86cfca563c0f7a9b08600cbb356c: Status 404 returned error can't find the container with id 0b7eb3bb0e042e8f7502b605c7232c43941f86cfca563c0f7a9b08600cbb356c Jun 02 01:41:12.152668 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.152653 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384fbc8d4420caadff09155e9add6c26.slice/crio-a12f9647911d73952f54f89fd3281fa9314c6fa071fe9518206e62e8a4c33710 WatchSource:0}: Error finding container a12f9647911d73952f54f89fd3281fa9314c6fa071fe9518206e62e8a4c33710: Status 404 returned error can't find the container with id a12f9647911d73952f54f89fd3281fa9314c6fa071fe9518206e62e8a4c33710 Jun 02 01:41:12.157890 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.157873 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:41:12.190788 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.190771 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:41:12.197834 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197813 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-sys\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.197925 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-host\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.197925 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6ch\" (UniqueName: \"kubernetes.io/projected/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-kube-api-access-5h6ch\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.197925 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198038 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197922 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-env-overrides\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198038 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198038 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.197991 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4wg\" (UniqueName: \"kubernetes.io/projected/37486945-b5e9-492b-a3b6-5e6fc8387821-kube-api-access-lt4wg\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198142 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198061 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/315d2a53-8aa4-4253-af06-7589c3b7e1e4-host-slash\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.198191 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198145 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-daemon-config\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198191 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/315d2a53-8aa4-4253-af06-7589c3b7e1e4-host-slash\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.198191 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-sys-fs\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.198291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198206 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-kubelet\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-systemd\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.198291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-var-lib-kubelet\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.198291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.198413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-env-overrides\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-kubelet\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-etc-selinux\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.198413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-modprobe-d\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-system-cni-dir\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198435 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-run-netns\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198450 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-k8s-cni-cncf-io\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-run-netns\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.198538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-registration-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysconfig\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198567 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-k8s-cni-cncf-io\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198584 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-kubelet\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-cni-netd\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198623 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-ovnkube-config\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198632 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-kubelet\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198644 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlgwr\" (UniqueName: \"kubernetes.io/projected/643acb0c-7c2f-44ae-b679-debd7548436e-kube-api-access-nlgwr\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.198656 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-device-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-cni-netd\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-daemon-config\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.198784 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.198754 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:12.69868479 +0000 UTC m=+2.036366575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198793 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/315d2a53-8aa4-4253-af06-7589c3b7e1e4-iptables-alerter-script\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198821 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-log-socket\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198846 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlg2p\" (UniqueName: \"kubernetes.io/projected/e0e444de-8842-4b03-9636-c1bdc905be11-kube-api-access-wlg2p\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/643acb0c-7c2f-44ae-b679-debd7548436e-hosts-file\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-log-socket\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198896 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/643acb0c-7c2f-44ae-b679-debd7548436e-tmp-dir\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198934 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-cnibin\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-tuned\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.198985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-tmp\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysctl-d\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/643acb0c-7c2f-44ae-b679-debd7548436e-hosts-file\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199036 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4p4wk\" (UniqueName: \"kubernetes.io/projected/c961f928-3c35-495d-b28c-0e59d04c8e3a-kube-api-access-4p4wk\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199101 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-systemd\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199118 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-cnibin\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199127 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-systemd\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.199367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199173 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/643acb0c-7c2f-44ae-b679-debd7548436e-tmp-dir\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199256 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-netns\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199282 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-hostroot\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199308 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-host\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-netns\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199358 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-slash\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/315d2a53-8aa4-4253-af06-7589c3b7e1e4-iptables-alerter-script\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199394 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-run-ovn-kubernetes\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199423 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-hostroot\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-slash\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199467 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-cni-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199482 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-run-ovn-kubernetes\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199500 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37486945-b5e9-492b-a3b6-5e6fc8387821-cni-binary-copy\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199522 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-conf-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx2pq\" (UniqueName: \"kubernetes.io/projected/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-kube-api-access-kx2pq\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-serviceca\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.200130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-conf-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-cni-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-os-release\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199643 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-ovnkube-script-lib\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199658 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-system-cni-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199681 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-os-release\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-system-cni-dir\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199734 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-node-log\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-os-release\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199757 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-cni-bin\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199778 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-cni-bin\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-lib-modules\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88tgd\" (UniqueName: \"kubernetes.io/projected/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-kube-api-access-88tgd\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-node-log\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cnibin\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-socket-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.200837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6txb\" (UniqueName: \"kubernetes.io/projected/03c67262-1b85-4078-8f13-a5429195d1de-kube-api-access-p6txb\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199937 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0e444de-8842-4b03-9636-c1bdc905be11-ovn-node-metrics-cert\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37486945-b5e9-492b-a3b6-5e6fc8387821-cni-binary-copy\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-kubernetes\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.199992 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-var-lib-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-ovnkube-config\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-var-lib-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200087 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-ovn\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200108 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-cni-multus\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200118 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-run-ovn\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200124 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-multus-certs\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-var-lib-cni-multus\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysctl-conf\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-host-run-multus-certs\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200190 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-etc-kubernetes\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200171 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-etc-kubernetes\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0e444de-8842-4b03-9636-c1bdc905be11-ovnkube-script-lib\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200230 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bff18d3-6203-492f-80f3-64b9af1944dc-konnectivity-ca\") pod \"konnectivity-agent-7lw8m\" (UID: \"9bff18d3-6203-492f-80f3-64b9af1944dc\") " pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.201371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200243 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200259 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvls\" (UniqueName: \"kubernetes.io/projected/315d2a53-8aa4-4253-af06-7589c3b7e1e4-kube-api-access-8wvls\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200282 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-systemd-units\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200303 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-etc-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-systemd-units\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200344 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-etc-openvswitch\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200380 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-socket-dir-parent\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37486945-b5e9-492b-a3b6-5e6fc8387821-multus-socket-dir-parent\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200415 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bff18d3-6203-492f-80f3-64b9af1944dc-agent-certs\") pod \"konnectivity-agent-7lw8m\" (UID: \"9bff18d3-6203-492f-80f3-64b9af1944dc\") " pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200463 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-cni-bin\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-run\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0e444de-8842-4b03-9636-c1bdc905be11-host-cni-bin\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.201882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.200704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bff18d3-6203-492f-80f3-64b9af1944dc-konnectivity-ca\") pod \"konnectivity-agent-7lw8m\" (UID: \"9bff18d3-6203-492f-80f3-64b9af1944dc\") " pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.203186 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.203169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0e444de-8842-4b03-9636-c1bdc905be11-ovn-node-metrics-cert\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.203254 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.203232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bff18d3-6203-492f-80f3-64b9af1944dc-agent-certs\") pod \"konnectivity-agent-7lw8m\" (UID: \"9bff18d3-6203-492f-80f3-64b9af1944dc\") " pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.209019 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.209000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4wg\" (UniqueName: \"kubernetes.io/projected/37486945-b5e9-492b-a3b6-5e6fc8387821-kube-api-access-lt4wg\") pod \"multus-27lt8\" (UID: \"37486945-b5e9-492b-a3b6-5e6fc8387821\") " pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.209144 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.209128 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p4wk\" (UniqueName: \"kubernetes.io/projected/c961f928-3c35-495d-b28c-0e59d04c8e3a-kube-api-access-4p4wk\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.209328 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.209313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlgwr\" (UniqueName: \"kubernetes.io/projected/643acb0c-7c2f-44ae-b679-debd7548436e-kube-api-access-nlgwr\") pod \"node-resolver-q7tsb\" (UID: \"643acb0c-7c2f-44ae-b679-debd7548436e\") " pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.209780 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.209766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlg2p\" (UniqueName: \"kubernetes.io/projected/e0e444de-8842-4b03-9636-c1bdc905be11-kube-api-access-wlg2p\") pod \"ovnkube-node-b25gz\" (UID: \"e0e444de-8842-4b03-9636-c1bdc905be11\") " pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.212086 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.212073 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:12.212139 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.212089 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:12.212139 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.212101 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:12.212204 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.212143 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:41:12.712131328 +0000 UTC m=+2.049813083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:12.214421 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.214395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvls\" (UniqueName: \"kubernetes.io/projected/315d2a53-8aa4-4253-af06-7589c3b7e1e4-kube-api-access-8wvls\") pod \"iptables-alerter-87lq2\" (UID: \"315d2a53-8aa4-4253-af06-7589c3b7e1e4\") " pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.235435 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.235389 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" event={"ID":"384fbc8d4420caadff09155e9add6c26","Type":"ContainerStarted","Data":"a12f9647911d73952f54f89fd3281fa9314c6fa071fe9518206e62e8a4c33710"} Jun 02 01:41:12.236353 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.236334 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" event={"ID":"60c1d0764ab816f2414eebb439f0782a","Type":"ContainerStarted","Data":"0b7eb3bb0e042e8f7502b605c7232c43941f86cfca563c0f7a9b08600cbb356c"} Jun 02 01:41:12.301603 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301571 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-host\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.301815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301626 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kx2pq\" (UniqueName: \"kubernetes.io/projected/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-kube-api-access-kx2pq\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.301815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301661 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-serviceca\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.301815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301709 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-os-release\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.301815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301745 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-lib-modules\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.301815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301771 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88tgd\" (UniqueName: \"kubernetes.io/projected/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-kube-api-access-88tgd\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301823 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cnibin\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301854 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301889 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-socket-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301921 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6txb\" (UniqueName: \"kubernetes.io/projected/03c67262-1b85-4078-8f13-a5429195d1de-kube-api-access-p6txb\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301947 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-kubernetes\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.301979 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysctl-conf\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302013 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302045 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-run\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302071 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-sys\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302103 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-host\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302130 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6ch\" (UniqueName: \"kubernetes.io/projected/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-kube-api-access-5h6ch\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302167 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-sys-fs\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302205 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-systemd\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302237 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-var-lib-kubelet\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302267 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302292 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-etc-selinux\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302322 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-modprobe-d\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302351 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-system-cni-dir\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302385 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302419 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302446 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-registration-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302477 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysconfig\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302532 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-device-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302565 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-tuned\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302594 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-tmp\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.302646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302629 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysctl-d\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.303489 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysctl-d\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.303489 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.302899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-host\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.303802 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.303604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-serviceca\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.303802 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.303728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-os-release\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.304063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.303920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-sys-fs\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.304063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.303968 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-system-cni-dir\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.304063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.303981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysconfig\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.303979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.304063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.304063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-socket-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.304431 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304027 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-var-lib-kubelet\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304502 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-kubernetes\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-systemd\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-lib-modules\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cnibin\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.304728 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-sys\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304728 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-host\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.304821 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-device-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.304884 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-etc-selinux\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.305021 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.305021 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03c67262-1b85-4078-8f13-a5429195d1de-registration-dir\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.305021 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-modprobe-d\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.305021 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.304984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-run\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.305348 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.305075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-sysctl-conf\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.305755 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.305736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.306020 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.305997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.306627 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.306600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-tmp\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.306627 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.306625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-etc-tuned\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.313258 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.313236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx2pq\" (UniqueName: \"kubernetes.io/projected/191dd7e2-eb3e-4426-bdf2-e4d8be564b17-kube-api-access-kx2pq\") pod \"tuned-4n5p9\" (UID: \"191dd7e2-eb3e-4426-bdf2-e4d8be564b17\") " pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.313422 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.313407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6ch\" (UniqueName: \"kubernetes.io/projected/69def33a-baf2-4860-bfb2-aba5fc3fbc6e-kube-api-access-5h6ch\") pod \"multus-additional-cni-plugins-p82jm\" (UID: \"69def33a-baf2-4860-bfb2-aba5fc3fbc6e\") " pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.313545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.313531 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6txb\" (UniqueName: \"kubernetes.io/projected/03c67262-1b85-4078-8f13-a5429195d1de-kube-api-access-p6txb\") pod \"aws-ebs-csi-driver-node-cj7gv\" (UID: \"03c67262-1b85-4078-8f13-a5429195d1de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.313812 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.313798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88tgd\" (UniqueName: \"kubernetes.io/projected/13f2ae2d-6ac9-46b2-ad29-cfcf51af7465-kube-api-access-88tgd\") pod \"node-ca-2fvx9\" (UID: \"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465\") " pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.420019 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.419941 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-87lq2" Jun 02 01:41:12.427272 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.427246 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315d2a53_8aa4_4253_af06_7589c3b7e1e4.slice/crio-bb8d6da9d14c3e1b6f941b1390744456d5154791f90cf0f77b0407f4d874c7f1 WatchSource:0}: Error finding container bb8d6da9d14c3e1b6f941b1390744456d5154791f90cf0f77b0407f4d874c7f1: Status 404 returned error can't find the container with id bb8d6da9d14c3e1b6f941b1390744456d5154791f90cf0f77b0407f4d874c7f1 Jun 02 01:41:12.432172 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.432155 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:12.437657 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.437633 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e444de_8842_4b03_9636_c1bdc905be11.slice/crio-71b0d11f759641ee4759a7be059575332f7fa9f97fbbbaab94bad1f056bc8a36 WatchSource:0}: Error finding container 71b0d11f759641ee4759a7be059575332f7fa9f97fbbbaab94bad1f056bc8a36: Status 404 returned error can't find the container with id 71b0d11f759641ee4759a7be059575332f7fa9f97fbbbaab94bad1f056bc8a36 Jun 02 01:41:12.459962 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.459940 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7tsb" Jun 02 01:41:12.464564 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.464539 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27lt8" Jun 02 01:41:12.465922 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.465899 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643acb0c_7c2f_44ae_b679_debd7548436e.slice/crio-367000a69f156d9fe013e8c8fd527325c7ad744c71028bb7e8afb412fd8962d3 WatchSource:0}: Error finding container 367000a69f156d9fe013e8c8fd527325c7ad744c71028bb7e8afb412fd8962d3: Status 404 returned error can't find the container with id 367000a69f156d9fe013e8c8fd527325c7ad744c71028bb7e8afb412fd8962d3 Jun 02 01:41:12.470384 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.470360 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:12.471778 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.471753 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37486945_b5e9_492b_a3b6_5e6fc8387821.slice/crio-fc31608d4f6c86affa999ac195c9279e035d45d6b858a8b7baf40d5958fa73ac WatchSource:0}: Error finding container fc31608d4f6c86affa999ac195c9279e035d45d6b858a8b7baf40d5958fa73ac: Status 404 returned error can't find the container with id fc31608d4f6c86affa999ac195c9279e035d45d6b858a8b7baf40d5958fa73ac Jun 02 01:41:12.475616 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.475600 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" Jun 02 01:41:12.476182 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.476166 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bff18d3_6203_492f_80f3_64b9af1944dc.slice/crio-7bd157e96bc3afc57c126f10f305cdc7596c67fbd1d6baf866863cd4c559dc0b WatchSource:0}: Error finding container 7bd157e96bc3afc57c126f10f305cdc7596c67fbd1d6baf866863cd4c559dc0b: Status 404 returned error can't find the container with id 7bd157e96bc3afc57c126f10f305cdc7596c67fbd1d6baf866863cd4c559dc0b Jun 02 01:41:12.481743 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.481722 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c67262_1b85_4078_8f13_a5429195d1de.slice/crio-ec58d75222166b23068fe6a40e505c36ff812d9d7b71f0d8ff98b6a0be6f2095 WatchSource:0}: Error finding container ec58d75222166b23068fe6a40e505c36ff812d9d7b71f0d8ff98b6a0be6f2095: Status 404 returned error can't find the container with id ec58d75222166b23068fe6a40e505c36ff812d9d7b71f0d8ff98b6a0be6f2095 Jun 02 01:41:12.482363 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.482346 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" Jun 02 01:41:12.487771 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.487753 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2fvx9" Jun 02 01:41:12.488278 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.488251 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191dd7e2_eb3e_4426_bdf2_e4d8be564b17.slice/crio-8ddafaebb83c27bd7a94796559a58c7fafe0d555dc43ac66c026943a2f70c558 WatchSource:0}: Error finding container 8ddafaebb83c27bd7a94796559a58c7fafe0d555dc43ac66c026943a2f70c558: Status 404 returned error can't find the container with id 8ddafaebb83c27bd7a94796559a58c7fafe0d555dc43ac66c026943a2f70c558 Jun 02 01:41:12.492478 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.492462 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p82jm" Jun 02 01:41:12.493679 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.493656 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f2ae2d_6ac9_46b2_ad29_cfcf51af7465.slice/crio-1c1b9fe3da218d04b363bcf365afb2e098d5ad8bcbd7dec08af1263c8f921098 WatchSource:0}: Error finding container 1c1b9fe3da218d04b363bcf365afb2e098d5ad8bcbd7dec08af1263c8f921098: Status 404 returned error can't find the container with id 1c1b9fe3da218d04b363bcf365afb2e098d5ad8bcbd7dec08af1263c8f921098 Jun 02 01:41:12.498248 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:12.498231 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69def33a_baf2_4860_bfb2_aba5fc3fbc6e.slice/crio-a6a19d7f7a9022b7f7331adb86d5e2877b9c99d1f7a5457992e697e01549b016 WatchSource:0}: Error finding container a6a19d7f7a9022b7f7331adb86d5e2877b9c99d1f7a5457992e697e01549b016: Status 404 returned error can't find the container with id a6a19d7f7a9022b7f7331adb86d5e2877b9c99d1f7a5457992e697e01549b016 Jun 02 01:41:12.583905 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.583878 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:41:12.705431 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.705346 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:12.705586 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.705492 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:12.705586 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.705555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:13.705539871 +0000 UTC m=+3.043221625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:12.805911 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.805877 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:12.806082 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.806029 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:12.806082 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.806047 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:12.806082 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.806059 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:12.806240 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:12.806116 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:41:13.806096542 +0000 UTC m=+3.143778298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:12.944516 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:12.944487 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:41:13.010903 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.010585 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:41:13.138129 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.138085 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:36:12 +0000 UTC" deadline="2027-12-20 00:50:45.876895311 +0000 UTC" Jun 02 01:41:13.138129 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.138125 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13583h9m32.738774014s" Jun 02 01:41:13.273532 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.273275 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" event={"ID":"191dd7e2-eb3e-4426-bdf2-e4d8be564b17","Type":"ContainerStarted","Data":"8ddafaebb83c27bd7a94796559a58c7fafe0d555dc43ac66c026943a2f70c558"} Jun 02 01:41:13.279853 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.279790 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" event={"ID":"03c67262-1b85-4078-8f13-a5429195d1de","Type":"ContainerStarted","Data":"ec58d75222166b23068fe6a40e505c36ff812d9d7b71f0d8ff98b6a0be6f2095"} Jun 02 01:41:13.290180 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.290144 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27lt8" event={"ID":"37486945-b5e9-492b-a3b6-5e6fc8387821","Type":"ContainerStarted","Data":"fc31608d4f6c86affa999ac195c9279e035d45d6b858a8b7baf40d5958fa73ac"} Jun 02 01:41:13.300242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.300129 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7tsb" event={"ID":"643acb0c-7c2f-44ae-b679-debd7548436e","Type":"ContainerStarted","Data":"367000a69f156d9fe013e8c8fd527325c7ad744c71028bb7e8afb412fd8962d3"} Jun 02 01:41:13.318823 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.318787 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-87lq2" event={"ID":"315d2a53-8aa4-4253-af06-7589c3b7e1e4","Type":"ContainerStarted","Data":"bb8d6da9d14c3e1b6f941b1390744456d5154791f90cf0f77b0407f4d874c7f1"} Jun 02 01:41:13.325485 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.325453 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerStarted","Data":"a6a19d7f7a9022b7f7331adb86d5e2877b9c99d1f7a5457992e697e01549b016"} Jun 02 01:41:13.336528 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.336487 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2fvx9" event={"ID":"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465","Type":"ContainerStarted","Data":"1c1b9fe3da218d04b363bcf365afb2e098d5ad8bcbd7dec08af1263c8f921098"} Jun 02 01:41:13.355621 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.355585 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7lw8m" event={"ID":"9bff18d3-6203-492f-80f3-64b9af1944dc","Type":"ContainerStarted","Data":"7bd157e96bc3afc57c126f10f305cdc7596c67fbd1d6baf866863cd4c559dc0b"} Jun 02 01:41:13.364159 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.364124 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"71b0d11f759641ee4759a7be059575332f7fa9f97fbbbaab94bad1f056bc8a36"} Jun 02 01:41:13.715518 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.715440 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:13.715712 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:13.715610 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:13.715712 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:13.715675 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:15.715657325 +0000 UTC m=+5.053339096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:13.818076 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:13.816822 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:13.818076 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:13.816988 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:13.818076 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:13.817007 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:13.818076 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:13.817020 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:13.818076 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:13.817079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:41:15.817059571 +0000 UTC m=+5.154741343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:14.138656 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:14.138567 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:36:12 +0000 UTC" deadline="2028-02-29 18:41:37.384592452 +0000 UTC" Jun 02 01:41:14.138656 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:14.138610 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15305h0m23.245986389s" Jun 02 01:41:14.232815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:14.232785 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:14.232997 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:14.232909 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:14.233370 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:14.233350 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:14.233477 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:14.233457 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:15.737092 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:15.736967 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:15.737456 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:15.737186 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:15.737456 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:15.737258 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:19.737236401 +0000 UTC m=+9.074918167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:15.838438 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:15.838398 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:15.838608 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:15.838579 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:15.838608 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:15.838608 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:15.838754 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:15.838622 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:15.838754 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:15.838705 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:41:19.838670729 +0000 UTC m=+9.176352491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:16.232949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:16.232869 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:16.233097 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:16.233001 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:16.233607 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:16.233379 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:16.233607 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:16.233493 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:18.232808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:18.232771 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:18.233284 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:18.232914 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:18.233284 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:18.232996 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:18.233284 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:18.233132 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:19.769215 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:19.769178 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:19.769656 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:19.769358 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:19.769656 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:19.769414 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:27.769398598 +0000 UTC m=+17.107080357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:19.869578 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:19.869527 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:19.869781 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:19.869741 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:19.869781 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:19.869762 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:19.869781 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:19.869775 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:19.869932 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:19.869833 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:41:27.869814591 +0000 UTC m=+17.207496347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:20.233205 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:20.233117 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:20.233205 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:20.233153 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:20.233428 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:20.233263 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:20.233428 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:20.233403 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:22.232417 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:22.232386 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:22.232873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:22.232401 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:22.232873 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:22.232500 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:22.232873 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:22.232650 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:23.164457 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.164375 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s22s5"] Jun 02 01:41:23.188475 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.188443 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.188678 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:23.188529 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:23.298508 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.298475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-dbus\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.298959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.298520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.298959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.298662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-kubelet-config\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.399325 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.399285 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-kubelet-config\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.399485 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.399351 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-dbus\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.399485 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.399379 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.399485 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.399433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-kubelet-config\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.399625 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:23.399485 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:23.399625 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:23.399546 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret podName:ef2189f3-a073-4b40-a460-31b5a3dfa4a0 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:23.899529275 +0000 UTC m=+13.237211029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret") pod "global-pull-secret-syncer-s22s5" (UID: "ef2189f3-a073-4b40-a460-31b5a3dfa4a0") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:23.399625 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.399598 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-dbus\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.903983 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:23.903946 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:23.904170 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:23.904114 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:23.904230 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:23.904193 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret podName:ef2189f3-a073-4b40-a460-31b5a3dfa4a0 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:24.904171892 +0000 UTC m=+14.241853648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret") pod "global-pull-secret-syncer-s22s5" (UID: "ef2189f3-a073-4b40-a460-31b5a3dfa4a0") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:24.232426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:24.232349 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:24.232587 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:24.232472 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:24.232587 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:24.232529 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:24.232714 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:24.232648 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:24.912849 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:24.912810 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:24.913326 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:24.912970 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:24.913326 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:24.913061 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret podName:ef2189f3-a073-4b40-a460-31b5a3dfa4a0 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:26.91303459 +0000 UTC m=+16.250716350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret") pod "global-pull-secret-syncer-s22s5" (UID: "ef2189f3-a073-4b40-a460-31b5a3dfa4a0") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:25.232966 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:25.232861 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:25.233221 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:25.233000 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:26.232946 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:26.232905 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:26.233421 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:26.232913 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:26.233421 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:26.233039 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:26.233421 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:26.233134 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:26.930013 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:26.929521 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:26.930173 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:26.929814 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:26.930173 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:26.930173 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret podName:ef2189f3-a073-4b40-a460-31b5a3dfa4a0 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:30.930152733 +0000 UTC m=+20.267834508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret") pod "global-pull-secret-syncer-s22s5" (UID: "ef2189f3-a073-4b40-a460-31b5a3dfa4a0") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:27.232352 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.232317 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:27.232518 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.232467 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:27.402110 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.402057 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" event={"ID":"60c1d0764ab816f2414eebb439f0782a","Type":"ContainerStarted","Data":"5ba7a9007636b69471dea957b3cd946280ac1151affd53d9282e1ade4f19e1c5"} Jun 02 01:41:27.404140 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.404117 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" event={"ID":"191dd7e2-eb3e-4426-bdf2-e4d8be564b17","Type":"ContainerStarted","Data":"05a1e2cfbf159d340e06c4cdfbd301df884eebe7b0ba57bc4cc73cf85ca1e467"} Jun 02 01:41:27.405389 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.405369 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27lt8" event={"ID":"37486945-b5e9-492b-a3b6-5e6fc8387821","Type":"ContainerStarted","Data":"723f4eb4e0352559d119b28f7c3b6d3d249a13a240cc0c6b363ff11e21870402"} Jun 02 01:41:27.415372 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.415310 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-21.ec2.internal" podStartSLOduration=15.415296687 podStartE2EDuration="15.415296687s" podCreationTimestamp="2026-06-02 01:41:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:41:27.415269388 +0000 UTC m=+16.752951166" watchObservedRunningTime="2026-06-02 01:41:27.415296687 +0000 UTC m=+16.752978465" Jun 02 01:41:27.445422 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.445373 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4n5p9" podStartSLOduration=2.419380762 podStartE2EDuration="16.445359054s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.489452783 +0000 UTC m=+1.827134539" lastFinishedPulling="2026-06-02 01:41:26.515431075 +0000 UTC m=+15.853112831" observedRunningTime="2026-06-02 01:41:27.4453124 +0000 UTC m=+16.782994177" watchObservedRunningTime="2026-06-02 01:41:27.445359054 +0000 UTC m=+16.783040830" Jun 02 01:41:27.445789 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.445765 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-27lt8" podStartSLOduration=2.060526233 podStartE2EDuration="16.445758774s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.473190628 +0000 UTC m=+1.810872383" lastFinishedPulling="2026-06-02 01:41:26.858423167 +0000 UTC m=+16.196104924" observedRunningTime="2026-06-02 01:41:27.430730024 +0000 UTC m=+16.768411804" watchObservedRunningTime="2026-06-02 01:41:27.445758774 +0000 UTC m=+16.783440614" Jun 02 01:41:27.837362 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.837283 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:27.837517 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.837427 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:27.837517 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.837488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:43.837473214 +0000 UTC m=+33.175154973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:27.937763 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:27.937730 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:27.937949 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.937924 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:27.937949 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.937953 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:27.938088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.937967 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:27.938088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:27.938034 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:41:43.93801438 +0000 UTC m=+33.275696142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:28.232707 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.232503 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:28.232888 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.232505 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:28.232888 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:28.232807 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:28.233003 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:28.232884 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:28.408977 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.408916 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" event={"ID":"03c67262-1b85-4078-8f13-a5429195d1de","Type":"ContainerStarted","Data":"2162ae4b04522364fbfca93ac9e10dc64eb1ff4854b65b2e94815777eede5d03"} Jun 02 01:41:28.410303 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.410261 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7tsb" event={"ID":"643acb0c-7c2f-44ae-b679-debd7548436e","Type":"ContainerStarted","Data":"9d0676a98944b6089a8279f7c26f62942584040cd50cb5f8d2d076098cd6ae68"} Jun 02 01:41:28.411640 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.411619 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-87lq2" event={"ID":"315d2a53-8aa4-4253-af06-7589c3b7e1e4","Type":"ContainerStarted","Data":"d10188c2d77a36088a7320394bcedf1fbaed6faa69fd25294a7fd224b78c9a14"} Jun 02 01:41:28.412995 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.412957 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" event={"ID":"384fbc8d4420caadff09155e9add6c26","Type":"ContainerStarted","Data":"8f9217fa3b2c1fdf3cf8aee912f2b0ab2528678e18bdb9718c5cbd8ba1f98fd2"} Jun 02 01:41:28.414492 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.414467 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerStarted","Data":"440108cf76114a92bfaea98a695e68b59e2376551d38f16a27d0f58c15e39804"} Jun 02 01:41:28.415942 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.415919 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2fvx9" event={"ID":"13f2ae2d-6ac9-46b2-ad29-cfcf51af7465","Type":"ContainerStarted","Data":"f127d98c46e40dfd3b6e6c3a4c763e99838a1e03f3261e473c05308c9865d374"} Jun 02 01:41:28.417300 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.417264 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7lw8m" event={"ID":"9bff18d3-6203-492f-80f3-64b9af1944dc","Type":"ContainerStarted","Data":"db9cc21af7aacaec925e93f7be9b728113305bc16587829bc53e85af20de145d"} Jun 02 01:41:28.425976 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.425936 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-q7tsb" podStartSLOduration=3.3745059729999998 podStartE2EDuration="17.425923903s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.467458699 +0000 UTC m=+1.805140454" lastFinishedPulling="2026-06-02 01:41:26.518876626 +0000 UTC m=+15.856558384" observedRunningTime="2026-06-02 01:41:28.425366354 +0000 UTC m=+17.763048131" watchObservedRunningTime="2026-06-02 01:41:28.425923903 +0000 UTC m=+17.763605680" Jun 02 01:41:28.454547 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.454498 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2fvx9" podStartSLOduration=3.51626187 podStartE2EDuration="17.454480016s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.495604216 +0000 UTC m=+1.833285985" lastFinishedPulling="2026-06-02 01:41:26.433822374 +0000 UTC m=+15.771504131" observedRunningTime="2026-06-02 01:41:28.439855974 +0000 UTC m=+17.777537750" watchObservedRunningTime="2026-06-02 01:41:28.454480016 +0000 UTC m=+17.792161797" Jun 02 01:41:28.492851 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.492761 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7lw8m" podStartSLOduration=3.460256292 podStartE2EDuration="17.492746886s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.478214923 +0000 UTC m=+1.815896681" lastFinishedPulling="2026-06-02 01:41:26.510705508 +0000 UTC m=+15.848387275" observedRunningTime="2026-06-02 01:41:28.471065102 +0000 UTC m=+17.808746878" watchObservedRunningTime="2026-06-02 01:41:28.492746886 +0000 UTC m=+17.830428662" Jun 02 01:41:28.509073 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:28.509016 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-87lq2" podStartSLOduration=3.426586975 podStartE2EDuration="17.508997082s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.428719626 +0000 UTC m=+1.766401385" lastFinishedPulling="2026-06-02 01:41:26.511129731 +0000 UTC m=+15.848811492" observedRunningTime="2026-06-02 01:41:28.508625448 +0000 UTC m=+17.846307225" watchObservedRunningTime="2026-06-02 01:41:28.508997082 +0000 UTC m=+17.846678860" Jun 02 01:41:29.232808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:29.232780 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:29.233002 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:29.232902 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:30.232436 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:30.232405 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:30.232902 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:30.232405 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:30.232902 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:30.232522 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:30.232902 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:30.232613 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:30.954677 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:30.954605 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:30.955274 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:30.955251 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:30.958990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:30.958963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:30.959126 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:30.959107 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:30.959194 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:30.959175 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret podName:ef2189f3-a073-4b40-a460-31b5a3dfa4a0 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:38.959155772 +0000 UTC m=+28.296837536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret") pod "global-pull-secret-syncer-s22s5" (UID: "ef2189f3-a073-4b40-a460-31b5a3dfa4a0") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:31.233213 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:31.233101 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:31.233923 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:31.233233 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:31.423538 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:31.423509 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:31.424095 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:31.424056 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7lw8m" Jun 02 01:41:32.233736 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.232902 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:32.233736 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:32.233260 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:32.233736 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.233370 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:32.233736 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:32.233456 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:32.428368 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.428321 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"b388757511cda7c4d41a5927665b1972fcd6ff7bc3d3640c8a774ff14d830611"} Jun 02 01:41:32.428368 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.428371 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"cab0e61f170a96893639f41fadbe84ebbd5efb458b01864c562003e353316ac4"} Jun 02 01:41:32.428590 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.428387 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"f94b771d7cf12cf1284bcb6c9916afd5def5f2ff1e502ea3c3fbfcb460632fd7"} Jun 02 01:41:32.428590 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.428400 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"f9f2704b381de89fbe008193c6bfec916a3b3e3f75abce95014b8b0a8c75ed33"} Jun 02 01:41:32.428590 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.428412 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"9f9a47cccd9f6eeafe3decafded87f34d0affb75434ffb64640c1074774a325c"} Jun 02 01:41:32.429860 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.429829 2563 generic.go:358] "Generic (PLEG): container finished" podID="384fbc8d4420caadff09155e9add6c26" containerID="8f9217fa3b2c1fdf3cf8aee912f2b0ab2528678e18bdb9718c5cbd8ba1f98fd2" exitCode=0 Jun 02 01:41:32.430001 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.429887 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" event={"ID":"384fbc8d4420caadff09155e9add6c26","Type":"ContainerDied","Data":"8f9217fa3b2c1fdf3cf8aee912f2b0ab2528678e18bdb9718c5cbd8ba1f98fd2"} Jun 02 01:41:32.431363 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.431341 2563 generic.go:358] "Generic (PLEG): container finished" podID="69def33a-baf2-4860-bfb2-aba5fc3fbc6e" containerID="440108cf76114a92bfaea98a695e68b59e2376551d38f16a27d0f58c15e39804" exitCode=0 Jun 02 01:41:32.431472 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.431422 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerDied","Data":"440108cf76114a92bfaea98a695e68b59e2376551d38f16a27d0f58c15e39804"} Jun 02 01:41:32.713727 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:32.713553 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:41:33.171095 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.170976 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:41:32.713722449Z","UUID":"fe960eee-de0c-44f7-9fc2-5e2c4e706b54","Handler":null,"Name":"","Endpoint":""} Jun 02 01:41:33.173988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.173962 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:41:33.173988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.173992 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:41:33.232401 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.232364 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:33.232582 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:33.232502 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:33.437228 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.437079 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"a408e02db02aa88e7c64161808863f3ef2635d51f73163b5f6653d64385e01fb"} Jun 02 01:41:33.439336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.439298 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" event={"ID":"03c67262-1b85-4078-8f13-a5429195d1de","Type":"ContainerStarted","Data":"be2d0d682a4657801d358ca46ed835761ed1b69ed4b675711b148af5bffb2bc6"} Jun 02 01:41:33.441130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.441103 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" event={"ID":"384fbc8d4420caadff09155e9add6c26","Type":"ContainerStarted","Data":"9d2a1f810975528a19ea43249e7a54814ba875c6f9241e4660a6c4e41d888c57"} Jun 02 01:41:33.456639 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:33.456592 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-21.ec2.internal" podStartSLOduration=21.456576966 podStartE2EDuration="21.456576966s" podCreationTimestamp="2026-06-02 01:41:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:41:33.456063106 +0000 UTC m=+22.793744884" watchObservedRunningTime="2026-06-02 01:41:33.456576966 +0000 UTC m=+22.794258742" Jun 02 01:41:34.232372 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:34.232337 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:34.232534 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:34.232337 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:34.232534 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:34.232457 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:34.232534 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:34.232507 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:34.444274 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:34.444241 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" event={"ID":"03c67262-1b85-4078-8f13-a5429195d1de","Type":"ContainerStarted","Data":"23cd2f3802198cdc2498cfb5582933410aca2c5a01106cb7dd84891f33dcfaba"} Jun 02 01:41:34.462061 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:34.462018 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cj7gv" podStartSLOduration=2.424296993 podStartE2EDuration="23.462003825s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.483254097 +0000 UTC m=+1.820935852" lastFinishedPulling="2026-06-02 01:41:33.520960922 +0000 UTC m=+22.858642684" observedRunningTime="2026-06-02 01:41:34.460336898 +0000 UTC m=+23.798018685" watchObservedRunningTime="2026-06-02 01:41:34.462003825 +0000 UTC m=+23.799685602" Jun 02 01:41:35.232913 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:35.232880 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:35.233095 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:35.232995 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:35.449443 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:35.449403 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"5536937e5ac644ccfe679150327ed7f60d8658a60ae9a827f8259d113cbc9a2b"} Jun 02 01:41:36.232172 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:36.232136 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:36.232365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:36.232135 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:36.232365 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:36.232277 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:36.232365 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:36.232340 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:37.233070 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:37.233019 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:37.233959 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:37.233161 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:37.455955 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:37.455913 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" event={"ID":"e0e444de-8842-4b03-9636-c1bdc905be11","Type":"ContainerStarted","Data":"45e0ccaf1f3edef23446504afd68d128700358aa6c93a86504c5429ee4c733bb"} Jun 02 01:41:37.456281 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:37.456233 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:37.456281 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:37.456263 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:37.473867 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:37.473843 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:37.508290 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:37.508191 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" podStartSLOduration=6.844982457 podStartE2EDuration="26.508178143s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.439147582 +0000 UTC m=+1.776829336" lastFinishedPulling="2026-06-02 01:41:32.102343259 +0000 UTC m=+21.440025022" observedRunningTime="2026-06-02 01:41:37.507833669 +0000 UTC m=+26.845515447" watchObservedRunningTime="2026-06-02 01:41:37.508178143 +0000 UTC m=+26.845859920" Jun 02 01:41:38.232779 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.232585 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:38.232942 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.232585 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:38.232942 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:38.232907 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:38.233060 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:38.232953 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:38.459165 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.459137 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:38.474717 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.474676 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:41:38.995589 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.995513 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fz4zd"] Jun 02 01:41:38.995740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.995649 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:38.995826 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:38.995756 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:38.996160 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.996136 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-595j9"] Jun 02 01:41:38.996272 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.996253 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:38.996396 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:38.996375 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:38.998580 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.998556 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s22s5"] Jun 02 01:41:38.998672 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:38.998662 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:38.998765 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:38.998750 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:39.020990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:39.020963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:39.021135 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:39.021104 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:39.021176 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:39.021165 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret podName:ef2189f3-a073-4b40-a460-31b5a3dfa4a0 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:55.021151533 +0000 UTC m=+44.358833294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret") pod "global-pull-secret-syncer-s22s5" (UID: "ef2189f3-a073-4b40-a460-31b5a3dfa4a0") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:41:39.461947 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:39.461917 2563 generic.go:358] "Generic (PLEG): container finished" podID="69def33a-baf2-4860-bfb2-aba5fc3fbc6e" containerID="89fc453b9995f92ffd26717941db30e63825b9788aba570ec77f0c908d240c62" exitCode=0 Jun 02 01:41:39.462354 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:39.461995 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerDied","Data":"89fc453b9995f92ffd26717941db30e63825b9788aba570ec77f0c908d240c62"} Jun 02 01:41:40.232280 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:40.232242 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:40.232455 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:40.232366 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:41.236276 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:41.235283 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:41.236276 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:41.235426 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:41.236276 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:41.235932 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:41.236276 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:41.236051 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:41.468008 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:41.467977 2563 generic.go:358] "Generic (PLEG): container finished" podID="69def33a-baf2-4860-bfb2-aba5fc3fbc6e" containerID="8f6c8125818ca621edabfe7018c1facdaca20b9f9819f621af37d48170e3bd3d" exitCode=0 Jun 02 01:41:41.468144 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:41.468043 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerDied","Data":"8f6c8125818ca621edabfe7018c1facdaca20b9f9819f621af37d48170e3bd3d"} Jun 02 01:41:42.232825 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:42.232625 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:42.232989 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:42.232932 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:43.232949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:43.232919 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:43.233467 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:43.232919 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:43.233467 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.233054 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s22s5" podUID="ef2189f3-a073-4b40-a460-31b5a3dfa4a0" Jun 02 01:41:43.233467 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.233097 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-595j9" podUID="1fd6a7d4-08fa-48e5-9240-06c00067480e" Jun 02 01:41:43.474489 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:43.474459 2563 generic.go:358] "Generic (PLEG): container finished" podID="69def33a-baf2-4860-bfb2-aba5fc3fbc6e" containerID="49affe074c6cb3fe531c749329b786264baa4e974130bb8943b74de4ec020950" exitCode=0 Jun 02 01:41:43.474643 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:43.474510 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerDied","Data":"49affe074c6cb3fe531c749329b786264baa4e974130bb8943b74de4ec020950"} Jun 02 01:41:43.856750 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:43.856718 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:43.856928 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.856837 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:43.856928 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.856889 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:42:15.856874855 +0000 UTC m=+65.194556610 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:41:43.957280 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:43.957242 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:43.957494 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.957469 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:41:43.957572 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.957504 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:41:43.957572 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.957520 2563 projected.go:194] Error preparing data for projected volume kube-api-access-hrdgs for pod openshift-network-diagnostics/network-check-target-595j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:43.957651 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:43.957582 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs podName:1fd6a7d4-08fa-48e5-9240-06c00067480e nodeName:}" failed. No retries permitted until 2026-06-02 01:42:15.957563524 +0000 UTC m=+65.295245281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrdgs" (UniqueName: "kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs") pod "network-check-target-595j9" (UID: "1fd6a7d4-08fa-48e5-9240-06c00067480e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:41:44.232914 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:44.232875 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:44.233163 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:44.233039 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:41:44.972655 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:44.972624 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-21.ec2.internal" event="NodeReady" Jun 02 01:41:44.972861 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:44.972754 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:41:45.013816 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.013783 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6pc4p"] Jun 02 01:41:45.033008 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.032975 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hptd8"] Jun 02 01:41:45.033186 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.033161 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.035922 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.035863 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:41:45.036086 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.035946 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:41:45.036086 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.035956 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q2kdm\"" Jun 02 01:41:45.049123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.049101 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pc4p"] Jun 02 01:41:45.049123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.049133 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hptd8"] Jun 02 01:41:45.049288 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.049239 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.051939 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.051909 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:41:45.051939 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.051915 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:41:45.052123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.051961 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kzbv\"" Jun 02 01:41:45.052123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.052027 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:41:45.169713 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.169662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7l9\" (UniqueName: \"kubernetes.io/projected/6d883de3-4af9-45ea-a9bd-a742008ac77a-kube-api-access-lg7l9\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.169885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.169726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d883de3-4af9-45ea-a9bd-a742008ac77a-tmp-dir\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.169885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.169749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d883de3-4af9-45ea-a9bd-a742008ac77a-config-volume\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.169885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.169763 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.169885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.169779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.169885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.169813 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgxhr\" (UniqueName: \"kubernetes.io/projected/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-kube-api-access-pgxhr\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.232205 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.232120 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:41:45.232366 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.232123 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:45.235306 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.235285 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:41:45.235660 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.235343 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnph6\"" Jun 02 01:41:45.235660 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.235381 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:41:45.235660 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.235637 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:41:45.270806 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.270776 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d883de3-4af9-45ea-a9bd-a742008ac77a-tmp-dir\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.270806 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.270813 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d883de3-4af9-45ea-a9bd-a742008ac77a-config-volume\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.270832 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.270859 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.270900 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxhr\" (UniqueName: \"kubernetes.io/projected/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-kube-api-access-pgxhr\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.270964 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.270976 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.270991 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7l9\" (UniqueName: \"kubernetes.io/projected/6d883de3-4af9-45ea-a9bd-a742008ac77a-kube-api-access-lg7l9\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.271049 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.271037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:45.771015357 +0000 UTC m=+35.108697129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:41:45.271401 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.271204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d883de3-4af9-45ea-a9bd-a742008ac77a-tmp-dir\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.271401 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.271211 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:45.771196724 +0000 UTC m=+35.108878486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:41:45.271500 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.271441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d883de3-4af9-45ea-a9bd-a742008ac77a-config-volume\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.282198 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.282169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7l9\" (UniqueName: \"kubernetes.io/projected/6d883de3-4af9-45ea-a9bd-a742008ac77a-kube-api-access-lg7l9\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.282404 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.282388 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgxhr\" (UniqueName: \"kubernetes.io/projected/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-kube-api-access-pgxhr\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.775541 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.775498 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:45.775541 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:45.775537 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:45.775778 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.775659 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:41:45.775778 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.775671 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:41:45.775778 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.775740 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:46.775722312 +0000 UTC m=+36.113404066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:41:45.775778 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:45.775756 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:46.775749414 +0000 UTC m=+36.113431168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:41:46.232117 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:46.232083 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:41:46.234908 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:46.234882 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:41:46.235047 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:46.234959 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hbws\"" Jun 02 01:41:46.784363 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:46.784328 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:46.784363 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:46.784371 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:46.784839 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:46.784506 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:41:46.784839 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:46.784509 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:41:46.784839 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:46.784558 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:48.784544268 +0000 UTC m=+38.122226023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:41:46.784839 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:46.784571 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:48.784565155 +0000 UTC m=+38.122246910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:41:48.800290 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:48.800246 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:48.800798 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:48.800303 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:48.800798 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:48.800412 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:41:48.800798 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:48.800488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:41:52.800470099 +0000 UTC m=+42.138151857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:41:48.800798 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:48.800418 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:41:48.800798 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:48.800559 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:41:52.800545004 +0000 UTC m=+42.138226763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:41:51.222842 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:51.222811 2563 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69def33a_baf2_4860_bfb2_aba5fc3fbc6e.slice/crio-conmon-e681393f071167df639b68f93138324ffcfe0361c0616ff3866e3d31d1b0b57e.scope\": RecentStats: unable to find data in memory cache]" Jun 02 01:41:51.490114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:51.490032 2563 generic.go:358] "Generic (PLEG): container finished" podID="69def33a-baf2-4860-bfb2-aba5fc3fbc6e" containerID="e681393f071167df639b68f93138324ffcfe0361c0616ff3866e3d31d1b0b57e" exitCode=0 Jun 02 01:41:51.490114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:51.490083 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerDied","Data":"e681393f071167df639b68f93138324ffcfe0361c0616ff3866e3d31d1b0b57e"} Jun 02 01:41:52.494710 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:52.494656 2563 generic.go:358] "Generic (PLEG): container finished" podID="69def33a-baf2-4860-bfb2-aba5fc3fbc6e" containerID="7980d28695e21994c45d19b33e04e81ba4ff36c53aa1e5b38d6a72acb2c7b1e0" exitCode=0 Jun 02 01:41:52.495101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:52.494721 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerDied","Data":"7980d28695e21994c45d19b33e04e81ba4ff36c53aa1e5b38d6a72acb2c7b1e0"} Jun 02 01:41:52.830540 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:52.830435 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:41:52.830540 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:52.830481 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:41:52.830759 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:52.830578 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:41:52.830759 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:52.830627 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:42:00.830612575 +0000 UTC m=+50.168294330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:41:52.830759 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:52.830578 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:41:52.830759 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:41:52.830725 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:42:00.830709744 +0000 UTC m=+50.168391509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:41:53.499141 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:53.499107 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p82jm" event={"ID":"69def33a-baf2-4860-bfb2-aba5fc3fbc6e","Type":"ContainerStarted","Data":"d1e6fbcd57341b1e397c179e887cf3f4fb901a331440cb2788948729cd3501bb"} Jun 02 01:41:53.522621 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:53.522333 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p82jm" podStartSLOduration=4.065650605 podStartE2EDuration="42.522317612s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:41:12.499680509 +0000 UTC m=+1.837362264" lastFinishedPulling="2026-06-02 01:41:50.956347513 +0000 UTC m=+40.294029271" observedRunningTime="2026-06-02 01:41:53.520511363 +0000 UTC m=+42.858193140" watchObservedRunningTime="2026-06-02 01:41:53.522317612 +0000 UTC m=+42.859999391" Jun 02 01:41:55.044303 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:55.044257 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:55.046621 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:55.046596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef2189f3-a073-4b40-a460-31b5a3dfa4a0-original-pull-secret\") pod \"global-pull-secret-syncer-s22s5\" (UID: \"ef2189f3-a073-4b40-a460-31b5a3dfa4a0\") " pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:55.147098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:55.147060 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s22s5" Jun 02 01:41:55.336680 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:55.336604 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s22s5"] Jun 02 01:41:55.340589 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:55.340561 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2189f3_a073_4b40_a460_31b5a3dfa4a0.slice/crio-749a8b094d6adaf32fe7710d9fdc3739005a0093d3b27b5686869e1ee57ac804 WatchSource:0}: Error finding container 749a8b094d6adaf32fe7710d9fdc3739005a0093d3b27b5686869e1ee57ac804: Status 404 returned error can't find the container with id 749a8b094d6adaf32fe7710d9fdc3739005a0093d3b27b5686869e1ee57ac804 Jun 02 01:41:55.503805 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:55.503771 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s22s5" event={"ID":"ef2189f3-a073-4b40-a460-31b5a3dfa4a0","Type":"ContainerStarted","Data":"749a8b094d6adaf32fe7710d9fdc3739005a0093d3b27b5686869e1ee57ac804"} Jun 02 01:41:56.431640 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.431609 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc"] Jun 02 01:41:56.448238 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.448182 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc"] Jun 02 01:41:56.448473 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.448248 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.451348 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.451200 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 01:41:56.451348 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.451270 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 01:41:56.452455 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.452430 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 01:41:56.452585 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.452523 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t8cfh\"" Jun 02 01:41:56.452585 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.452568 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 01:41:56.457554 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.457532 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7673c93-f318-4001-8a16-7443db03a7c9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f48778c5d-976gc\" (UID: \"e7673c93-f318-4001-8a16-7443db03a7c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.457672 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.457583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zh7\" (UniqueName: \"kubernetes.io/projected/e7673c93-f318-4001-8a16-7443db03a7c9-kube-api-access-n9zh7\") pod \"managed-serviceaccount-addon-agent-6f48778c5d-976gc\" (UID: \"e7673c93-f318-4001-8a16-7443db03a7c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.558097 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.558053 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7673c93-f318-4001-8a16-7443db03a7c9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f48778c5d-976gc\" (UID: \"e7673c93-f318-4001-8a16-7443db03a7c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.558268 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.558112 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zh7\" (UniqueName: \"kubernetes.io/projected/e7673c93-f318-4001-8a16-7443db03a7c9-kube-api-access-n9zh7\") pod \"managed-serviceaccount-addon-agent-6f48778c5d-976gc\" (UID: \"e7673c93-f318-4001-8a16-7443db03a7c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.560970 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.560948 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7673c93-f318-4001-8a16-7443db03a7c9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f48778c5d-976gc\" (UID: \"e7673c93-f318-4001-8a16-7443db03a7c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.566875 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.566820 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zh7\" (UniqueName: \"kubernetes.io/projected/e7673c93-f318-4001-8a16-7443db03a7c9-kube-api-access-n9zh7\") pod \"managed-serviceaccount-addon-agent-6f48778c5d-976gc\" (UID: \"e7673c93-f318-4001-8a16-7443db03a7c9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.773237 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.773149 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" Jun 02 01:41:56.905572 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:56.905537 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc"] Jun 02 01:41:56.908893 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:41:56.908861 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7673c93_f318_4001_8a16_7443db03a7c9.slice/crio-4bb1330f16e20dd4d355a4b13fad08846aaabd2bda784c49451fafcd7a195642 WatchSource:0}: Error finding container 4bb1330f16e20dd4d355a4b13fad08846aaabd2bda784c49451fafcd7a195642: Status 404 returned error can't find the container with id 4bb1330f16e20dd4d355a4b13fad08846aaabd2bda784c49451fafcd7a195642 Jun 02 01:41:57.508378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:41:57.508333 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" event={"ID":"e7673c93-f318-4001-8a16-7443db03a7c9","Type":"ContainerStarted","Data":"4bb1330f16e20dd4d355a4b13fad08846aaabd2bda784c49451fafcd7a195642"} Jun 02 01:42:00.891962 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:00.891941 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:42:00.892332 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:00.891973 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:42:00.892332 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:00.892095 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:42:00.892332 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:00.892105 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:42:00.892332 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:00.892164 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:42:16.892149998 +0000 UTC m=+66.229831766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:42:00.892332 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:00.892178 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:42:16.892172321 +0000 UTC m=+66.229854076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:42:01.516898 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:01.516857 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" event={"ID":"e7673c93-f318-4001-8a16-7443db03a7c9","Type":"ContainerStarted","Data":"87d4855d838b3b8500ee35f9da10a840da3e33ed1574329fa8c5cc46a94b23dc"} Jun 02 01:42:01.518160 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:01.518126 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s22s5" event={"ID":"ef2189f3-a073-4b40-a460-31b5a3dfa4a0","Type":"ContainerStarted","Data":"0ff6efbd0aedc7c8b5a9a27e32197ed26467f95c008b6316a204d87138831649"} Jun 02 01:42:01.532168 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:01.532118 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" podStartSLOduration=1.541785259 podStartE2EDuration="5.532103855s" podCreationTimestamp="2026-06-02 01:41:56 +0000 UTC" firstStartedPulling="2026-06-02 01:41:56.911323968 +0000 UTC m=+46.249005722" lastFinishedPulling="2026-06-02 01:42:00.901642562 +0000 UTC m=+50.239324318" observedRunningTime="2026-06-02 01:42:01.531634914 +0000 UTC m=+50.869316690" watchObservedRunningTime="2026-06-02 01:42:01.532103855 +0000 UTC m=+50.869785631" Jun 02 01:42:01.548384 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:01.548334 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s22s5" podStartSLOduration=32.999716805 podStartE2EDuration="38.548321476s" podCreationTimestamp="2026-06-02 01:41:23 +0000 UTC" firstStartedPulling="2026-06-02 01:41:55.342671636 +0000 UTC m=+44.680353394" lastFinishedPulling="2026-06-02 01:42:00.891276307 +0000 UTC m=+50.228958065" observedRunningTime="2026-06-02 01:42:01.547578512 +0000 UTC m=+50.885260290" watchObservedRunningTime="2026-06-02 01:42:01.548321476 +0000 UTC m=+50.886003252" Jun 02 01:42:10.479822 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:10.479794 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b25gz" Jun 02 01:42:15.897319 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:15.897256 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:42:15.900098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:15.900077 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:42:15.907469 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:15.907442 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:42:15.907575 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:15.907505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:43:19.9074903 +0000 UTC m=+129.245172055 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : secret "metrics-daemon-secret" not found Jun 02 01:42:15.997904 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:15.997869 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:42:16.000663 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.000647 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:42:16.011187 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.011168 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:42:16.021564 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.021540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdgs\" (UniqueName: \"kubernetes.io/projected/1fd6a7d4-08fa-48e5-9240-06c00067480e-kube-api-access-hrdgs\") pod \"network-check-target-595j9\" (UID: \"1fd6a7d4-08fa-48e5-9240-06c00067480e\") " pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:42:16.144626 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.144595 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnph6\"" Jun 02 01:42:16.152834 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.152785 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:42:16.271014 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.270982 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-595j9"] Jun 02 01:42:16.274252 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:42:16.274220 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd6a7d4_08fa_48e5_9240_06c00067480e.slice/crio-d2ac4779617e9ae4dc4e5aa7c1ccc7fcdffeeb9fc46fe3d77b2c42fcd62a8920 WatchSource:0}: Error finding container d2ac4779617e9ae4dc4e5aa7c1ccc7fcdffeeb9fc46fe3d77b2c42fcd62a8920: Status 404 returned error can't find the container with id d2ac4779617e9ae4dc4e5aa7c1ccc7fcdffeeb9fc46fe3d77b2c42fcd62a8920 Jun 02 01:42:16.548420 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.548334 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-595j9" event={"ID":"1fd6a7d4-08fa-48e5-9240-06c00067480e","Type":"ContainerStarted","Data":"d2ac4779617e9ae4dc4e5aa7c1ccc7fcdffeeb9fc46fe3d77b2c42fcd62a8920"} Jun 02 01:42:16.903706 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.903660 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:42:16.904088 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:16.903758 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:42:16.904088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:16.903822 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:42:16.904088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:16.903902 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:42:48.903883182 +0000 UTC m=+98.241564949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:42:16.904088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:16.903899 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:42:16.904088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:16.903928 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:42:48.903922708 +0000 UTC m=+98.241604462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:42:20.558521 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:20.558480 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-595j9" event={"ID":"1fd6a7d4-08fa-48e5-9240-06c00067480e","Type":"ContainerStarted","Data":"98b8319b80bb76c4e0ec388361711a0cacaa6d6370b1869916cbeec989f67be4"} Jun 02 01:42:20.558963 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:20.558612 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:42:20.574213 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:20.574170 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-595j9" podStartSLOduration=66.174539759 podStartE2EDuration="1m9.574155115s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:42:16.276094997 +0000 UTC m=+65.613776753" lastFinishedPulling="2026-06-02 01:42:19.675710343 +0000 UTC m=+69.013392109" observedRunningTime="2026-06-02 01:42:20.574092742 +0000 UTC m=+69.911774529" watchObservedRunningTime="2026-06-02 01:42:20.574155115 +0000 UTC m=+69.911836891" Jun 02 01:42:48.921149 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:48.921110 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:42:48.921149 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:48.921149 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:42:48.921865 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:48.921264 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:42:48.921865 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:48.921266 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:42:48.921865 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:48.921339 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls podName:6d883de3-4af9-45ea-a9bd-a742008ac77a nodeName:}" failed. No retries permitted until 2026-06-02 01:43:52.921323956 +0000 UTC m=+162.259005710 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls") pod "dns-default-6pc4p" (UID: "6d883de3-4af9-45ea-a9bd-a742008ac77a") : secret "dns-default-metrics-tls" not found Jun 02 01:42:48.921865 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:42:48.921355 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert podName:b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:52.921348256 +0000 UTC m=+162.259030010 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert") pod "ingress-canary-hptd8" (UID: "b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805") : secret "canary-serving-cert" not found Jun 02 01:42:51.563310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:42:51.563274 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-595j9" Jun 02 01:43:13.580047 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.580009 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc"] Jun 02 01:43:13.583484 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.583467 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" Jun 02 01:43:13.586030 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.586008 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:43:13.586248 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.586230 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 01:43:13.586336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.586257 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vc4fv\"" Jun 02 01:43:13.591827 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.591808 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc"] Jun 02 01:43:13.682706 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.682657 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl"] Jun 02 01:43:13.686236 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.686218 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-vsnvg"] Jun 02 01:43:13.686390 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.686376 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:13.689311 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689291 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 01:43:13.689426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689353 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9444674f7-4r8rm"] Jun 02 01:43:13.689426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689364 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bmctt\"" Jun 02 01:43:13.689426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkm6w\" (UniqueName: \"kubernetes.io/projected/e9164e49-6759-4a87-82d5-3adcb7969c82-kube-api-access-kkm6w\") pod \"volume-data-source-validator-7598fd5bd-s56fc\" (UID: \"e9164e49-6759-4a87-82d5-3adcb7969c82\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" Jun 02 01:43:13.689565 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689473 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 01:43:13.689565 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689497 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.689780 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.689758 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:43:13.692175 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.692157 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:43:13.692600 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.692583 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.694965 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.694941 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 01:43:13.695081 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.695025 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dxkzd\"" Jun 02 01:43:13.695145 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.695092 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 01:43:13.695512 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.695490 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:43:13.695613 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.695529 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 01:43:13.695928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.695911 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 01:43:13.696048 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.696030 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 01:43:13.696120 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.696080 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hsjkt\"" Jun 02 01:43:13.696177 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.696125 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 01:43:13.696177 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.696080 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 01:43:13.696270 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.696209 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:43:13.699297 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.699278 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl"] Jun 02 01:43:13.700269 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.700250 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-vsnvg"] Jun 02 01:43:13.701767 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.701627 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 01:43:13.704916 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.704894 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9444674f7-4r8rm"] Jun 02 01:43:13.781277 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.781245 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk"] Jun 02 01:43:13.784517 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.784501 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.786418 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.786389 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd"] Jun 02 01:43:13.787816 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.787796 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 01:43:13.787939 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.787801 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:43:13.787939 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.787859 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 01:43:13.787939 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.787859 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nl29w\"" Jun 02 01:43:13.788225 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.788211 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 01:43:13.789348 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.789334 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ddf746f45-bh5lb"] Jun 02 01:43:13.789486 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.789470 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:13.789799 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.789780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.789886 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.789864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5dsj\" (UniqueName: \"kubernetes.io/projected/34d8efbb-748e-4291-8fcd-1d878fa37349-kube-api-access-l5dsj\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:13.789948 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.789932 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkm6w\" (UniqueName: \"kubernetes.io/projected/e9164e49-6759-4a87-82d5-3adcb7969c82-kube-api-access-kkm6w\") pod \"volume-data-source-validator-7598fd5bd-s56fc\" (UID: \"e9164e49-6759-4a87-82d5-3adcb7969c82\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" Jun 02 01:43:13.789996 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.789964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:13.790045 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-default-certificate\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.790045 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.790146 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-stats-auth\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.790146 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cq9c\" (UniqueName: \"kubernetes.io/projected/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-kube-api-access-7cq9c\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.790245 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca253491-8ecd-4250-8265-9c4f8786b163-config\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.790245 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdsgg\" (UniqueName: \"kubernetes.io/projected/ca253491-8ecd-4250-8265-9c4f8786b163-kube-api-access-mdsgg\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.790336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca253491-8ecd-4250-8265-9c4f8786b163-serving-cert\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.790336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.790289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca253491-8ecd-4250-8265-9c4f8786b163-trusted-ca\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.791780 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.791761 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 01:43:13.791935 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.791913 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 01:43:13.792017 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.791938 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6vnzg\"" Jun 02 01:43:13.792523 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.792510 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.794972 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.794954 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 01:43:13.795144 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.795131 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 01:43:13.795252 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.795237 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4h6ct\"" Jun 02 01:43:13.795572 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.795559 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 01:43:13.800294 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.800269 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk"] Jun 02 01:43:13.800989 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.800969 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 01:43:13.803990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.803973 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd"] Jun 02 01:43:13.805066 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.805044 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ddf746f45-bh5lb"] Jun 02 01:43:13.817268 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.817246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkm6w\" (UniqueName: \"kubernetes.io/projected/e9164e49-6759-4a87-82d5-3adcb7969c82-kube-api-access-kkm6w\") pod \"volume-data-source-validator-7598fd5bd-s56fc\" (UID: \"e9164e49-6759-4a87-82d5-3adcb7969c82\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" Jun 02 01:43:13.890925 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.890894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-trusted-ca\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.891096 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.890938 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cq9c\" (UniqueName: \"kubernetes.io/projected/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-kube-api-access-7cq9c\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.891096 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.890993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.891096 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891033 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:13.891096 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-ca-trust-extracted\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.891306 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-installation-pull-secrets\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.891306 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.891153 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:43:13.891306 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891175 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.891306 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.891226 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls podName:34d8efbb-748e-4291-8fcd-1d878fa37349 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:14.391211026 +0000 UTC m=+123.728892782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-5bgtl" (UID: "34d8efbb-748e-4291-8fcd-1d878fa37349") : secret "samples-operator-tls" not found Jun 02 01:43:13.891306 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.891288 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:14.391272328 +0000 UTC m=+123.728954083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : configmap references non-existent config key: service-ca.crt Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891314 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-default-certificate\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891348 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3f5e34b-1473-47a6-a00a-597800b9b2d2-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-image-registry-private-configuration\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.891417 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.891447 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:14.391437478 +0000 UTC m=+123.729119233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : secret "router-metrics-certs-default" not found Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891415 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5dsj\" (UniqueName: \"kubernetes.io/projected/34d8efbb-748e-4291-8fcd-1d878fa37349-kube-api-access-l5dsj\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891473 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7kt\" (UniqueName: \"kubernetes.io/projected/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-kube-api-access-tx7kt\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891514 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdsgg\" (UniqueName: \"kubernetes.io/projected/ca253491-8ecd-4250-8265-9c4f8786b163-kube-api-access-mdsgg\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.891623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcm5\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-kube-api-access-qdcm5\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891710 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-stats-auth\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891742 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca253491-8ecd-4250-8265-9c4f8786b163-config\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-bound-sa-token\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891818 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca253491-8ecd-4250-8265-9c4f8786b163-serving-cert\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.891980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca253491-8ecd-4250-8265-9c4f8786b163-trusted-ca\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.892014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:13.892155 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.892039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-certificates\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.893035 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.892505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca253491-8ecd-4250-8265-9c4f8786b163-config\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.893035 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.892905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca253491-8ecd-4250-8265-9c4f8786b163-trusted-ca\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.894369 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.894343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-default-certificate\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.894468 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.894438 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca253491-8ecd-4250-8265-9c4f8786b163-serving-cert\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.894544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.894529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-stats-auth\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.899820 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.899796 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5dsj\" (UniqueName: \"kubernetes.io/projected/34d8efbb-748e-4291-8fcd-1d878fa37349-kube-api-access-l5dsj\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:13.899975 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.899961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cq9c\" (UniqueName: \"kubernetes.io/projected/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-kube-api-access-7cq9c\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:13.900274 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.900254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdsgg\" (UniqueName: \"kubernetes.io/projected/ca253491-8ecd-4250-8265-9c4f8786b163-kube-api-access-mdsgg\") pod \"console-operator-86d7c6cc77-vsnvg\" (UID: \"ca253491-8ecd-4250-8265-9c4f8786b163\") " pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:13.993274 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993242 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-trusted-ca\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993425 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993280 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.993478 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993421 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-ca-trust-extracted\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993535 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993474 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-installation-pull-secrets\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993617 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993597 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3f5e34b-1473-47a6-a00a-597800b9b2d2-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:13.993675 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993635 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-image-registry-private-configuration\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993753 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993718 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7kt\" (UniqueName: \"kubernetes.io/projected/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-kube-api-access-tx7kt\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.993807 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993760 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcm5\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-kube-api-access-qdcm5\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993865 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993816 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-bound-sa-token\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993865 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-ca-trust-extracted\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993868 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.993959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993896 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.993959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993928 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:13.993959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.993955 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-certificates\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.994271 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.994213 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:43:13.994271 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.994234 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddf746f45-bh5lb: secret "image-registry-tls" not found Jun 02 01:43:13.994398 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.994295 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls podName:ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b nodeName:}" failed. No retries permitted until 2026-06-02 01:43:14.494275785 +0000 UTC m=+123.831957555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls") pod "image-registry-7ddf746f45-bh5lb" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b") : secret "image-registry-tls" not found Jun 02 01:43:13.994496 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.994473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3f5e34b-1473-47a6-a00a-597800b9b2d2-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:13.994558 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.994523 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:43:13.994558 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.994528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-certificates\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.994634 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:13.994570 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert podName:a3f5e34b-1473-47a6-a00a-597800b9b2d2 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:14.494554996 +0000 UTC m=+123.832236756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vz8sd" (UID: "a3f5e34b-1473-47a6-a00a-597800b9b2d2") : secret "networking-console-plugin-cert" not found Jun 02 01:43:13.994634 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.994617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.994940 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.994923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-trusted-ca\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.995745 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.995725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:13.996066 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.996045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-installation-pull-secrets\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:13.996626 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:13.996609 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-image-registry-private-configuration\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:14.002967 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.002942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7kt\" (UniqueName: \"kubernetes.io/projected/aa9c6fc0-a360-4f73-8e87-6aa2941a8934-kube-api-access-tx7kt\") pod \"kube-storage-version-migrator-operator-96ddc787c-xrxqk\" (UID: \"aa9c6fc0-a360-4f73-8e87-6aa2941a8934\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:14.003555 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.003538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-bound-sa-token\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:14.003923 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.003907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcm5\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-kube-api-access-qdcm5\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:14.004644 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.004628 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:14.010178 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.010155 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc"] Jun 02 01:43:14.013540 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:14.013518 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9164e49_6759_4a87_82d5_3adcb7969c82.slice/crio-31aa774c2025b4117471793460ac4a8a6fcb4cbfb9381f88f5771ecdc69d63c4 WatchSource:0}: Error finding container 31aa774c2025b4117471793460ac4a8a6fcb4cbfb9381f88f5771ecdc69d63c4: Status 404 returned error can't find the container with id 31aa774c2025b4117471793460ac4a8a6fcb4cbfb9381f88f5771ecdc69d63c4 Jun 02 01:43:14.095345 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.095135 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" Jun 02 01:43:14.123771 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.123740 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-vsnvg"] Jun 02 01:43:14.126977 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:14.126948 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca253491_8ecd_4250_8265_9c4f8786b163.slice/crio-746b00691dec7623cbf31467f0520d1a5c06404580e269c4ab0965a82ec16fa2 WatchSource:0}: Error finding container 746b00691dec7623cbf31467f0520d1a5c06404580e269c4ab0965a82ec16fa2: Status 404 returned error can't find the container with id 746b00691dec7623cbf31467f0520d1a5c06404580e269c4ab0965a82ec16fa2 Jun 02 01:43:14.218393 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.218360 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk"] Jun 02 01:43:14.222553 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:14.222531 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9c6fc0_a360_4f73_8e87_6aa2941a8934.slice/crio-f4416e60526f36a89b12c4e9a515676e08be6d328f1e92f8c4fcb40374043d0b WatchSource:0}: Error finding container f4416e60526f36a89b12c4e9a515676e08be6d328f1e92f8c4fcb40374043d0b: Status 404 returned error can't find the container with id f4416e60526f36a89b12c4e9a515676e08be6d328f1e92f8c4fcb40374043d0b Jun 02 01:43:14.398069 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.397977 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:14.398069 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.398013 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:14.398069 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.398065 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:14.398276 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.398140 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:43:14.398276 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.398204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls podName:34d8efbb-748e-4291-8fcd-1d878fa37349 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:15.398185233 +0000 UTC m=+124.735866995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-5bgtl" (UID: "34d8efbb-748e-4291-8fcd-1d878fa37349") : secret "samples-operator-tls" not found Jun 02 01:43:14.398276 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.398227 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:15.398216046 +0000 UTC m=+124.735897806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : configmap references non-existent config key: service-ca.crt Jun 02 01:43:14.398276 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.398241 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:43:14.398406 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.398281 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:15.398271131 +0000 UTC m=+124.735952888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : secret "router-metrics-certs-default" not found Jun 02 01:43:14.499464 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.499421 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:14.499464 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.499468 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:14.499669 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.499571 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:43:14.499669 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.499624 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert podName:a3f5e34b-1473-47a6-a00a-597800b9b2d2 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:15.499609691 +0000 UTC m=+124.837291451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vz8sd" (UID: "a3f5e34b-1473-47a6-a00a-597800b9b2d2") : secret "networking-console-plugin-cert" not found Jun 02 01:43:14.499669 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.499574 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:43:14.499669 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.499661 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddf746f45-bh5lb: secret "image-registry-tls" not found Jun 02 01:43:14.499824 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:14.499722 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls podName:ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b nodeName:}" failed. No retries permitted until 2026-06-02 01:43:15.499710282 +0000 UTC m=+124.837392052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls") pod "image-registry-7ddf746f45-bh5lb" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b") : secret "image-registry-tls" not found Jun 02 01:43:14.656295 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.656208 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" event={"ID":"aa9c6fc0-a360-4f73-8e87-6aa2941a8934","Type":"ContainerStarted","Data":"f4416e60526f36a89b12c4e9a515676e08be6d328f1e92f8c4fcb40374043d0b"} Jun 02 01:43:14.657328 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.657294 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" event={"ID":"ca253491-8ecd-4250-8265-9c4f8786b163","Type":"ContainerStarted","Data":"746b00691dec7623cbf31467f0520d1a5c06404580e269c4ab0965a82ec16fa2"} Jun 02 01:43:14.658347 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:14.658320 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" event={"ID":"e9164e49-6759-4a87-82d5-3adcb7969c82","Type":"ContainerStarted","Data":"31aa774c2025b4117471793460ac4a8a6fcb4cbfb9381f88f5771ecdc69d63c4"} Jun 02 01:43:15.406635 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.406590 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:15.406841 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.406787 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:15.406841 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.406824 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:15.407099 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.407075 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:43:15.407217 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.407143 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:43:15.407217 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.407146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:17.407124427 +0000 UTC m=+126.744806181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : configmap references non-existent config key: service-ca.crt Jun 02 01:43:15.407217 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.407214 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls podName:34d8efbb-748e-4291-8fcd-1d878fa37349 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:17.407202524 +0000 UTC m=+126.744884290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-5bgtl" (UID: "34d8efbb-748e-4291-8fcd-1d878fa37349") : secret "samples-operator-tls" not found Jun 02 01:43:15.407400 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.407230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:17.407220576 +0000 UTC m=+126.744902332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : secret "router-metrics-certs-default" not found Jun 02 01:43:15.508368 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.508143 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:15.508368 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.508199 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:15.508368 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.508312 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:43:15.508368 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.508335 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddf746f45-bh5lb: secret "image-registry-tls" not found Jun 02 01:43:15.508624 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.508399 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:43:15.508624 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.508419 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls podName:ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b nodeName:}" failed. No retries permitted until 2026-06-02 01:43:17.508396836 +0000 UTC m=+126.846078604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls") pod "image-registry-7ddf746f45-bh5lb" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b") : secret "image-registry-tls" not found Jun 02 01:43:15.508624 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:15.508449 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert podName:a3f5e34b-1473-47a6-a00a-597800b9b2d2 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:17.508433138 +0000 UTC m=+126.846114904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vz8sd" (UID: "a3f5e34b-1473-47a6-a00a-597800b9b2d2") : secret "networking-console-plugin-cert" not found Jun 02 01:43:15.661403 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.661322 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" event={"ID":"e9164e49-6759-4a87-82d5-3adcb7969c82","Type":"ContainerStarted","Data":"d1e803a3753af2d4fc84f0e2916795241636b8d294ceb44cf242bcc19fd448d3"} Jun 02 01:43:15.675892 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:15.675847 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s56fc" podStartSLOduration=1.20851592 podStartE2EDuration="2.675833956s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:14.015907496 +0000 UTC m=+123.353589254" lastFinishedPulling="2026-06-02 01:43:15.483225534 +0000 UTC m=+124.820907290" observedRunningTime="2026-06-02 01:43:15.67520325 +0000 UTC m=+125.012885026" watchObservedRunningTime="2026-06-02 01:43:15.675833956 +0000 UTC m=+125.013515733" Jun 02 01:43:16.664413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:16.664386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/0.log" Jun 02 01:43:16.664758 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:16.664424 2563 generic.go:358] "Generic (PLEG): container finished" podID="ca253491-8ecd-4250-8265-9c4f8786b163" containerID="58e57bb80c30125a1afe45df1402826dcb60357284c6553b29fdbb1952b05773" exitCode=255 Jun 02 01:43:16.664758 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:16.664509 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" event={"ID":"ca253491-8ecd-4250-8265-9c4f8786b163","Type":"ContainerDied","Data":"58e57bb80c30125a1afe45df1402826dcb60357284c6553b29fdbb1952b05773"} Jun 02 01:43:16.664758 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:16.664717 2563 scope.go:117] "RemoveContainer" containerID="58e57bb80c30125a1afe45df1402826dcb60357284c6553b29fdbb1952b05773" Jun 02 01:43:17.426866 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.426826 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:17.426866 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.426865 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:17.427088 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.426902 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:17.427088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.426985 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:43:17.427088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.426989 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:43:17.427088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.427037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:21.427023708 +0000 UTC m=+130.764705467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : secret "router-metrics-certs-default" not found Jun 02 01:43:17.427088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.427050 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:21.427043152 +0000 UTC m=+130.764724907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : configmap references non-existent config key: service-ca.crt Jun 02 01:43:17.427088 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.427059 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls podName:34d8efbb-748e-4291-8fcd-1d878fa37349 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:21.427054532 +0000 UTC m=+130.764736286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-5bgtl" (UID: "34d8efbb-748e-4291-8fcd-1d878fa37349") : secret "samples-operator-tls" not found Jun 02 01:43:17.528002 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.527965 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:17.528174 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.528010 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:17.528174 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.528117 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:43:17.528174 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.528133 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddf746f45-bh5lb: secret "image-registry-tls" not found Jun 02 01:43:17.528274 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.528183 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:43:17.528274 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.528196 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls podName:ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b nodeName:}" failed. No retries permitted until 2026-06-02 01:43:21.528178459 +0000 UTC m=+130.865860215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls") pod "image-registry-7ddf746f45-bh5lb" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b") : secret "image-registry-tls" not found Jun 02 01:43:17.528274 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.528252 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert podName:a3f5e34b-1473-47a6-a00a-597800b9b2d2 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:21.528237681 +0000 UTC m=+130.865919436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vz8sd" (UID: "a3f5e34b-1473-47a6-a00a-597800b9b2d2") : secret "networking-console-plugin-cert" not found Jun 02 01:43:17.670089 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.670044 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" event={"ID":"aa9c6fc0-a360-4f73-8e87-6aa2941a8934","Type":"ContainerStarted","Data":"1545eea865683d4e5529306bbecf0751d00652dc169778286b656f43ff9bbb6f"} Jun 02 01:43:17.671399 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.671382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:43:17.671827 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.671813 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/0.log" Jun 02 01:43:17.671885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.671847 2563 generic.go:358] "Generic (PLEG): container finished" podID="ca253491-8ecd-4250-8265-9c4f8786b163" containerID="1b8dc827d13c052ff5ad9dcf01cf9642ef979c98e9a5233175e5690e55f2409a" exitCode=255 Jun 02 01:43:17.671918 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.671890 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" event={"ID":"ca253491-8ecd-4250-8265-9c4f8786b163","Type":"ContainerDied","Data":"1b8dc827d13c052ff5ad9dcf01cf9642ef979c98e9a5233175e5690e55f2409a"} Jun 02 01:43:17.671956 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.671919 2563 scope.go:117] "RemoveContainer" containerID="58e57bb80c30125a1afe45df1402826dcb60357284c6553b29fdbb1952b05773" Jun 02 01:43:17.672156 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.672139 2563 scope.go:117] "RemoveContainer" containerID="1b8dc827d13c052ff5ad9dcf01cf9642ef979c98e9a5233175e5690e55f2409a" Jun 02 01:43:17.672342 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:17.672322 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vsnvg_openshift-console-operator(ca253491-8ecd-4250-8265-9c4f8786b163)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" podUID="ca253491-8ecd-4250-8265-9c4f8786b163" Jun 02 01:43:17.684671 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:17.684631 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" podStartSLOduration=1.59507502 podStartE2EDuration="4.68461873s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:14.22434644 +0000 UTC m=+123.562028195" lastFinishedPulling="2026-06-02 01:43:17.31389015 +0000 UTC m=+126.651571905" observedRunningTime="2026-06-02 01:43:17.68422708 +0000 UTC m=+127.021908856" watchObservedRunningTime="2026-06-02 01:43:17.68461873 +0000 UTC m=+127.022300511" Jun 02 01:43:18.676231 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:18.676201 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:43:18.676727 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:18.676570 2563 scope.go:117] "RemoveContainer" containerID="1b8dc827d13c052ff5ad9dcf01cf9642ef979c98e9a5233175e5690e55f2409a" Jun 02 01:43:18.676778 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:18.676754 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vsnvg_openshift-console-operator(ca253491-8ecd-4250-8265-9c4f8786b163)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" podUID="ca253491-8ecd-4250-8265-9c4f8786b163" Jun 02 01:43:19.531633 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:19.531602 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7tsb_643acb0c-7c2f-44ae-b679-debd7548436e/dns-node-resolver/0.log" Jun 02 01:43:19.949484 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:19.949449 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:43:19.949866 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:19.949601 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:43:19.949866 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:19.949660 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs podName:c961f928-3c35-495d-b28c-0e59d04c8e3a nodeName:}" failed. No retries permitted until 2026-06-02 01:45:21.949645119 +0000 UTC m=+251.287326894 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs") pod "network-metrics-daemon-fz4zd" (UID: "c961f928-3c35-495d-b28c-0e59d04c8e3a") : secret "metrics-daemon-secret" not found Jun 02 01:43:20.131576 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:20.131551 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2fvx9_13f2ae2d-6ac9-46b2-ad29-cfcf51af7465/node-ca/0.log" Jun 02 01:43:21.462850 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:21.462818 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:21.462850 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:21.462853 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:21.463254 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:21.462887 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:21.463254 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.462977 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:43:21.463254 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.462984 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:43:21.463254 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.463012 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:29.462990528 +0000 UTC m=+138.800672283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : configmap references non-existent config key: service-ca.crt Jun 02 01:43:21.463254 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.463034 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs podName:f9645f7f-2922-45cd-ad7a-1a82e58b8de0 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:29.463024369 +0000 UTC m=+138.800706127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs") pod "router-default-9444674f7-4r8rm" (UID: "f9645f7f-2922-45cd-ad7a-1a82e58b8de0") : secret "router-metrics-certs-default" not found Jun 02 01:43:21.463254 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.463045 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls podName:34d8efbb-748e-4291-8fcd-1d878fa37349 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:29.463039964 +0000 UTC m=+138.800721718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-5bgtl" (UID: "34d8efbb-748e-4291-8fcd-1d878fa37349") : secret "samples-operator-tls" not found Jun 02 01:43:21.563622 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:21.563588 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:21.563622 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:21.563625 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:21.563855 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.563758 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:43:21.563855 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.563773 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ddf746f45-bh5lb: secret "image-registry-tls" not found Jun 02 01:43:21.563855 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.563795 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:43:21.563855 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.563831 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls podName:ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b nodeName:}" failed. No retries permitted until 2026-06-02 01:43:29.563812676 +0000 UTC m=+138.901494448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls") pod "image-registry-7ddf746f45-bh5lb" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b") : secret "image-registry-tls" not found Jun 02 01:43:21.563855 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:21.563845 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert podName:a3f5e34b-1473-47a6-a00a-597800b9b2d2 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:29.56383877 +0000 UTC m=+138.901520525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vz8sd" (UID: "a3f5e34b-1473-47a6-a00a-597800b9b2d2") : secret "networking-console-plugin-cert" not found Jun 02 01:43:24.005793 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:24.005752 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:24.005793 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:24.005790 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:24.006207 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:24.006118 2563 scope.go:117] "RemoveContainer" containerID="1b8dc827d13c052ff5ad9dcf01cf9642ef979c98e9a5233175e5690e55f2409a" Jun 02 01:43:24.006301 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:24.006283 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-vsnvg_openshift-console-operator(ca253491-8ecd-4250-8265-9c4f8786b163)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" podUID="ca253491-8ecd-4250-8265-9c4f8786b163" Jun 02 01:43:29.526427 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.526379 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:29.526427 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.526429 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:29.526886 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.526466 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:29.527098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.527079 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-service-ca-bundle\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:29.528830 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.528811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34d8efbb-748e-4291-8fcd-1d878fa37349-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-5bgtl\" (UID: \"34d8efbb-748e-4291-8fcd-1d878fa37349\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:29.529334 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.529306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9645f7f-2922-45cd-ad7a-1a82e58b8de0-metrics-certs\") pod \"router-default-9444674f7-4r8rm\" (UID: \"f9645f7f-2922-45cd-ad7a-1a82e58b8de0\") " pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:29.596868 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.596835 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" Jun 02 01:43:29.610201 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.610172 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:29.627135 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.627070 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:29.627135 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.627113 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:29.627356 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:29.627313 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:43:29.632362 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:29.628717 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert podName:a3f5e34b-1473-47a6-a00a-597800b9b2d2 nodeName:}" failed. No retries permitted until 2026-06-02 01:43:45.628663712 +0000 UTC m=+154.966345489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-vz8sd" (UID: "a3f5e34b-1473-47a6-a00a-597800b9b2d2") : secret "networking-console-plugin-cert" not found Jun 02 01:43:29.635990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.635966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"image-registry-7ddf746f45-bh5lb\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:29.708715 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.708670 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:29.726628 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.726591 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl"] Jun 02 01:43:29.748294 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.748264 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9444674f7-4r8rm"] Jun 02 01:43:29.841506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:29.841450 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ddf746f45-bh5lb"] Jun 02 01:43:29.844792 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:29.844758 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1ab102_abc8_4f6b_a3a7_2bb120f0ee0b.slice/crio-848fdad38dbf5503830454e3eae19443270b8747784e7ccad638e7e50b9719ce WatchSource:0}: Error finding container 848fdad38dbf5503830454e3eae19443270b8747784e7ccad638e7e50b9719ce: Status 404 returned error can't find the container with id 848fdad38dbf5503830454e3eae19443270b8747784e7ccad638e7e50b9719ce Jun 02 01:43:30.707905 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.707830 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" event={"ID":"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b","Type":"ContainerStarted","Data":"0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384"} Jun 02 01:43:30.707905 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.707879 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" event={"ID":"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b","Type":"ContainerStarted","Data":"848fdad38dbf5503830454e3eae19443270b8747784e7ccad638e7e50b9719ce"} Jun 02 01:43:30.708431 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.707950 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:43:30.709386 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.709330 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9444674f7-4r8rm" event={"ID":"f9645f7f-2922-45cd-ad7a-1a82e58b8de0","Type":"ContainerStarted","Data":"139c19a1129fecc18eb0a0aeaeefeedef9d46a8c8c9d2cd3c621c499ee9f59c8"} Jun 02 01:43:30.709386 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.709365 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9444674f7-4r8rm" event={"ID":"f9645f7f-2922-45cd-ad7a-1a82e58b8de0","Type":"ContainerStarted","Data":"79d87a4fd85a796ddb5f7c5533b34e12f071f35a5b5b5b694dc9ed2a62ec4d7f"} Jun 02 01:43:30.710495 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.710457 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" event={"ID":"34d8efbb-748e-4291-8fcd-1d878fa37349","Type":"ContainerStarted","Data":"cc5c92b94dd23af68b704c3a8ac40469a253ba4418dba2bf0d4c79a6dc98bfd0"} Jun 02 01:43:30.728415 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.728366 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" podStartSLOduration=17.728353745 podStartE2EDuration="17.728353745s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:43:30.727669206 +0000 UTC m=+140.065350985" watchObservedRunningTime="2026-06-02 01:43:30.728353745 +0000 UTC m=+140.066035521" Jun 02 01:43:30.745039 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:30.744994 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-9444674f7-4r8rm" podStartSLOduration=17.744981117000002 podStartE2EDuration="17.744981117s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:43:30.743893893 +0000 UTC m=+140.081575671" watchObservedRunningTime="2026-06-02 01:43:30.744981117 +0000 UTC m=+140.082662893" Jun 02 01:43:31.611369 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:31.611335 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:31.613910 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:31.613884 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:31.713174 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:31.713146 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:31.714499 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:31.714473 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9444674f7-4r8rm" Jun 02 01:43:32.716496 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:32.716455 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" event={"ID":"34d8efbb-748e-4291-8fcd-1d878fa37349","Type":"ContainerStarted","Data":"c124e4c820ec0753f7888c2aeab0909163f83710c3167f7cdafcb7048c91e74f"} Jun 02 01:43:32.716885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:32.716504 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" event={"ID":"34d8efbb-748e-4291-8fcd-1d878fa37349","Type":"ContainerStarted","Data":"a819374ab73cad100365d6eac38346928dc6d5f92a79e8e0d2e9e6c5dfeeb6fa"} Jun 02 01:43:32.733256 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:32.733198 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-5bgtl" podStartSLOduration=17.443253608 podStartE2EDuration="19.733184167s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:29.766261937 +0000 UTC m=+139.103943693" lastFinishedPulling="2026-06-02 01:43:32.056192495 +0000 UTC m=+141.393874252" observedRunningTime="2026-06-02 01:43:32.731375327 +0000 UTC m=+142.069057103" watchObservedRunningTime="2026-06-02 01:43:32.733184167 +0000 UTC m=+142.070865944" Jun 02 01:43:36.232879 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:36.232846 2563 scope.go:117] "RemoveContainer" containerID="1b8dc827d13c052ff5ad9dcf01cf9642ef979c98e9a5233175e5690e55f2409a" Jun 02 01:43:36.728847 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:36.728820 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:43:36.729013 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:36.728881 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" event={"ID":"ca253491-8ecd-4250-8265-9c4f8786b163","Type":"ContainerStarted","Data":"33b8d63dbd8da3a567dd97a0b710211ca7c4c376493ecda3af1cae677532cb0a"} Jun 02 01:43:36.729153 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:36.729129 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:36.892356 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:36.892323 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" Jun 02 01:43:36.914725 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:36.914653 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-vsnvg" podStartSLOduration=21.544843253 podStartE2EDuration="23.914618798s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:14.129341051 +0000 UTC m=+123.467022807" lastFinishedPulling="2026-06-02 01:43:16.499116598 +0000 UTC m=+125.836798352" observedRunningTime="2026-06-02 01:43:36.745976985 +0000 UTC m=+146.083658762" watchObservedRunningTime="2026-06-02 01:43:36.914618798 +0000 UTC m=+146.252300577" Jun 02 01:43:38.182737 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.182685 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7l8r8"] Jun 02 01:43:38.186284 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.186260 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.189913 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.189891 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:43:38.190759 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.190741 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:43:38.190828 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.190757 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:43:38.191071 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.191052 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:43:38.191071 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.191066 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qqcg\"" Jun 02 01:43:38.197203 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.197184 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ddf746f45-bh5lb"] Jun 02 01:43:38.200920 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.200896 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7l8r8"] Jun 02 01:43:38.298657 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.298624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b43ccf85-8c64-4b23-9174-f4ca774591ff-crio-socket\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.298831 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.298661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b43ccf85-8c64-4b23-9174-f4ca774591ff-data-volume\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.298831 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.298683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b43ccf85-8c64-4b23-9174-f4ca774591ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.298831 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.298785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cf74\" (UniqueName: \"kubernetes.io/projected/b43ccf85-8c64-4b23-9174-f4ca774591ff-kube-api-access-6cf74\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.298831 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.298823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b43ccf85-8c64-4b23-9174-f4ca774591ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399510 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b43ccf85-8c64-4b23-9174-f4ca774591ff-crio-socket\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399732 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399551 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b43ccf85-8c64-4b23-9174-f4ca774591ff-data-volume\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399732 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399581 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b43ccf85-8c64-4b23-9174-f4ca774591ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399732 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b43ccf85-8c64-4b23-9174-f4ca774591ff-crio-socket\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399732 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399721 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cf74\" (UniqueName: \"kubernetes.io/projected/b43ccf85-8c64-4b23-9174-f4ca774591ff-kube-api-access-6cf74\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399888 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399758 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b43ccf85-8c64-4b23-9174-f4ca774591ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.399953 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.399934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b43ccf85-8c64-4b23-9174-f4ca774591ff-data-volume\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.400131 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.400116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b43ccf85-8c64-4b23-9174-f4ca774591ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.401969 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.401951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b43ccf85-8c64-4b23-9174-f4ca774591ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.407859 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.407838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cf74\" (UniqueName: \"kubernetes.io/projected/b43ccf85-8c64-4b23-9174-f4ca774591ff-kube-api-access-6cf74\") pod \"insights-runtime-extractor-7l8r8\" (UID: \"b43ccf85-8c64-4b23-9174-f4ca774591ff\") " pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.495584 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.495509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7l8r8" Jun 02 01:43:38.623666 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.623640 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7l8r8"] Jun 02 01:43:38.626027 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:38.625998 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43ccf85_8c64_4b23_9174_f4ca774591ff.slice/crio-da6cd6a48b4ffb2585c2a34dfc46c311a72c26422971e125c9405fd6c225d73d WatchSource:0}: Error finding container da6cd6a48b4ffb2585c2a34dfc46c311a72c26422971e125c9405fd6c225d73d: Status 404 returned error can't find the container with id da6cd6a48b4ffb2585c2a34dfc46c311a72c26422971e125c9405fd6c225d73d Jun 02 01:43:38.738987 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.738951 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7l8r8" event={"ID":"b43ccf85-8c64-4b23-9174-f4ca774591ff","Type":"ContainerStarted","Data":"691229b153fa7f22d05191b620d3208a454cba5f967ee7ff7e358c6a2356ccb0"} Jun 02 01:43:38.738987 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:38.738991 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7l8r8" event={"ID":"b43ccf85-8c64-4b23-9174-f4ca774591ff","Type":"ContainerStarted","Data":"da6cd6a48b4ffb2585c2a34dfc46c311a72c26422971e125c9405fd6c225d73d"} Jun 02 01:43:39.743187 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:39.743152 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7l8r8" event={"ID":"b43ccf85-8c64-4b23-9174-f4ca774591ff","Type":"ContainerStarted","Data":"4a88cf30e68360d5d02c6e2fb3e830345889a55a39047638dcdba3e35603e46b"} Jun 02 01:43:41.749743 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:41.749701 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7l8r8" event={"ID":"b43ccf85-8c64-4b23-9174-f4ca774591ff","Type":"ContainerStarted","Data":"bfdb87ca8e95f0edd65d0d32cebd57bedb488e1d67008e36b52881b4cd45d6aa"} Jun 02 01:43:41.767863 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:41.767802 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7l8r8" podStartSLOduration=1.494226421 podStartE2EDuration="3.767788441s" podCreationTimestamp="2026-06-02 01:43:38 +0000 UTC" firstStartedPulling="2026-06-02 01:43:38.683960011 +0000 UTC m=+148.021641766" lastFinishedPulling="2026-06-02 01:43:40.95752203 +0000 UTC m=+150.295203786" observedRunningTime="2026-06-02 01:43:41.766462541 +0000 UTC m=+151.104144319" watchObservedRunningTime="2026-06-02 01:43:41.767788441 +0000 UTC m=+151.105470246" Jun 02 01:43:45.656720 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:45.656667 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:45.659130 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:45.659104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f5e34b-1473-47a6-a00a-597800b9b2d2-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-vz8sd\" (UID: \"a3f5e34b-1473-47a6-a00a-597800b9b2d2\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:45.902123 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:45.902088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" Jun 02 01:43:46.020462 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:46.020430 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd"] Jun 02 01:43:46.023321 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:46.023290 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f5e34b_1473_47a6_a00a_597800b9b2d2.slice/crio-3973ba103f043d7698590787075dabf96fd3aae8eb4007c4eee5327560019271 WatchSource:0}: Error finding container 3973ba103f043d7698590787075dabf96fd3aae8eb4007c4eee5327560019271: Status 404 returned error can't find the container with id 3973ba103f043d7698590787075dabf96fd3aae8eb4007c4eee5327560019271 Jun 02 01:43:46.761322 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:46.761286 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" event={"ID":"a3f5e34b-1473-47a6-a00a-597800b9b2d2","Type":"ContainerStarted","Data":"3973ba103f043d7698590787075dabf96fd3aae8eb4007c4eee5327560019271"} Jun 02 01:43:47.765214 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:47.765132 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" event={"ID":"a3f5e34b-1473-47a6-a00a-597800b9b2d2","Type":"ContainerStarted","Data":"6c413c479382da1cc1b7d62094139ef7328af373f789fadd0d48e2727977346a"} Jun 02 01:43:47.781997 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:47.781947 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-vz8sd" podStartSLOduration=33.360574932 podStartE2EDuration="34.781931938s" podCreationTimestamp="2026-06-02 01:43:13 +0000 UTC" firstStartedPulling="2026-06-02 01:43:46.025189931 +0000 UTC m=+155.362871688" lastFinishedPulling="2026-06-02 01:43:47.446546935 +0000 UTC m=+156.784228694" observedRunningTime="2026-06-02 01:43:47.781410848 +0000 UTC m=+157.119092625" watchObservedRunningTime="2026-06-02 01:43:47.781931938 +0000 UTC m=+157.119613714" Jun 02 01:43:48.045345 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:48.045235 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6pc4p" podUID="6d883de3-4af9-45ea-a9bd-a742008ac77a" Jun 02 01:43:48.058326 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:48.058295 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hptd8" podUID="b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805" Jun 02 01:43:48.203676 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:48.203636 2563 patch_prober.go:28] interesting pod/image-registry-7ddf746f45-bh5lb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 01:43:48.203857 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:48.203715 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:43:48.767910 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:48.767874 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pc4p" Jun 02 01:43:49.242973 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:43:49.242939 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fz4zd" podUID="c961f928-3c35-495d-b28c-0e59d04c8e3a" Jun 02 01:43:53.018751 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.018683 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:43:53.019204 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.018769 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:43:53.021033 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.021010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d883de3-4af9-45ea-a9bd-a742008ac77a-metrics-tls\") pod \"dns-default-6pc4p\" (UID: \"6d883de3-4af9-45ea-a9bd-a742008ac77a\") " pod="openshift-dns/dns-default-6pc4p" Jun 02 01:43:53.021133 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.021033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805-cert\") pod \"ingress-canary-hptd8\" (UID: \"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805\") " pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:43:53.272154 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.272068 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q2kdm\"" Jun 02 01:43:53.280185 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.280165 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pc4p" Jun 02 01:43:53.404146 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.404122 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pc4p"] Jun 02 01:43:53.406505 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:53.406478 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d883de3_4af9_45ea_a9bd_a742008ac77a.slice/crio-ff4824e568d831e644dfb3094f656cb496febd9585f5a1f391bc2288a5e04d3f WatchSource:0}: Error finding container ff4824e568d831e644dfb3094f656cb496febd9585f5a1f391bc2288a5e04d3f: Status 404 returned error can't find the container with id ff4824e568d831e644dfb3094f656cb496febd9585f5a1f391bc2288a5e04d3f Jun 02 01:43:53.783089 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:53.783052 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pc4p" event={"ID":"6d883de3-4af9-45ea-a9bd-a742008ac77a","Type":"ContainerStarted","Data":"ff4824e568d831e644dfb3094f656cb496febd9585f5a1f391bc2288a5e04d3f"} Jun 02 01:43:54.787334 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:54.787296 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pc4p" event={"ID":"6d883de3-4af9-45ea-a9bd-a742008ac77a","Type":"ContainerStarted","Data":"b49fa2c44405bf83042d59e86b1000ec5d244508d53f69b287e9cec358aaa639"} Jun 02 01:43:54.787732 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:54.787340 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pc4p" event={"ID":"6d883de3-4af9-45ea-a9bd-a742008ac77a","Type":"ContainerStarted","Data":"4781e8180ae6ef3256b09ee71ca928950375fa3b02844753ec51bec1facbd8f7"} Jun 02 01:43:54.787732 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:54.787408 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6pc4p" Jun 02 01:43:54.808778 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:54.807234 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6pc4p" podStartSLOduration=128.659479545 podStartE2EDuration="2m9.807203412s" podCreationTimestamp="2026-06-02 01:41:45 +0000 UTC" firstStartedPulling="2026-06-02 01:43:53.408330182 +0000 UTC m=+162.746011936" lastFinishedPulling="2026-06-02 01:43:54.556054043 +0000 UTC m=+163.893735803" observedRunningTime="2026-06-02 01:43:54.805958496 +0000 UTC m=+164.143640274" watchObservedRunningTime="2026-06-02 01:43:54.807203412 +0000 UTC m=+164.144885191" Jun 02 01:43:56.364836 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.364799 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86ccf44695-bdqkf"] Jun 02 01:43:56.367951 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.367931 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.370760 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.370733 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:43:56.370877 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.370766 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:43:56.372134 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.372092 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:43:56.372271 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.372188 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:43:56.372271 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.372198 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:43:56.372552 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.372537 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:43:56.372593 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.372550 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kbb5h\"" Jun 02 01:43:56.372593 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.372538 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:43:56.376564 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.376544 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:43:56.377977 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.377954 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86ccf44695-bdqkf"] Jun 02 01:43:56.449231 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-serving-cert\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.449419 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-oauth-serving-cert\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.449419 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhqf\" (UniqueName: \"kubernetes.io/projected/42709068-9e8a-4251-8b3f-414da1acc459-kube-api-access-7nhqf\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.449419 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-trusted-ca-bundle\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.449419 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-oauth-config\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.449419 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-console-config\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.449605 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.449438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-service-ca\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550071 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550037 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-serving-cert\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550251 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550085 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-oauth-serving-cert\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550251 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550102 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhqf\" (UniqueName: \"kubernetes.io/projected/42709068-9e8a-4251-8b3f-414da1acc459-kube-api-access-7nhqf\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550251 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550224 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-trusted-ca-bundle\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550398 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550286 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-oauth-config\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550471 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550456 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-console-config\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550525 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550488 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-service-ca\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.550901 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.550881 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-oauth-serving-cert\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.551063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.551039 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-trusted-ca-bundle\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.551150 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.551130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-console-config\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.551209 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.551130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-service-ca\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.552666 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.552648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-serving-cert\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.552777 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.552763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-oauth-config\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.558700 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.558668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhqf\" (UniqueName: \"kubernetes.io/projected/42709068-9e8a-4251-8b3f-414da1acc459-kube-api-access-7nhqf\") pod \"console-86ccf44695-bdqkf\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.677704 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.677659 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:43:56.799227 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:56.799203 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86ccf44695-bdqkf"] Jun 02 01:43:56.801644 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:43:56.801618 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42709068_9e8a_4251_8b3f_414da1acc459.slice/crio-f2ef49d1c6cda6fdd625767c87446618738a296c80a85acdf8ed90b1561e89a2 WatchSource:0}: Error finding container f2ef49d1c6cda6fdd625767c87446618738a296c80a85acdf8ed90b1561e89a2: Status 404 returned error can't find the container with id f2ef49d1c6cda6fdd625767c87446618738a296c80a85acdf8ed90b1561e89a2 Jun 02 01:43:57.797285 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:57.797245 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86ccf44695-bdqkf" event={"ID":"42709068-9e8a-4251-8b3f-414da1acc459","Type":"ContainerStarted","Data":"f2ef49d1c6cda6fdd625767c87446618738a296c80a85acdf8ed90b1561e89a2"} Jun 02 01:43:58.202600 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:58.202558 2563 patch_prober.go:28] interesting pod/image-registry-7ddf746f45-bh5lb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 01:43:58.202779 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:58.202622 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:43:59.803431 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:59.803394 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86ccf44695-bdqkf" event={"ID":"42709068-9e8a-4251-8b3f-414da1acc459","Type":"ContainerStarted","Data":"b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62"} Jun 02 01:43:59.823166 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:43:59.823118 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86ccf44695-bdqkf" podStartSLOduration=1.314097442 podStartE2EDuration="3.823103511s" podCreationTimestamp="2026-06-02 01:43:56 +0000 UTC" firstStartedPulling="2026-06-02 01:43:56.803573283 +0000 UTC m=+166.141255038" lastFinishedPulling="2026-06-02 01:43:59.312579348 +0000 UTC m=+168.650261107" observedRunningTime="2026-06-02 01:43:59.821400772 +0000 UTC m=+169.159082549" watchObservedRunningTime="2026-06-02 01:43:59.823103511 +0000 UTC m=+169.160785265" Jun 02 01:44:00.232916 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:00.232871 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:44:00.235922 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:00.235901 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kzbv\"" Jun 02 01:44:00.244097 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:00.244077 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hptd8" Jun 02 01:44:00.366423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:00.366341 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hptd8"] Jun 02 01:44:00.368928 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:44:00.368896 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01cecc0_1c8f_4cb9_9de7_8e9c6f0c5805.slice/crio-3c5988ac02628fbcb2563f4a4a1065c1111f7845b902aec2dbadaa8ecacf3ef3 WatchSource:0}: Error finding container 3c5988ac02628fbcb2563f4a4a1065c1111f7845b902aec2dbadaa8ecacf3ef3: Status 404 returned error can't find the container with id 3c5988ac02628fbcb2563f4a4a1065c1111f7845b902aec2dbadaa8ecacf3ef3 Jun 02 01:44:00.806535 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:00.806499 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hptd8" event={"ID":"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805","Type":"ContainerStarted","Data":"3c5988ac02628fbcb2563f4a4a1065c1111f7845b902aec2dbadaa8ecacf3ef3"} Jun 02 01:44:01.236430 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:01.236405 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:44:01.812437 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:01.812393 2563 generic.go:358] "Generic (PLEG): container finished" podID="e7673c93-f318-4001-8a16-7443db03a7c9" containerID="87d4855d838b3b8500ee35f9da10a840da3e33ed1574329fa8c5cc46a94b23dc" exitCode=255 Jun 02 01:44:01.812437 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:01.812430 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" event={"ID":"e7673c93-f318-4001-8a16-7443db03a7c9","Type":"ContainerDied","Data":"87d4855d838b3b8500ee35f9da10a840da3e33ed1574329fa8c5cc46a94b23dc"} Jun 02 01:44:01.820510 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:01.820484 2563 scope.go:117] "RemoveContainer" containerID="87d4855d838b3b8500ee35f9da10a840da3e33ed1574329fa8c5cc46a94b23dc" Jun 02 01:44:02.817211 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:02.817172 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hptd8" event={"ID":"b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805","Type":"ContainerStarted","Data":"b4c509d3fef8b03dc80551af49cd715bcb4f91e1daabf3c791e5fc01a05d248f"} Jun 02 01:44:02.818646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:02.818622 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f48778c5d-976gc" event={"ID":"e7673c93-f318-4001-8a16-7443db03a7c9","Type":"ContainerStarted","Data":"b153950c37da8630c654d426cf640cfd41fd53bf1f11de8d215a036c941a629e"} Jun 02 01:44:02.833026 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:02.832981 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hptd8" podStartSLOduration=136.152843151 podStartE2EDuration="2m17.832966596s" podCreationTimestamp="2026-06-02 01:41:45 +0000 UTC" firstStartedPulling="2026-06-02 01:44:00.370778689 +0000 UTC m=+169.708460443" lastFinishedPulling="2026-06-02 01:44:02.05090211 +0000 UTC m=+171.388583888" observedRunningTime="2026-06-02 01:44:02.832616054 +0000 UTC m=+172.170297831" watchObservedRunningTime="2026-06-02 01:44:02.832966596 +0000 UTC m=+172.170648389" Jun 02 01:44:03.218999 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.218954 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerName="registry" containerID="cri-o://0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384" gracePeriod=30 Jun 02 01:44:03.458201 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.458175 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:44:03.616131 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616024 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-certificates\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616131 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616083 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdcm5\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-kube-api-access-qdcm5\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616131 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616106 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616131 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616137 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-installation-pull-secrets\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616450 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616164 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-trusted-ca\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616450 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616188 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-bound-sa-token\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616450 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616264 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-ca-trust-extracted\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616450 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616288 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-image-registry-private-configuration\") pod \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\" (UID: \"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b\") " Jun 02 01:44:03.616647 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616559 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:44:03.616831 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.616797 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:44:03.618481 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.618453 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:44:03.618612 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.618579 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-kube-api-access-qdcm5" (OuterVolumeSpecName: "kube-api-access-qdcm5") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "kube-api-access-qdcm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:44:03.618736 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.618677 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:44:03.618893 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.618875 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:44:03.618959 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.618917 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:44:03.625281 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.625249 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" (UID: "ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:44:03.717655 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717615 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-installation-pull-secrets\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717655 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717651 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-trusted-ca\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717665 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-bound-sa-token\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717678 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-ca-trust-extracted\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717709 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-image-registry-private-configuration\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717719 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-certificates\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717728 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdcm5\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-kube-api-access-qdcm5\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.717873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.717737 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b-registry-tls\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:03.821883 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.821847 2563 generic.go:358] "Generic (PLEG): container finished" podID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerID="0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384" exitCode=0 Jun 02 01:44:03.822312 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.821908 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" Jun 02 01:44:03.822312 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.821931 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" event={"ID":"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b","Type":"ContainerDied","Data":"0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384"} Jun 02 01:44:03.822312 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.821967 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddf746f45-bh5lb" event={"ID":"ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b","Type":"ContainerDied","Data":"848fdad38dbf5503830454e3eae19443270b8747784e7ccad638e7e50b9719ce"} Jun 02 01:44:03.822312 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.821983 2563 scope.go:117] "RemoveContainer" containerID="0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384" Jun 02 01:44:03.830282 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.830267 2563 scope.go:117] "RemoveContainer" containerID="0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384" Jun 02 01:44:03.830602 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:03.830575 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384\": container with ID starting with 0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384 not found: ID does not exist" containerID="0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384" Jun 02 01:44:03.830720 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.830609 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384"} err="failed to get container status \"0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384\": rpc error: code = NotFound desc = could not find container \"0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384\": container with ID starting with 0908be7e6fe0f74a127597d7fb10cb95acb4ee601509e02ffe2dbf7a12a61384 not found: ID does not exist" Jun 02 01:44:03.842600 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.842562 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ddf746f45-bh5lb"] Jun 02 01:44:03.845801 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:03.845775 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ddf746f45-bh5lb"] Jun 02 01:44:04.270549 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.270515 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-vf8hq"] Jun 02 01:44:04.270829 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.270815 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerName="registry" Jun 02 01:44:04.270879 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.270832 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerName="registry" Jun 02 01:44:04.270879 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.270876 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" containerName="registry" Jun 02 01:44:04.275632 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.275607 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.278503 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.278473 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:44:04.278631 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.278533 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 01:44:04.278631 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.278565 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:44:04.280142 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.280123 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:44:04.280259 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.280164 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:44:04.280259 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.280251 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kkjqx\"" Jun 02 01:44:04.289951 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.289929 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-vf8hq"] Jun 02 01:44:04.291069 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.291050 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj"] Jun 02 01:44:04.294316 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.294298 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.296706 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.296672 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 01:44:04.296981 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.296948 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 01:44:04.297081 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.297004 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:44:04.297081 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.297004 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cb7tk\"" Jun 02 01:44:04.303505 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.303481 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6n8bz"] Jun 02 01:44:04.307435 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.307415 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj"] Jun 02 01:44:04.307532 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.307521 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.310037 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.310016 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:44:04.310117 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.310016 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:44:04.310171 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.310157 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:44:04.310218 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.310157 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-76pc2\"" Jun 02 01:44:04.323825 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.323797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-sys\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.323936 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.323834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.323936 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.323869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.323936 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.323909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-tls\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324065 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.323950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f15f8f-cced-4706-a903-5db568e914b5-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.324065 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.323993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.324065 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh774\" (UniqueName: \"kubernetes.io/projected/d65036a8-cf7f-40d0-9440-a608a3636cf7-kube-api-access-hh774\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324065 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-textfile\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324202 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/31f15f8f-cced-4706-a903-5db568e914b5-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.324202 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.324202 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7b4w\" (UniqueName: \"kubernetes.io/projected/31f15f8f-cced-4706-a903-5db568e914b5-kube-api-access-g7b4w\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.324202 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-wtmp\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324202 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-root\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324373 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324373 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d65036a8-cf7f-40d0-9440-a608a3636cf7-metrics-client-ca\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.324373 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkqzv\" (UniqueName: \"kubernetes.io/projected/1d694045-32e6-4a83-8afd-176be335965b-kube-api-access-qkqzv\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.324373 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.324373 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.324552 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.324391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d694045-32e6-4a83-8afd-176be335965b-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.425286 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425251 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkqzv\" (UniqueName: \"kubernetes.io/projected/1d694045-32e6-4a83-8afd-176be335965b-kube-api-access-qkqzv\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.425286 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425292 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425312 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425338 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d694045-32e6-4a83-8afd-176be335965b-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425365 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-sys\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425395 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.425413 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425424 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425448 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-tls\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.425483 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls podName:1d694045-32e6-4a83-8afd-176be335965b nodeName:}" failed. No retries permitted until 2026-06-02 01:44:04.925462246 +0000 UTC m=+174.263144006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-vf8hq" (UID: "1d694045-32e6-4a83-8afd-176be335965b") : secret "openshift-state-metrics-tls" not found Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-sys\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.425529 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 01:44:04.425545 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.425541 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.425579 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-tls podName:d65036a8-cf7f-40d0-9440-a608a3636cf7 nodeName:}" failed. No retries permitted until 2026-06-02 01:44:04.925561725 +0000 UTC m=+174.263243498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-tls") pod "node-exporter-6n8bz" (UID: "d65036a8-cf7f-40d0-9440-a608a3636cf7") : secret "node-exporter-tls" not found Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.425602 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-tls podName:31f15f8f-cced-4706-a903-5db568e914b5 nodeName:}" failed. No retries permitted until 2026-06-02 01:44:04.925586223 +0000 UTC m=+174.263267978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-qhbcj" (UID: "31f15f8f-cced-4706-a903-5db568e914b5") : secret "kube-state-metrics-tls" not found Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425541 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f15f8f-cced-4706-a903-5db568e914b5-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425647 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425678 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh774\" (UniqueName: \"kubernetes.io/projected/d65036a8-cf7f-40d0-9440-a608a3636cf7-kube-api-access-hh774\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425735 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-textfile\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425765 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/31f15f8f-cced-4706-a903-5db568e914b5-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425797 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425825 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7b4w\" (UniqueName: \"kubernetes.io/projected/31f15f8f-cced-4706-a903-5db568e914b5-kube-api-access-g7b4w\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425860 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-wtmp\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-root\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425926 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.425957 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d65036a8-cf7f-40d0-9440-a608a3636cf7-metrics-client-ca\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-textfile\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d694045-32e6-4a83-8afd-176be335965b-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-wtmp\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31f15f8f-cced-4706-a903-5db568e914b5-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d65036a8-cf7f-40d0-9440-a608a3636cf7-root\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426382 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426465 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d65036a8-cf7f-40d0-9440-a608a3636cf7-metrics-client-ca\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426551 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/31f15f8f-cced-4706-a903-5db568e914b5-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.426808 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.426729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.428291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.428270 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.428407 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.428329 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.428537 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.428518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.437423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.437402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh774\" (UniqueName: \"kubernetes.io/projected/d65036a8-cf7f-40d0-9440-a608a3636cf7-kube-api-access-hh774\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.437423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.437408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkqzv\" (UniqueName: \"kubernetes.io/projected/1d694045-32e6-4a83-8afd-176be335965b-kube-api-access-qkqzv\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.437577 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.437505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7b4w\" (UniqueName: \"kubernetes.io/projected/31f15f8f-cced-4706-a903-5db568e914b5-kube-api-access-g7b4w\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.792569 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.792538 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6pc4p" Jun 02 01:44:04.930739 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.930684 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:04.931149 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.930761 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:04.931149 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.930781 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-tls\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.931149 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.930871 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 01:44:04.931149 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:04.930943 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls podName:1d694045-32e6-4a83-8afd-176be335965b nodeName:}" failed. No retries permitted until 2026-06-02 01:44:05.930927968 +0000 UTC m=+175.268609722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-vf8hq" (UID: "1d694045-32e6-4a83-8afd-176be335965b") : secret "openshift-state-metrics-tls" not found Jun 02 01:44:04.933051 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.933030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d65036a8-cf7f-40d0-9440-a608a3636cf7-node-exporter-tls\") pod \"node-exporter-6n8bz\" (UID: \"d65036a8-cf7f-40d0-9440-a608a3636cf7\") " pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:04.933196 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:04.933179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31f15f8f-cced-4706-a903-5db568e914b5-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-qhbcj\" (UID: \"31f15f8f-cced-4706-a903-5db568e914b5\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:05.205003 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.204968 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" Jun 02 01:44:05.216873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.216843 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6n8bz" Jun 02 01:44:05.226760 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:44:05.226726 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65036a8_cf7f_40d0_9440_a608a3636cf7.slice/crio-83160e131022a1b37cf2b80f178636a747d43b4b94b3f7e068e57f232af6f5a2 WatchSource:0}: Error finding container 83160e131022a1b37cf2b80f178636a747d43b4b94b3f7e068e57f232af6f5a2: Status 404 returned error can't find the container with id 83160e131022a1b37cf2b80f178636a747d43b4b94b3f7e068e57f232af6f5a2 Jun 02 01:44:05.235867 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.235835 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b" path="/var/lib/kubelet/pods/ce1ab102-abc8-4f6b-a3a7-2bb120f0ee0b/volumes" Jun 02 01:44:05.336286 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.336252 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj"] Jun 02 01:44:05.339386 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:44:05.339356 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f15f8f_cced_4706_a903_5db568e914b5.slice/crio-15390e2731713e0f0d7a0fbeab13145f764a69e07958b99ef9f702c26441a927 WatchSource:0}: Error finding container 15390e2731713e0f0d7a0fbeab13145f764a69e07958b99ef9f702c26441a927: Status 404 returned error can't find the container with id 15390e2731713e0f0d7a0fbeab13145f764a69e07958b99ef9f702c26441a927 Jun 02 01:44:05.828885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.828845 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" event={"ID":"31f15f8f-cced-4706-a903-5db568e914b5","Type":"ContainerStarted","Data":"15390e2731713e0f0d7a0fbeab13145f764a69e07958b99ef9f702c26441a927"} Jun 02 01:44:05.830078 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.830047 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6n8bz" event={"ID":"d65036a8-cf7f-40d0-9440-a608a3636cf7","Type":"ContainerStarted","Data":"83160e131022a1b37cf2b80f178636a747d43b4b94b3f7e068e57f232af6f5a2"} Jun 02 01:44:05.938885 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.938842 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:05.943478 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:05.941704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d694045-32e6-4a83-8afd-176be335965b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-vf8hq\" (UID: \"1d694045-32e6-4a83-8afd-176be335965b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:06.085502 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.085416 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" Jun 02 01:44:06.251010 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.250979 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh"] Jun 02 01:44:06.255160 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.255141 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.257844 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.257818 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 01:44:06.257960 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.257906 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wtcd6\"" Jun 02 01:44:06.258034 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.257824 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8j50vn1hnqsfe\"" Jun 02 01:44:06.258092 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.258018 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 01:44:06.258330 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.258309 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 01:44:06.258426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.258354 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 01:44:06.258485 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.258433 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 01:44:06.265859 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.265594 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh"] Jun 02 01:44:06.342076 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342191 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ca165b-4a48-477a-b682-9e32f8f83a7e-metrics-client-ca\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342191 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2psn\" (UniqueName: \"kubernetes.io/projected/a6ca165b-4a48-477a-b682-9e32f8f83a7e-kube-api-access-s2psn\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342387 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342481 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-tls\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342481 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.342624 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.342486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-grpc-tls\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.397290 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.397258 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-vf8hq"] Jun 02 01:44:06.400240 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:44:06.400211 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d694045_32e6_4a83_8afd_176be335965b.slice/crio-5617fe0474d532e7458390dd344691e901bbc5e66de00f0baf169345c0995ad5 WatchSource:0}: Error finding container 5617fe0474d532e7458390dd344691e901bbc5e66de00f0baf169345c0995ad5: Status 404 returned error can't find the container with id 5617fe0474d532e7458390dd344691e901bbc5e66de00f0baf169345c0995ad5 Jun 02 01:44:06.443466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443426 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-grpc-tls\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443599 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443498 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443599 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443533 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ca165b-4a48-477a-b682-9e32f8f83a7e-metrics-client-ca\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443599 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443575 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443781 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443619 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2psn\" (UniqueName: \"kubernetes.io/projected/a6ca165b-4a48-477a-b682-9e32f8f83a7e-kube-api-access-s2psn\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443781 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443781 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443772 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-tls\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.443932 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.443799 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.444633 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.444600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ca165b-4a48-477a-b682-9e32f8f83a7e-metrics-client-ca\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.446659 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.446631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.446813 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.446664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.447223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.447200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-tls\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.447353 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.447330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.447951 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.447920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-grpc-tls\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.448525 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.448507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6ca165b-4a48-477a-b682-9e32f8f83a7e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.452745 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.452684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2psn\" (UniqueName: \"kubernetes.io/projected/a6ca165b-4a48-477a-b682-9e32f8f83a7e-kube-api-access-s2psn\") pod \"thanos-querier-5dd5d9c769-gl9gh\" (UID: \"a6ca165b-4a48-477a-b682-9e32f8f83a7e\") " pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.579259 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.579230 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:06.678506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.678472 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:44:06.678506 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.678513 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:44:06.679884 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.679838 2563 patch_prober.go:28] interesting pod/console-86ccf44695-bdqkf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 02 01:44:06.679997 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.679886 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86ccf44695-bdqkf" podUID="42709068-9e8a-4251-8b3f-414da1acc459" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 02 01:44:06.835546 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.835508 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" event={"ID":"1d694045-32e6-4a83-8afd-176be335965b","Type":"ContainerStarted","Data":"a1dda4a7a646af872b1ded47b5e2101a3ffd2f0a3f895288d639968242559acf"} Jun 02 01:44:06.835684 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.835556 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" event={"ID":"1d694045-32e6-4a83-8afd-176be335965b","Type":"ContainerStarted","Data":"b27b6ab224788495a55a992bf741032bb25978f4d82982339970ed991e2add55"} Jun 02 01:44:06.835684 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.835571 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" event={"ID":"1d694045-32e6-4a83-8afd-176be335965b","Type":"ContainerStarted","Data":"5617fe0474d532e7458390dd344691e901bbc5e66de00f0baf169345c0995ad5"} Jun 02 01:44:06.836886 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.836860 2563 generic.go:358] "Generic (PLEG): container finished" podID="d65036a8-cf7f-40d0-9440-a608a3636cf7" containerID="e358d0bbf20e88cac5fcff2ac93a856c3cee5ebed3113fd97e6dc9ae516b2868" exitCode=0 Jun 02 01:44:06.836991 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.836895 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6n8bz" event={"ID":"d65036a8-cf7f-40d0-9440-a608a3636cf7","Type":"ContainerDied","Data":"e358d0bbf20e88cac5fcff2ac93a856c3cee5ebed3113fd97e6dc9ae516b2868"} Jun 02 01:44:06.958559 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:06.958523 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh"] Jun 02 01:44:06.962506 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:44:06.962481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ca165b_4a48_477a_b682_9e32f8f83a7e.slice/crio-f7da9018ae91165afab4a1c405bbbb13e2b7234aab9d933ffc20c3685ed35443 WatchSource:0}: Error finding container f7da9018ae91165afab4a1c405bbbb13e2b7234aab9d933ffc20c3685ed35443: Status 404 returned error can't find the container with id f7da9018ae91165afab4a1c405bbbb13e2b7234aab9d933ffc20c3685ed35443 Jun 02 01:44:07.847701 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.847662 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" event={"ID":"31f15f8f-cced-4706-a903-5db568e914b5","Type":"ContainerStarted","Data":"f6ef06c428a7a89ccc4ee030131d1990dea7a3a44fc5931a36bd19261b253d80"} Jun 02 01:44:07.847832 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.847725 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" event={"ID":"31f15f8f-cced-4706-a903-5db568e914b5","Type":"ContainerStarted","Data":"156c46fcd9b6b9f2242d8001e694cf719a2af91b6d2dda720bcb4e43fee5fdc9"} Jun 02 01:44:07.847832 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.847741 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" event={"ID":"31f15f8f-cced-4706-a903-5db568e914b5","Type":"ContainerStarted","Data":"1fa8bcdf680e05c821d0e118ebe6bd8673348f9504e2f199d0526e76d6af4fd9"} Jun 02 01:44:07.851021 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.850990 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6n8bz" event={"ID":"d65036a8-cf7f-40d0-9440-a608a3636cf7","Type":"ContainerStarted","Data":"0e807220b95c1bc91cd5c42ac95efbe4eaf028b400bb97f04d140174a1d85a67"} Jun 02 01:44:07.851136 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.851031 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6n8bz" event={"ID":"d65036a8-cf7f-40d0-9440-a608a3636cf7","Type":"ContainerStarted","Data":"ad146ec06f470ec5a50100334495f1f88d36e89f6a947aa843d2e331ce9bbeba"} Jun 02 01:44:07.852647 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.852608 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"f7da9018ae91165afab4a1c405bbbb13e2b7234aab9d933ffc20c3685ed35443"} Jun 02 01:44:07.854834 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.854809 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" event={"ID":"1d694045-32e6-4a83-8afd-176be335965b","Type":"ContainerStarted","Data":"bc828e92d59b9f1683acec1c4fcdccde6c43e0422d1f3efa13c9035177189a00"} Jun 02 01:44:07.868081 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.868021 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-qhbcj" podStartSLOduration=2.33584957 podStartE2EDuration="3.868003099s" podCreationTimestamp="2026-06-02 01:44:04 +0000 UTC" firstStartedPulling="2026-06-02 01:44:05.341162476 +0000 UTC m=+174.678844230" lastFinishedPulling="2026-06-02 01:44:06.873315989 +0000 UTC m=+176.210997759" observedRunningTime="2026-06-02 01:44:07.867287641 +0000 UTC m=+177.204969416" watchObservedRunningTime="2026-06-02 01:44:07.868003099 +0000 UTC m=+177.205684881" Jun 02 01:44:07.887534 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.886948 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6n8bz" podStartSLOduration=2.809468268 podStartE2EDuration="3.886929342s" podCreationTimestamp="2026-06-02 01:44:04 +0000 UTC" firstStartedPulling="2026-06-02 01:44:05.22853814 +0000 UTC m=+174.566219895" lastFinishedPulling="2026-06-02 01:44:06.305999204 +0000 UTC m=+175.643680969" observedRunningTime="2026-06-02 01:44:07.886307474 +0000 UTC m=+177.223989253" watchObservedRunningTime="2026-06-02 01:44:07.886929342 +0000 UTC m=+177.224611120" Jun 02 01:44:07.902880 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:07.902800 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-vf8hq" podStartSLOduration=2.71731422 podStartE2EDuration="3.902781055s" podCreationTimestamp="2026-06-02 01:44:04 +0000 UTC" firstStartedPulling="2026-06-02 01:44:06.572094509 +0000 UTC m=+175.909776264" lastFinishedPulling="2026-06-02 01:44:07.757561327 +0000 UTC m=+177.095243099" observedRunningTime="2026-06-02 01:44:07.902340155 +0000 UTC m=+177.240021932" watchObservedRunningTime="2026-06-02 01:44:07.902781055 +0000 UTC m=+177.240462833" Jun 02 01:44:09.864797 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:09.864761 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"71d4ad1d78c588c14a82a6f7383954a3b9c7db3d33d26558b258c3c9ae0187cf"} Jun 02 01:44:09.864797 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:09.864799 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"0b90926b9a5485d460ae59cace57ce835ed118eabd1af9bc46bca2d327406acd"} Jun 02 01:44:09.865179 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:09.864809 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"5e966221815a7ca8253c0bdffebdb71aad897f6b9fe5bbd8a87eaa35f5e1e227"} Jun 02 01:44:10.869779 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:10.869740 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"c0ae35e13a310a8a265dc2fab66aa9c14b5474abb4c31900eee8e0e0ed708d6b"} Jun 02 01:44:10.869779 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:10.869782 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"96d06ed19a64466285f0be073c3c57a645b6ce640a8597097cf5f5b52c4625d5"} Jun 02 01:44:10.870199 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:10.869795 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" event={"ID":"a6ca165b-4a48-477a-b682-9e32f8f83a7e","Type":"ContainerStarted","Data":"d850c2d2edd40de1981d9510372ccd9a53628d7894f2c95ed8c7cf7d78ecd006"} Jun 02 01:44:10.870199 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:10.869962 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:10.895081 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:10.895035 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" podStartSLOduration=1.612711094 podStartE2EDuration="4.895021608s" podCreationTimestamp="2026-06-02 01:44:06 +0000 UTC" firstStartedPulling="2026-06-02 01:44:06.964515548 +0000 UTC m=+176.302197323" lastFinishedPulling="2026-06-02 01:44:10.246826081 +0000 UTC m=+179.584507837" observedRunningTime="2026-06-02 01:44:10.892755868 +0000 UTC m=+180.230437646" watchObservedRunningTime="2026-06-02 01:44:10.895021608 +0000 UTC m=+180.232703384" Jun 02 01:44:16.682067 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:16.682036 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:44:16.685807 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:16.685785 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:44:16.879266 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:16.879234 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dd5d9c769-gl9gh" Jun 02 01:44:20.854707 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:20.854657 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86ccf44695-bdqkf"] Jun 02 01:44:32.320659 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:32.320628 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9444674f7-4r8rm_f9645f7f-2922-45cd-ad7a-1a82e58b8de0/router/0.log" Jun 02 01:44:32.331747 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:32.331717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hptd8_b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805/serve-healthcheck-canary/0.log" Jun 02 01:44:43.962988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:43.962896 2563 generic.go:358] "Generic (PLEG): container finished" podID="aa9c6fc0-a360-4f73-8e87-6aa2941a8934" containerID="1545eea865683d4e5529306bbecf0751d00652dc169778286b656f43ff9bbb6f" exitCode=0 Jun 02 01:44:43.962988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:43.962966 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" event={"ID":"aa9c6fc0-a360-4f73-8e87-6aa2941a8934","Type":"ContainerDied","Data":"1545eea865683d4e5529306bbecf0751d00652dc169778286b656f43ff9bbb6f"} Jun 02 01:44:43.963503 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:43.963375 2563 scope.go:117] "RemoveContainer" containerID="1545eea865683d4e5529306bbecf0751d00652dc169778286b656f43ff9bbb6f" Jun 02 01:44:44.970176 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:44.970137 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-xrxqk" event={"ID":"aa9c6fc0-a360-4f73-8e87-6aa2941a8934","Type":"ContainerStarted","Data":"71832ecde191d7c39f012fceeafdeb8869e0ec9ee566c7d24933b0c29e9cc42e"} Jun 02 01:44:45.875795 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:45.875748 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-86ccf44695-bdqkf" podUID="42709068-9e8a-4251-8b3f-414da1acc459" containerName="console" containerID="cri-o://b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62" gracePeriod=15 Jun 02 01:44:46.154645 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.154622 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86ccf44695-bdqkf_42709068-9e8a-4251-8b3f-414da1acc459/console/0.log" Jun 02 01:44:46.154983 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.154682 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:44:46.295771 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295737 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nhqf\" (UniqueName: \"kubernetes.io/projected/42709068-9e8a-4251-8b3f-414da1acc459-kube-api-access-7nhqf\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.295948 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295782 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-oauth-serving-cert\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.295948 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295834 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-oauth-config\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.295948 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295871 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-serving-cert\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.295948 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295898 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-service-ca\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.296147 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295949 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-trusted-ca-bundle\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.296147 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.295987 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-console-config\") pod \"42709068-9e8a-4251-8b3f-414da1acc459\" (UID: \"42709068-9e8a-4251-8b3f-414da1acc459\") " Jun 02 01:44:46.296300 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.296241 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:44:46.296449 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.296305 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-service-ca" (OuterVolumeSpecName: "service-ca") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:44:46.296449 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.296398 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:44:46.296577 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.296536 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-console-config" (OuterVolumeSpecName: "console-config") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:44:46.298093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.298068 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42709068-9e8a-4251-8b3f-414da1acc459-kube-api-access-7nhqf" (OuterVolumeSpecName: "kube-api-access-7nhqf") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "kube-api-access-7nhqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:44:46.298241 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.298218 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:44:46.298300 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.298233 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42709068-9e8a-4251-8b3f-414da1acc459" (UID: "42709068-9e8a-4251-8b3f-414da1acc459"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396873 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-oauth-config\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396917 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42709068-9e8a-4251-8b3f-414da1acc459-console-serving-cert\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396928 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-service-ca\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396937 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-trusted-ca-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396947 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-console-config\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396956 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nhqf\" (UniqueName: \"kubernetes.io/projected/42709068-9e8a-4251-8b3f-414da1acc459-kube-api-access-7nhqf\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.396971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.396965 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42709068-9e8a-4251-8b3f-414da1acc459-oauth-serving-cert\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:44:46.980046 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.980019 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86ccf44695-bdqkf_42709068-9e8a-4251-8b3f-414da1acc459/console/0.log" Jun 02 01:44:46.980242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.980060 2563 generic.go:358] "Generic (PLEG): container finished" podID="42709068-9e8a-4251-8b3f-414da1acc459" containerID="b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62" exitCode=2 Jun 02 01:44:46.980242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.980093 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86ccf44695-bdqkf" event={"ID":"42709068-9e8a-4251-8b3f-414da1acc459","Type":"ContainerDied","Data":"b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62"} Jun 02 01:44:46.980242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.980115 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86ccf44695-bdqkf" event={"ID":"42709068-9e8a-4251-8b3f-414da1acc459","Type":"ContainerDied","Data":"f2ef49d1c6cda6fdd625767c87446618738a296c80a85acdf8ed90b1561e89a2"} Jun 02 01:44:46.980242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.980130 2563 scope.go:117] "RemoveContainer" containerID="b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62" Jun 02 01:44:46.980242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.980143 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86ccf44695-bdqkf" Jun 02 01:44:46.989163 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.989143 2563 scope.go:117] "RemoveContainer" containerID="b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62" Jun 02 01:44:46.989432 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:44:46.989413 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62\": container with ID starting with b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62 not found: ID does not exist" containerID="b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62" Jun 02 01:44:46.989479 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:46.989441 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62"} err="failed to get container status \"b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62\": rpc error: code = NotFound desc = could not find container \"b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62\": container with ID starting with b94362101f55ff0dde3cc516289ed5ebd922be98e06752f1bdb420824c1e8f62 not found: ID does not exist" Jun 02 01:44:47.000685 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:47.000662 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86ccf44695-bdqkf"] Jun 02 01:44:47.003344 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:47.003319 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86ccf44695-bdqkf"] Jun 02 01:44:47.237262 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:44:47.237175 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42709068-9e8a-4251-8b3f-414da1acc459" path="/var/lib/kubelet/pods/42709068-9e8a-4251-8b3f-414da1acc459/volumes" Jun 02 01:45:21.996791 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:21.996732 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:45:21.999166 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:21.999136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c961f928-3c35-495d-b28c-0e59d04c8e3a-metrics-certs\") pod \"network-metrics-daemon-fz4zd\" (UID: \"c961f928-3c35-495d-b28c-0e59d04c8e3a\") " pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:45:22.240874 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:22.240836 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hbws\"" Jun 02 01:45:22.248408 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:22.248340 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fz4zd" Jun 02 01:45:22.373132 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:22.373109 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fz4zd"] Jun 02 01:45:22.375872 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:45:22.375835 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc961f928_3c35_495d_b28c_0e59d04c8e3a.slice/crio-bf8d45f3ceba21cc72ecfc864d23797316883dbe52225382f33519873b433820 WatchSource:0}: Error finding container bf8d45f3ceba21cc72ecfc864d23797316883dbe52225382f33519873b433820: Status 404 returned error can't find the container with id bf8d45f3ceba21cc72ecfc864d23797316883dbe52225382f33519873b433820 Jun 02 01:45:23.077669 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:23.077632 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fz4zd" event={"ID":"c961f928-3c35-495d-b28c-0e59d04c8e3a","Type":"ContainerStarted","Data":"bf8d45f3ceba21cc72ecfc864d23797316883dbe52225382f33519873b433820"} Jun 02 01:45:24.081550 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:24.081433 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fz4zd" event={"ID":"c961f928-3c35-495d-b28c-0e59d04c8e3a","Type":"ContainerStarted","Data":"402f799367d1d2a0b36d10a73e828804e649ea8354ea316afd26fbdda261f5bd"} Jun 02 01:45:24.081550 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:24.081470 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fz4zd" event={"ID":"c961f928-3c35-495d-b28c-0e59d04c8e3a","Type":"ContainerStarted","Data":"5fae4748b3f32574830d860877d1488298b1103519995afd11a3b8a83dce7ee1"} Jun 02 01:45:24.099950 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:24.099896 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fz4zd" podStartSLOduration=251.784224468 podStartE2EDuration="4m13.099881372s" podCreationTimestamp="2026-06-02 01:41:11 +0000 UTC" firstStartedPulling="2026-06-02 01:45:22.377948124 +0000 UTC m=+251.715629879" lastFinishedPulling="2026-06-02 01:45:23.69360502 +0000 UTC m=+253.031286783" observedRunningTime="2026-06-02 01:45:24.097858346 +0000 UTC m=+253.435540123" watchObservedRunningTime="2026-06-02 01:45:24.099881372 +0000 UTC m=+253.437563148" Jun 02 01:45:32.662464 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.662429 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b86c8685c-np652"] Jun 02 01:45:32.662986 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.662738 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42709068-9e8a-4251-8b3f-414da1acc459" containerName="console" Jun 02 01:45:32.662986 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.662751 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42709068-9e8a-4251-8b3f-414da1acc459" containerName="console" Jun 02 01:45:32.662986 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.662820 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="42709068-9e8a-4251-8b3f-414da1acc459" containerName="console" Jun 02 01:45:32.665463 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.665443 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.668314 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.668290 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:45:32.668314 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.668306 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:45:32.669867 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.669849 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kbb5h\"" Jun 02 01:45:32.670002 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.669980 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:45:32.670116 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.670094 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:45:32.670184 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.670147 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:45:32.670562 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.670391 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:45:32.670562 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.670436 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:45:32.674806 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.674785 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:45:32.677104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.677059 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b86c8685c-np652"] Jun 02 01:45:32.784109 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-oauth-serving-cert\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.784109 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-serving-cert\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.784361 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-config\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.784361 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb2sf\" (UniqueName: \"kubernetes.io/projected/8f5f28ee-86c9-4c96-a869-acb6af90c90c-kube-api-access-wb2sf\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.784361 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-trusted-ca-bundle\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.784361 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-oauth-config\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.784361 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.784339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-service-ca\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885590 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885549 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-trusted-ca-bundle\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885789 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885599 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-oauth-config\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885789 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-service-ca\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885870 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885819 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-oauth-serving-cert\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885870 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885844 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-serving-cert\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885870 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885862 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-config\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.885987 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.885901 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2sf\" (UniqueName: \"kubernetes.io/projected/8f5f28ee-86c9-4c96-a869-acb6af90c90c-kube-api-access-wb2sf\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.886613 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.886589 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-oauth-serving-cert\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.886765 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.886611 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-config\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.886765 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.886617 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-trusted-ca-bundle\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.887007 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.886989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-service-ca\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.888138 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.888119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-oauth-config\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.888360 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.888337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-serving-cert\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.893713 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.893667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb2sf\" (UniqueName: \"kubernetes.io/projected/8f5f28ee-86c9-4c96-a869-acb6af90c90c-kube-api-access-wb2sf\") pod \"console-6b86c8685c-np652\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:32.978450 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:32.978361 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:33.105074 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:33.105040 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b86c8685c-np652"] Jun 02 01:45:33.108268 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:45:33.108246 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5f28ee_86c9_4c96_a869_acb6af90c90c.slice/crio-4468a8fe530e70487ae1953a2e89a350d0fa3380471ff2870749394377d3495f WatchSource:0}: Error finding container 4468a8fe530e70487ae1953a2e89a350d0fa3380471ff2870749394377d3495f: Status 404 returned error can't find the container with id 4468a8fe530e70487ae1953a2e89a350d0fa3380471ff2870749394377d3495f Jun 02 01:45:34.109462 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:34.109423 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86c8685c-np652" event={"ID":"8f5f28ee-86c9-4c96-a869-acb6af90c90c","Type":"ContainerStarted","Data":"f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5"} Jun 02 01:45:34.109462 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:34.109461 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86c8685c-np652" event={"ID":"8f5f28ee-86c9-4c96-a869-acb6af90c90c","Type":"ContainerStarted","Data":"4468a8fe530e70487ae1953a2e89a350d0fa3380471ff2870749394377d3495f"} Jun 02 01:45:34.130698 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:34.130639 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b86c8685c-np652" podStartSLOduration=2.130620951 podStartE2EDuration="2.130620951s" podCreationTimestamp="2026-06-02 01:45:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:45:34.129049556 +0000 UTC m=+263.466731333" watchObservedRunningTime="2026-06-02 01:45:34.130620951 +0000 UTC m=+263.468302730" Jun 02 01:45:42.978673 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:42.978632 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:42.978673 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:42.978677 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:42.983421 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:42.983394 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:43.137834 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.137800 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:45:43.264566 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.264462 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8574dc99-5sntv"] Jun 02 01:45:43.267163 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.267141 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.280684 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.280655 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8574dc99-5sntv"] Jun 02 01:45:43.375284 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-config\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.375451 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-serving-cert\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.375451 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkks\" (UniqueName: \"kubernetes.io/projected/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-kube-api-access-7qkks\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.375451 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-service-ca\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.375451 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-oauth-serving-cert\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.375451 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-oauth-config\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.375616 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.375453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-trusted-ca-bundle\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.476645 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476595 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-oauth-config\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.476645 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476646 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-trusted-ca-bundle\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.476916 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476717 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-config\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.476916 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476742 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-serving-cert\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.476916 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476770 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkks\" (UniqueName: \"kubernetes.io/projected/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-kube-api-access-7qkks\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.476916 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476890 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-service-ca\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.477113 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.476945 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-oauth-serving-cert\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.477500 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.477472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-config\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.477681 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.477582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-service-ca\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.477681 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.477616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-oauth-serving-cert\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.477840 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.477802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-trusted-ca-bundle\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.479220 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.479199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-oauth-config\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.479265 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.479224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-serving-cert\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.489029 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.489006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkks\" (UniqueName: \"kubernetes.io/projected/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-kube-api-access-7qkks\") pod \"console-7d8574dc99-5sntv\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.577907 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.577817 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:43.724500 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:43.724467 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8574dc99-5sntv"] Jun 02 01:45:43.727676 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:45:43.727651 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1705197_9c72_431a_96e0_d0bc5bc0cf0f.slice/crio-3d57c17c2a3871011d24f7a892906d35ae3782c2628080bf422e269c7a56217a WatchSource:0}: Error finding container 3d57c17c2a3871011d24f7a892906d35ae3782c2628080bf422e269c7a56217a: Status 404 returned error can't find the container with id 3d57c17c2a3871011d24f7a892906d35ae3782c2628080bf422e269c7a56217a Jun 02 01:45:44.138177 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:44.138145 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8574dc99-5sntv" event={"ID":"b1705197-9c72-431a-96e0-d0bc5bc0cf0f","Type":"ContainerStarted","Data":"51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1"} Jun 02 01:45:44.138177 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:44.138183 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8574dc99-5sntv" event={"ID":"b1705197-9c72-431a-96e0-d0bc5bc0cf0f","Type":"ContainerStarted","Data":"3d57c17c2a3871011d24f7a892906d35ae3782c2628080bf422e269c7a56217a"} Jun 02 01:45:44.157209 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:44.157162 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d8574dc99-5sntv" podStartSLOduration=1.157148511 podStartE2EDuration="1.157148511s" podCreationTimestamp="2026-06-02 01:45:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:45:44.154889133 +0000 UTC m=+273.492570909" watchObservedRunningTime="2026-06-02 01:45:44.157148511 +0000 UTC m=+273.494830289" Jun 02 01:45:53.577961 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:53.577903 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:53.577961 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:53.577965 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:53.582761 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:53.582737 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:54.168560 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:54.168533 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:45:54.216209 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:45:54.216178 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b86c8685c-np652"] Jun 02 01:46:11.108544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:11.108517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:46:11.109270 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:11.109241 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:46:11.119045 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:11.119022 2563 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:46:19.243090 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.243033 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b86c8685c-np652" podUID="8f5f28ee-86c9-4c96-a869-acb6af90c90c" containerName="console" containerID="cri-o://f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5" gracePeriod=15 Jun 02 01:46:19.486852 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.486831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b86c8685c-np652_8f5f28ee-86c9-4c96-a869-acb6af90c90c/console/0.log" Jun 02 01:46:19.486976 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.486890 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:46:19.581990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.581901 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-oauth-serving-cert\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.581990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.581945 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-serving-cert\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.581990 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.581970 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-service-ca\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.582217 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582124 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb2sf\" (UniqueName: \"kubernetes.io/projected/8f5f28ee-86c9-4c96-a869-acb6af90c90c-kube-api-access-wb2sf\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.582217 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582181 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-trusted-ca-bundle\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.582299 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582265 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-oauth-config\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.582345 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582308 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-config\") pod \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\" (UID: \"8f5f28ee-86c9-4c96-a869-acb6af90c90c\") " Jun 02 01:46:19.582345 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582330 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:46:19.582445 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582362 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:46:19.582575 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582553 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-oauth-serving-cert\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:19.582734 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582579 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-service-ca\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:19.582734 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582604 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:46:19.582852 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.582828 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-config" (OuterVolumeSpecName: "console-config") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:46:19.584242 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.584221 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:46:19.584316 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.584278 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:46:19.584316 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.584289 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5f28ee-86c9-4c96-a869-acb6af90c90c-kube-api-access-wb2sf" (OuterVolumeSpecName: "kube-api-access-wb2sf") pod "8f5f28ee-86c9-4c96-a869-acb6af90c90c" (UID: "8f5f28ee-86c9-4c96-a869-acb6af90c90c"). InnerVolumeSpecName "kube-api-access-wb2sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:46:19.683336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.683301 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb2sf\" (UniqueName: \"kubernetes.io/projected/8f5f28ee-86c9-4c96-a869-acb6af90c90c-kube-api-access-wb2sf\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:19.683336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.683334 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-trusted-ca-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:19.683336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.683343 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-oauth-config\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:19.683336 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.683354 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-config\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:19.683595 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:19.683363 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f5f28ee-86c9-4c96-a869-acb6af90c90c-console-serving-cert\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:46:20.239857 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.239830 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b86c8685c-np652_8f5f28ee-86c9-4c96-a869-acb6af90c90c/console/0.log" Jun 02 01:46:20.240041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.239870 2563 generic.go:358] "Generic (PLEG): container finished" podID="8f5f28ee-86c9-4c96-a869-acb6af90c90c" containerID="f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5" exitCode=2 Jun 02 01:46:20.240041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.239905 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86c8685c-np652" event={"ID":"8f5f28ee-86c9-4c96-a869-acb6af90c90c","Type":"ContainerDied","Data":"f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5"} Jun 02 01:46:20.240041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.239935 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b86c8685c-np652" Jun 02 01:46:20.240041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.239949 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b86c8685c-np652" event={"ID":"8f5f28ee-86c9-4c96-a869-acb6af90c90c","Type":"ContainerDied","Data":"4468a8fe530e70487ae1953a2e89a350d0fa3380471ff2870749394377d3495f"} Jun 02 01:46:20.240041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.239967 2563 scope.go:117] "RemoveContainer" containerID="f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5" Jun 02 01:46:20.248447 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.248251 2563 scope.go:117] "RemoveContainer" containerID="f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5" Jun 02 01:46:20.248666 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:46:20.248527 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5\": container with ID starting with f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5 not found: ID does not exist" containerID="f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5" Jun 02 01:46:20.248666 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.248549 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5"} err="failed to get container status \"f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5\": rpc error: code = NotFound desc = could not find container \"f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5\": container with ID starting with f9ec36151aa8b9a8e536af48bb12add560e67b6f4fce6262c566a75611cc3ba5 not found: ID does not exist" Jun 02 01:46:20.260579 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.260553 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b86c8685c-np652"] Jun 02 01:46:20.265574 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:20.265544 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b86c8685c-np652"] Jun 02 01:46:21.236249 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:46:21.236217 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5f28ee-86c9-4c96-a869-acb6af90c90c" path="/var/lib/kubelet/pods/8f5f28ee-86c9-4c96-a869-acb6af90c90c/volumes" Jun 02 01:47:05.695801 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.695722 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc"] Jun 02 01:47:05.696288 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.696022 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5f28ee-86c9-4c96-a869-acb6af90c90c" containerName="console" Jun 02 01:47:05.696288 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.696033 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5f28ee-86c9-4c96-a869-acb6af90c90c" containerName="console" Jun 02 01:47:05.696288 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.696081 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f5f28ee-86c9-4c96-a869-acb6af90c90c" containerName="console" Jun 02 01:47:05.699205 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.699186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.703255 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.703231 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hq84\"" Jun 02 01:47:05.703255 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.703245 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:47:05.704458 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.704423 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:47:05.710651 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.710629 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc"] Jun 02 01:47:05.731618 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.731584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mftnv\" (UniqueName: \"kubernetes.io/projected/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-kube-api-access-mftnv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.731775 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.731680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.731775 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.731730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.832942 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.832903 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.833108 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.832968 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mftnv\" (UniqueName: \"kubernetes.io/projected/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-kube-api-access-mftnv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.833108 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.833013 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.833316 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.833298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.833364 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.833333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:05.841541 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:05.841514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mftnv\" (UniqueName: \"kubernetes.io/projected/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-kube-api-access-mftnv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:06.008263 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:06.008178 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:06.134147 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:06.134112 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc"] Jun 02 01:47:06.137193 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:47:06.137162 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6925b534_1f0f_4533_8c87_a7dcd2e3aafe.slice/crio-fa3d03a223d4c80e5e404e36b6ee8427968f39196f951f9c9964468ca6480bc4 WatchSource:0}: Error finding container fa3d03a223d4c80e5e404e36b6ee8427968f39196f951f9c9964468ca6480bc4: Status 404 returned error can't find the container with id fa3d03a223d4c80e5e404e36b6ee8427968f39196f951f9c9964468ca6480bc4 Jun 02 01:47:06.139063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:06.139049 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:47:06.368365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:06.368279 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" event={"ID":"6925b534-1f0f-4533-8c87-a7dcd2e3aafe","Type":"ContainerStarted","Data":"fa3d03a223d4c80e5e404e36b6ee8427968f39196f951f9c9964468ca6480bc4"} Jun 02 01:47:14.392914 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:14.392877 2563 generic.go:358] "Generic (PLEG): container finished" podID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerID="dfa62a2159d3ffbd623e79b1b6c34428cbf0144893148b546ac9fc229c064f40" exitCode=0 Jun 02 01:47:14.393331 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:14.392944 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" event={"ID":"6925b534-1f0f-4533-8c87-a7dcd2e3aafe","Type":"ContainerDied","Data":"dfa62a2159d3ffbd623e79b1b6c34428cbf0144893148b546ac9fc229c064f40"} Jun 02 01:47:17.402412 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:17.402378 2563 generic.go:358] "Generic (PLEG): container finished" podID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerID="040ddab11692b8d8f782809bd8aa863a3d39161b06203fde8539050a43fe5943" exitCode=0 Jun 02 01:47:17.402781 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:17.402456 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" event={"ID":"6925b534-1f0f-4533-8c87-a7dcd2e3aafe","Type":"ContainerDied","Data":"040ddab11692b8d8f782809bd8aa863a3d39161b06203fde8539050a43fe5943"} Jun 02 01:47:25.428867 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:25.428824 2563 generic.go:358] "Generic (PLEG): container finished" podID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerID="6eddc05802f306d424765283a2cd36d0b6481ef6d11484f98e9f568e95d99f35" exitCode=0 Jun 02 01:47:25.429232 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:25.428903 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" event={"ID":"6925b534-1f0f-4533-8c87-a7dcd2e3aafe","Type":"ContainerDied","Data":"6eddc05802f306d424765283a2cd36d0b6481ef6d11484f98e9f568e95d99f35"} Jun 02 01:47:26.553772 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.553751 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:26.712624 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.712528 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-bundle\") pod \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " Jun 02 01:47:26.712624 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.712608 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-util\") pod \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " Jun 02 01:47:26.712887 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.712659 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mftnv\" (UniqueName: \"kubernetes.io/projected/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-kube-api-access-mftnv\") pod \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\" (UID: \"6925b534-1f0f-4533-8c87-a7dcd2e3aafe\") " Jun 02 01:47:26.713206 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.713182 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-bundle" (OuterVolumeSpecName: "bundle") pod "6925b534-1f0f-4533-8c87-a7dcd2e3aafe" (UID: "6925b534-1f0f-4533-8c87-a7dcd2e3aafe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:47:26.714893 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.714868 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-kube-api-access-mftnv" (OuterVolumeSpecName: "kube-api-access-mftnv") pod "6925b534-1f0f-4533-8c87-a7dcd2e3aafe" (UID: "6925b534-1f0f-4533-8c87-a7dcd2e3aafe"). InnerVolumeSpecName "kube-api-access-mftnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:47:26.716559 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.716538 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-util" (OuterVolumeSpecName: "util") pod "6925b534-1f0f-4533-8c87-a7dcd2e3aafe" (UID: "6925b534-1f0f-4533-8c87-a7dcd2e3aafe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:47:26.813897 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.813858 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mftnv\" (UniqueName: \"kubernetes.io/projected/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-kube-api-access-mftnv\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:47:26.813897 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.813889 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:47:26.813897 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:26.813899 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6925b534-1f0f-4533-8c87-a7dcd2e3aafe-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:47:27.437107 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:27.437076 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" Jun 02 01:47:27.437268 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:27.437071 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnwfcc" event={"ID":"6925b534-1f0f-4533-8c87-a7dcd2e3aafe","Type":"ContainerDied","Data":"fa3d03a223d4c80e5e404e36b6ee8427968f39196f951f9c9964468ca6480bc4"} Jun 02 01:47:27.437268 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:27.437183 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa3d03a223d4c80e5e404e36b6ee8427968f39196f951f9c9964468ca6480bc4" Jun 02 01:47:33.967262 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967219 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw"] Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967651 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="util" Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967668 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="util" Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967702 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="pull" Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967711 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="pull" Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967738 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="extract" Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967746 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="extract" Jun 02 01:47:33.968101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.967815 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="6925b534-1f0f-4533-8c87-a7dcd2e3aafe" containerName="extract" Jun 02 01:47:33.972111 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.972091 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:33.974900 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.974877 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 01:47:33.975007 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.974877 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:47:33.975007 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.974988 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-78cnh\"" Jun 02 01:47:33.982708 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:33.982665 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw"] Jun 02 01:47:34.076948 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.076908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4lh\" (UniqueName: \"kubernetes.io/projected/257ccac5-edf5-46cd-8ceb-102affff3662-kube-api-access-tv4lh\") pod \"cert-manager-operator-controller-manager-54b9655956-glndw\" (UID: \"257ccac5-edf5-46cd-8ceb-102affff3662\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.077132 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.076975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/257ccac5-edf5-46cd-8ceb-102affff3662-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-glndw\" (UID: \"257ccac5-edf5-46cd-8ceb-102affff3662\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.177844 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.177810 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/257ccac5-edf5-46cd-8ceb-102affff3662-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-glndw\" (UID: \"257ccac5-edf5-46cd-8ceb-102affff3662\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.178015 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.177901 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4lh\" (UniqueName: \"kubernetes.io/projected/257ccac5-edf5-46cd-8ceb-102affff3662-kube-api-access-tv4lh\") pod \"cert-manager-operator-controller-manager-54b9655956-glndw\" (UID: \"257ccac5-edf5-46cd-8ceb-102affff3662\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.178185 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.178164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/257ccac5-edf5-46cd-8ceb-102affff3662-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-glndw\" (UID: \"257ccac5-edf5-46cd-8ceb-102affff3662\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.186200 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.186178 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4lh\" (UniqueName: \"kubernetes.io/projected/257ccac5-edf5-46cd-8ceb-102affff3662-kube-api-access-tv4lh\") pod \"cert-manager-operator-controller-manager-54b9655956-glndw\" (UID: \"257ccac5-edf5-46cd-8ceb-102affff3662\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.281148 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.281047 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" Jun 02 01:47:34.419031 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.418996 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw"] Jun 02 01:47:34.422557 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:47:34.422525 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257ccac5_edf5_46cd_8ceb_102affff3662.slice/crio-a4fbbe05c42006a84e0d260aa77889caf433099385c0c4faa951bd9e3cc3447e WatchSource:0}: Error finding container a4fbbe05c42006a84e0d260aa77889caf433099385c0c4faa951bd9e3cc3447e: Status 404 returned error can't find the container with id a4fbbe05c42006a84e0d260aa77889caf433099385c0c4faa951bd9e3cc3447e Jun 02 01:47:34.457041 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:34.457008 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" event={"ID":"257ccac5-edf5-46cd-8ceb-102affff3662","Type":"ContainerStarted","Data":"a4fbbe05c42006a84e0d260aa77889caf433099385c0c4faa951bd9e3cc3447e"} Jun 02 01:47:37.476627 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:37.476583 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" event={"ID":"257ccac5-edf5-46cd-8ceb-102affff3662","Type":"ContainerStarted","Data":"b0eba6a304c9a61c6055c1d26a61e183ecf39094162efa6802b821f9ca49f6ab"} Jun 02 01:47:37.498646 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:37.498598 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-glndw" podStartSLOduration=1.6088739570000001 podStartE2EDuration="4.49858237s" podCreationTimestamp="2026-06-02 01:47:33 +0000 UTC" firstStartedPulling="2026-06-02 01:47:34.425293872 +0000 UTC m=+383.762975632" lastFinishedPulling="2026-06-02 01:47:37.31500229 +0000 UTC m=+386.652684045" observedRunningTime="2026-06-02 01:47:37.49599851 +0000 UTC m=+386.833680287" watchObservedRunningTime="2026-06-02 01:47:37.49858237 +0000 UTC m=+386.836264147" Jun 02 01:47:38.102378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.102337 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294"] Jun 02 01:47:38.105019 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.104993 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.107826 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.107801 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hq84\"" Jun 02 01:47:38.108089 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.108061 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:47:38.108187 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.108095 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:47:38.116629 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.116583 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294"] Jun 02 01:47:38.212621 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.212583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vgc\" (UniqueName: \"kubernetes.io/projected/346948df-342e-4b26-b607-4a37e0aa8bf5-kube-api-access-s6vgc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.212858 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.212652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.212858 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.212761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.313502 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.313466 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.313703 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.313526 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vgc\" (UniqueName: \"kubernetes.io/projected/346948df-342e-4b26-b607-4a37e0aa8bf5-kube-api-access-s6vgc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.313703 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.313577 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.313873 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.313854 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.313923 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.313905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.322652 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.322621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vgc\" (UniqueName: \"kubernetes.io/projected/346948df-342e-4b26-b607-4a37e0aa8bf5-kube-api-access-s6vgc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.417709 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.417659 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:38.551831 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:38.551806 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294"] Jun 02 01:47:38.554282 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:47:38.554254 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346948df_342e_4b26_b607_4a37e0aa8bf5.slice/crio-b08bae6b84016a1e6455ffa764f82183dcfc458a53f32d14f35f2154a01f383d WatchSource:0}: Error finding container b08bae6b84016a1e6455ffa764f82183dcfc458a53f32d14f35f2154a01f383d: Status 404 returned error can't find the container with id b08bae6b84016a1e6455ffa764f82183dcfc458a53f32d14f35f2154a01f383d Jun 02 01:47:39.486450 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:39.486417 2563 generic.go:358] "Generic (PLEG): container finished" podID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerID="62fdbcb3694030f1264168176cf38493710f320585e19dda8184fcee22405a5d" exitCode=0 Jun 02 01:47:39.486642 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:39.486500 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" event={"ID":"346948df-342e-4b26-b607-4a37e0aa8bf5","Type":"ContainerDied","Data":"62fdbcb3694030f1264168176cf38493710f320585e19dda8184fcee22405a5d"} Jun 02 01:47:39.486642 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:39.486535 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" event={"ID":"346948df-342e-4b26-b607-4a37e0aa8bf5","Type":"ContainerStarted","Data":"b08bae6b84016a1e6455ffa764f82183dcfc458a53f32d14f35f2154a01f383d"} Jun 02 01:47:42.498327 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:42.498236 2563 generic.go:358] "Generic (PLEG): container finished" podID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerID="0d08cb687fed8703e7917aacd6468f5ddf3ba9db9e2ea5ac1fe040ffdc6c69ce" exitCode=0 Jun 02 01:47:42.498327 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:42.498314 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" event={"ID":"346948df-342e-4b26-b607-4a37e0aa8bf5","Type":"ContainerDied","Data":"0d08cb687fed8703e7917aacd6468f5ddf3ba9db9e2ea5ac1fe040ffdc6c69ce"} Jun 02 01:47:43.504009 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.503972 2563 generic.go:358] "Generic (PLEG): container finished" podID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerID="6ad54d4b5ea928782753ef30db64637c8b0b8cdba3d89e69970071df36393fa9" exitCode=0 Jun 02 01:47:43.504385 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.504061 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" event={"ID":"346948df-342e-4b26-b607-4a37e0aa8bf5","Type":"ContainerDied","Data":"6ad54d4b5ea928782753ef30db64637c8b0b8cdba3d89e69970071df36393fa9"} Jun 02 01:47:43.686132 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.686095 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vr9g8"] Jun 02 01:47:43.688445 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.688420 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.691453 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.691432 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 01:47:43.691592 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.691513 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5vjxq\"" Jun 02 01:47:43.691731 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.691680 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 01:47:43.702258 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.702230 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vr9g8"] Jun 02 01:47:43.758783 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.758683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkv6d\" (UniqueName: \"kubernetes.io/projected/e9fd909e-c2f4-4c6a-be8c-430743fd216c-kube-api-access-lkv6d\") pod \"cert-manager-cainjector-68b757865b-vr9g8\" (UID: \"e9fd909e-c2f4-4c6a-be8c-430743fd216c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.758930 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.758808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9fd909e-c2f4-4c6a-be8c-430743fd216c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vr9g8\" (UID: \"e9fd909e-c2f4-4c6a-be8c-430743fd216c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.859812 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.859776 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkv6d\" (UniqueName: \"kubernetes.io/projected/e9fd909e-c2f4-4c6a-be8c-430743fd216c-kube-api-access-lkv6d\") pod \"cert-manager-cainjector-68b757865b-vr9g8\" (UID: \"e9fd909e-c2f4-4c6a-be8c-430743fd216c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.859988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.859845 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9fd909e-c2f4-4c6a-be8c-430743fd216c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vr9g8\" (UID: \"e9fd909e-c2f4-4c6a-be8c-430743fd216c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.880210 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.880172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkv6d\" (UniqueName: \"kubernetes.io/projected/e9fd909e-c2f4-4c6a-be8c-430743fd216c-kube-api-access-lkv6d\") pod \"cert-manager-cainjector-68b757865b-vr9g8\" (UID: \"e9fd909e-c2f4-4c6a-be8c-430743fd216c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.882050 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.882032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9fd909e-c2f4-4c6a-be8c-430743fd216c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vr9g8\" (UID: \"e9fd909e-c2f4-4c6a-be8c-430743fd216c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:43.997157 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:43.997115 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" Jun 02 01:47:44.124292 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.124265 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vr9g8"] Jun 02 01:47:44.126325 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:47:44.126295 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9fd909e_c2f4_4c6a_be8c_430743fd216c.slice/crio-41654872061cb5568bde12283ce70c08d4fd703763eafe484d017adb744aa119 WatchSource:0}: Error finding container 41654872061cb5568bde12283ce70c08d4fd703763eafe484d017adb744aa119: Status 404 returned error can't find the container with id 41654872061cb5568bde12283ce70c08d4fd703763eafe484d017adb744aa119 Jun 02 01:47:44.508514 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.508476 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" event={"ID":"e9fd909e-c2f4-4c6a-be8c-430743fd216c","Type":"ContainerStarted","Data":"41654872061cb5568bde12283ce70c08d4fd703763eafe484d017adb744aa119"} Jun 02 01:47:44.621003 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.620981 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:44.665882 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.665850 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6vgc\" (UniqueName: \"kubernetes.io/projected/346948df-342e-4b26-b607-4a37e0aa8bf5-kube-api-access-s6vgc\") pod \"346948df-342e-4b26-b607-4a37e0aa8bf5\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " Jun 02 01:47:44.666015 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.665910 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-util\") pod \"346948df-342e-4b26-b607-4a37e0aa8bf5\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " Jun 02 01:47:44.666015 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.665964 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-bundle\") pod \"346948df-342e-4b26-b607-4a37e0aa8bf5\" (UID: \"346948df-342e-4b26-b607-4a37e0aa8bf5\") " Jun 02 01:47:44.666361 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.666331 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-bundle" (OuterVolumeSpecName: "bundle") pod "346948df-342e-4b26-b607-4a37e0aa8bf5" (UID: "346948df-342e-4b26-b607-4a37e0aa8bf5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:47:44.667922 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.667901 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346948df-342e-4b26-b607-4a37e0aa8bf5-kube-api-access-s6vgc" (OuterVolumeSpecName: "kube-api-access-s6vgc") pod "346948df-342e-4b26-b607-4a37e0aa8bf5" (UID: "346948df-342e-4b26-b607-4a37e0aa8bf5"). InnerVolumeSpecName "kube-api-access-s6vgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:47:44.670398 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.670375 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-util" (OuterVolumeSpecName: "util") pod "346948df-342e-4b26-b607-4a37e0aa8bf5" (UID: "346948df-342e-4b26-b607-4a37e0aa8bf5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:47:44.766922 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.766833 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6vgc\" (UniqueName: \"kubernetes.io/projected/346948df-342e-4b26-b607-4a37e0aa8bf5-kube-api-access-s6vgc\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:47:44.766922 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.766865 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:47:44.766922 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:44.766877 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346948df-342e-4b26-b607-4a37e0aa8bf5-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:47:45.514447 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:45.514363 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" event={"ID":"346948df-342e-4b26-b607-4a37e0aa8bf5","Type":"ContainerDied","Data":"b08bae6b84016a1e6455ffa764f82183dcfc458a53f32d14f35f2154a01f383d"} Jun 02 01:47:45.514447 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:45.514405 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b08bae6b84016a1e6455ffa764f82183dcfc458a53f32d14f35f2154a01f383d" Jun 02 01:47:45.514447 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:45.514424 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2g294" Jun 02 01:47:47.522560 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:47.522524 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" event={"ID":"e9fd909e-c2f4-4c6a-be8c-430743fd216c","Type":"ContainerStarted","Data":"02ba98350a7b04f234bd17b3921d64829522215c810bafb97c884fec41b256e8"} Jun 02 01:47:47.537655 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:47.537607 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-vr9g8" podStartSLOduration=1.9267407909999998 podStartE2EDuration="4.537594018s" podCreationTimestamp="2026-06-02 01:47:43 +0000 UTC" firstStartedPulling="2026-06-02 01:47:44.128135538 +0000 UTC m=+393.465817294" lastFinishedPulling="2026-06-02 01:47:46.738988756 +0000 UTC m=+396.076670521" observedRunningTime="2026-06-02 01:47:47.537465421 +0000 UTC m=+396.875147211" watchObservedRunningTime="2026-06-02 01:47:47.537594018 +0000 UTC m=+396.875275795" Jun 02 01:47:52.299750 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.299716 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52"] Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300038 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="pull" Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300049 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="pull" Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300064 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="extract" Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300070 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="extract" Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300077 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="util" Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300084 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="util" Jun 02 01:47:52.300169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.300134 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="346948df-342e-4b26-b607-4a37e0aa8bf5" containerName="extract" Jun 02 01:47:52.302002 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.301986 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.305706 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.305672 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:47:52.305706 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.305680 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:47:52.306740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.306722 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vq9th\"" Jun 02 01:47:52.311941 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.311920 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52"] Jun 02 01:47:52.315551 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.315526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnjjk\" (UniqueName: \"kubernetes.io/projected/f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4-kube-api-access-xnjjk\") pod \"openshift-lws-operator-bfc7f696d-45v52\" (UID: \"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.315648 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.315612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4-tmp\") pod \"openshift-lws-operator-bfc7f696d-45v52\" (UID: \"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.416052 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.415999 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4-tmp\") pod \"openshift-lws-operator-bfc7f696d-45v52\" (UID: \"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.416233 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.416072 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnjjk\" (UniqueName: \"kubernetes.io/projected/f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4-kube-api-access-xnjjk\") pod \"openshift-lws-operator-bfc7f696d-45v52\" (UID: \"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.416392 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.416372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4-tmp\") pod \"openshift-lws-operator-bfc7f696d-45v52\" (UID: \"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.424427 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.424400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnjjk\" (UniqueName: \"kubernetes.io/projected/f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4-kube-api-access-xnjjk\") pod \"openshift-lws-operator-bfc7f696d-45v52\" (UID: \"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.610949 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.610867 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" Jun 02 01:47:52.738342 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:52.738316 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52"] Jun 02 01:47:52.740225 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:47:52.740197 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf70eb576_2e8b_4e7f_8b53_aa9f32dc7bb4.slice/crio-5f2dfdfa5439e3b4c30c7b172079b958ea4fc677e1e1f12e4e76f304d2a86f7d WatchSource:0}: Error finding container 5f2dfdfa5439e3b4c30c7b172079b958ea4fc677e1e1f12e4e76f304d2a86f7d: Status 404 returned error can't find the container with id 5f2dfdfa5439e3b4c30c7b172079b958ea4fc677e1e1f12e4e76f304d2a86f7d Jun 02 01:47:53.540924 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:53.540886 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" event={"ID":"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4","Type":"ContainerStarted","Data":"5f2dfdfa5439e3b4c30c7b172079b958ea4fc677e1e1f12e4e76f304d2a86f7d"} Jun 02 01:47:55.548233 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:55.548140 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" event={"ID":"f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4","Type":"ContainerStarted","Data":"01fe0858310e7b4402a21732516b757835066978755b77137f66ec65b1811e64"} Jun 02 01:47:55.563528 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:55.563474 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-45v52" podStartSLOduration=1.007337245 podStartE2EDuration="3.563455443s" podCreationTimestamp="2026-06-02 01:47:52 +0000 UTC" firstStartedPulling="2026-06-02 01:47:52.742108659 +0000 UTC m=+402.079790417" lastFinishedPulling="2026-06-02 01:47:55.298226847 +0000 UTC m=+404.635908615" observedRunningTime="2026-06-02 01:47:55.562822319 +0000 UTC m=+404.900504095" watchObservedRunningTime="2026-06-02 01:47:55.563455443 +0000 UTC m=+404.901137223" Jun 02 01:47:58.092907 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.092869 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht"] Jun 02 01:47:58.142360 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.142323 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht"] Jun 02 01:47:58.142526 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.142448 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.145262 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.145231 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:47:58.145398 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.145242 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:47:58.146152 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.146138 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hq84\"" Jun 02 01:47:58.164676 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.164649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.164806 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.164711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5gf7\" (UniqueName: \"kubernetes.io/projected/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-kube-api-access-k5gf7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.164856 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.164811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.265894 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.265861 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.266075 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.265928 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.266075 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.265963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5gf7\" (UniqueName: \"kubernetes.io/projected/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-kube-api-access-k5gf7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.266367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.266342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.266466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.266364 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.274335 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.274309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5gf7\" (UniqueName: \"kubernetes.io/projected/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-kube-api-access-k5gf7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.451613 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.451574 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:47:58.586270 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:58.586249 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht"] Jun 02 01:47:58.589132 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:47:58.589105 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0f267e_261c_4ef3_98ea_e8e5831c44aa.slice/crio-2a29e04338cbc7256bc2412e3326a5d7ae1ba37c5a1835b9a51d22996bc0d59d WatchSource:0}: Error finding container 2a29e04338cbc7256bc2412e3326a5d7ae1ba37c5a1835b9a51d22996bc0d59d: Status 404 returned error can't find the container with id 2a29e04338cbc7256bc2412e3326a5d7ae1ba37c5a1835b9a51d22996bc0d59d Jun 02 01:47:59.568393 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:59.568310 2563 generic.go:358] "Generic (PLEG): container finished" podID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerID="f4bc4a42795cc1bcaa393579394a97032eb368e4fea4abec6f65c2b9cc6f5515" exitCode=0 Jun 02 01:47:59.568760 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:59.568396 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" event={"ID":"ac0f267e-261c-4ef3-98ea-e8e5831c44aa","Type":"ContainerDied","Data":"f4bc4a42795cc1bcaa393579394a97032eb368e4fea4abec6f65c2b9cc6f5515"} Jun 02 01:47:59.568760 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:47:59.568433 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" event={"ID":"ac0f267e-261c-4ef3-98ea-e8e5831c44aa","Type":"ContainerStarted","Data":"2a29e04338cbc7256bc2412e3326a5d7ae1ba37c5a1835b9a51d22996bc0d59d"} Jun 02 01:48:00.572895 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:00.572863 2563 generic.go:358] "Generic (PLEG): container finished" podID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerID="d5b8d467cb4b25757bde2d499a9437c79cc2c55d85a4023c1303f74debb59250" exitCode=0 Jun 02 01:48:00.573288 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:00.572942 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" event={"ID":"ac0f267e-261c-4ef3-98ea-e8e5831c44aa","Type":"ContainerDied","Data":"d5b8d467cb4b25757bde2d499a9437c79cc2c55d85a4023c1303f74debb59250"} Jun 02 01:48:01.578391 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:01.578359 2563 generic.go:358] "Generic (PLEG): container finished" podID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerID="d34fd978bf2b42687b7443a4b61f28fcb3e82794cae98b921887341067cd14d3" exitCode=0 Jun 02 01:48:01.578784 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:01.578443 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" event={"ID":"ac0f267e-261c-4ef3-98ea-e8e5831c44aa","Type":"ContainerDied","Data":"d34fd978bf2b42687b7443a4b61f28fcb3e82794cae98b921887341067cd14d3"} Jun 02 01:48:02.716413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.716388 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:48:02.805083 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.805049 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-util\") pod \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " Jun 02 01:48:02.805083 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.805097 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5gf7\" (UniqueName: \"kubernetes.io/projected/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-kube-api-access-k5gf7\") pod \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " Jun 02 01:48:02.805341 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.805147 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-bundle\") pod \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\" (UID: \"ac0f267e-261c-4ef3-98ea-e8e5831c44aa\") " Jun 02 01:48:02.806016 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.805989 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-bundle" (OuterVolumeSpecName: "bundle") pod "ac0f267e-261c-4ef3-98ea-e8e5831c44aa" (UID: "ac0f267e-261c-4ef3-98ea-e8e5831c44aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:48:02.807269 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.807244 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-kube-api-access-k5gf7" (OuterVolumeSpecName: "kube-api-access-k5gf7") pod "ac0f267e-261c-4ef3-98ea-e8e5831c44aa" (UID: "ac0f267e-261c-4ef3-98ea-e8e5831c44aa"). InnerVolumeSpecName "kube-api-access-k5gf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:48:02.810628 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.810592 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-util" (OuterVolumeSpecName: "util") pod "ac0f267e-261c-4ef3-98ea-e8e5831c44aa" (UID: "ac0f267e-261c-4ef3-98ea-e8e5831c44aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:48:02.905997 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.905959 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:48:02.905997 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.905993 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5gf7\" (UniqueName: \"kubernetes.io/projected/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-kube-api-access-k5gf7\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:48:02.905997 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:02.906004 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac0f267e-261c-4ef3-98ea-e8e5831c44aa-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:48:03.586815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:03.586714 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" event={"ID":"ac0f267e-261c-4ef3-98ea-e8e5831c44aa","Type":"ContainerDied","Data":"2a29e04338cbc7256bc2412e3326a5d7ae1ba37c5a1835b9a51d22996bc0d59d"} Jun 02 01:48:03.586815 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:03.586745 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdshcht" Jun 02 01:48:03.587039 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:03.586750 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a29e04338cbc7256bc2412e3326a5d7ae1ba37c5a1835b9a51d22996bc0d59d" Jun 02 01:48:14.965303 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965269 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf"] Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965638 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="pull" Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965653 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="pull" Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965666 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="extract" Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965672 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="extract" Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965680 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="util" Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965699 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="util" Jun 02 01:48:14.965843 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.965749 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac0f267e-261c-4ef3-98ea-e8e5831c44aa" containerName="extract" Jun 02 01:48:14.968394 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.968369 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:14.971159 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.971129 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:48:14.971307 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.971291 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:48:14.971386 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.971320 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:48:14.971447 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.971414 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f8v9d\"" Jun 02 01:48:14.971975 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.971955 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:48:14.984978 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:14.984954 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf"] Jun 02 01:48:15.003502 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.003474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04627260-935c-44db-8ba6-3b063120d637-tmp\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.003649 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.003518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04627260-935c-44db-8ba6-3b063120d637-manifests\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.003649 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.003624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04627260-935c-44db-8ba6-3b063120d637-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.003747 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.003657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04627260-935c-44db-8ba6-3b063120d637-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.003747 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.003729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8z54\" (UniqueName: \"kubernetes.io/projected/04627260-935c-44db-8ba6-3b063120d637-kube-api-access-v8z54\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.104133 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.104094 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8z54\" (UniqueName: \"kubernetes.io/projected/04627260-935c-44db-8ba6-3b063120d637-kube-api-access-v8z54\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.104133 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.104137 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04627260-935c-44db-8ba6-3b063120d637-tmp\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.104318 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.104167 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04627260-935c-44db-8ba6-3b063120d637-manifests\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.104318 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.104211 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04627260-935c-44db-8ba6-3b063120d637-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.104318 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.104233 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04627260-935c-44db-8ba6-3b063120d637-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.104795 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.104765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04627260-935c-44db-8ba6-3b063120d637-manifests\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.106614 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.106586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04627260-935c-44db-8ba6-3b063120d637-tmp\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.106749 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.106733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04627260-935c-44db-8ba6-3b063120d637-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.106926 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.106906 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04627260-935c-44db-8ba6-3b063120d637-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.116830 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.116810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8z54\" (UniqueName: \"kubernetes.io/projected/04627260-935c-44db-8ba6-3b063120d637-kube-api-access-v8z54\") pod \"opendatahub-operator-controller-manager-6fdd9d74b4-jglsf\" (UID: \"04627260-935c-44db-8ba6-3b063120d637\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.280142 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.280047 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:15.409633 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.409607 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf"] Jun 02 01:48:15.412401 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:15.412369 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04627260_935c_44db_8ba6_3b063120d637.slice/crio-5110953b9f58738096d7493e14d1b43fa13f71c4a6fa03883a996515f3ec69e7 WatchSource:0}: Error finding container 5110953b9f58738096d7493e14d1b43fa13f71c4a6fa03883a996515f3ec69e7: Status 404 returned error can't find the container with id 5110953b9f58738096d7493e14d1b43fa13f71c4a6fa03883a996515f3ec69e7 Jun 02 01:48:15.629291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:15.629211 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" event={"ID":"04627260-935c-44db-8ba6-3b063120d637","Type":"ContainerStarted","Data":"5110953b9f58738096d7493e14d1b43fa13f71c4a6fa03883a996515f3ec69e7"} Jun 02 01:48:18.642531 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:18.642496 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" event={"ID":"04627260-935c-44db-8ba6-3b063120d637","Type":"ContainerStarted","Data":"66a21c3f0bd2fae8cb7c10d5191f267c93c800e9f0c905d3c95483a1e0150657"} Jun 02 01:48:19.647579 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:19.647542 2563 generic.go:358] "Generic (PLEG): container finished" podID="04627260-935c-44db-8ba6-3b063120d637" containerID="66a21c3f0bd2fae8cb7c10d5191f267c93c800e9f0c905d3c95483a1e0150657" exitCode=0 Jun 02 01:48:19.648044 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:19.647592 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" event={"ID":"04627260-935c-44db-8ba6-3b063120d637","Type":"ContainerDied","Data":"66a21c3f0bd2fae8cb7c10d5191f267c93c800e9f0c905d3c95483a1e0150657"} Jun 02 01:48:20.653423 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:20.653385 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" event={"ID":"04627260-935c-44db-8ba6-3b063120d637","Type":"ContainerStarted","Data":"e7cc0cc1607c095ef8152c95bff911cc6e07dd37bc9a431e2b521418f117c5c6"} Jun 02 01:48:20.653859 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:20.653519 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:20.673404 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:20.673354 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" podStartSLOduration=2.094109068 podStartE2EDuration="6.673336006s" podCreationTimestamp="2026-06-02 01:48:14 +0000 UTC" firstStartedPulling="2026-06-02 01:48:15.41407558 +0000 UTC m=+424.751757336" lastFinishedPulling="2026-06-02 01:48:19.993302519 +0000 UTC m=+429.330984274" observedRunningTime="2026-06-02 01:48:20.672363864 +0000 UTC m=+430.010045642" watchObservedRunningTime="2026-06-02 01:48:20.673336006 +0000 UTC m=+430.011017784" Jun 02 01:48:31.658871 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:31.658785 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdd9d74b4-jglsf" Jun 02 01:48:33.696834 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.696788 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx"] Jun 02 01:48:33.700264 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.700245 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.703029 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.703010 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ff4ws\"" Jun 02 01:48:33.703114 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.703104 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 01:48:33.703982 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.703962 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 01:48:33.719757 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.719726 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx"] Jun 02 01:48:33.865759 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.865725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb05e835-b158-4efb-8a37-855e9fb55e74-tls-certs\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.865924 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.865804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jbh\" (UniqueName: \"kubernetes.io/projected/bb05e835-b158-4efb-8a37-855e9fb55e74-kube-api-access-q5jbh\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.865924 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.865850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb05e835-b158-4efb-8a37-855e9fb55e74-tmp\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.966861 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.966785 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jbh\" (UniqueName: \"kubernetes.io/projected/bb05e835-b158-4efb-8a37-855e9fb55e74-kube-api-access-q5jbh\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.966861 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.966844 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb05e835-b158-4efb-8a37-855e9fb55e74-tmp\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.967076 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.966879 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb05e835-b158-4efb-8a37-855e9fb55e74-tls-certs\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.969171 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.969137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb05e835-b158-4efb-8a37-855e9fb55e74-tmp\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.969355 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.969336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb05e835-b158-4efb-8a37-855e9fb55e74-tls-certs\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:33.974070 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:33.974040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jbh\" (UniqueName: \"kubernetes.io/projected/bb05e835-b158-4efb-8a37-855e9fb55e74-kube-api-access-q5jbh\") pod \"kube-auth-proxy-5f795fc994-6h9fx\" (UID: \"bb05e835-b158-4efb-8a37-855e9fb55e74\") " pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:34.009619 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.009393 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" Jun 02 01:48:34.154727 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.154703 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx"] Jun 02 01:48:34.156672 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:34.156646 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb05e835_b158_4efb_8a37_855e9fb55e74.slice/crio-8478bec010a005b089da6e0a0915195a50a7f31f830b86cbd48cbb6a5cfacdd7 WatchSource:0}: Error finding container 8478bec010a005b089da6e0a0915195a50a7f31f830b86cbd48cbb6a5cfacdd7: Status 404 returned error can't find the container with id 8478bec010a005b089da6e0a0915195a50a7f31f830b86cbd48cbb6a5cfacdd7 Jun 02 01:48:34.555401 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.555368 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-fhbsl"] Jun 02 01:48:34.558593 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.558576 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:34.560868 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.560846 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 01:48:34.561022 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.561001 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-phmnn\"" Jun 02 01:48:34.568379 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.568351 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-fhbsl"] Jun 02 01:48:34.672525 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.672489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7sj7\" (UniqueName: \"kubernetes.io/projected/3c05f581-0061-49bd-a93f-99afb5a6976d-kube-api-access-p7sj7\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:34.672734 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.672568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c05f581-0061-49bd-a93f-99afb5a6976d-tls-certs\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:34.701310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.701274 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" event={"ID":"bb05e835-b158-4efb-8a37-855e9fb55e74","Type":"ContainerStarted","Data":"8478bec010a005b089da6e0a0915195a50a7f31f830b86cbd48cbb6a5cfacdd7"} Jun 02 01:48:34.773921 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.773867 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7sj7\" (UniqueName: \"kubernetes.io/projected/3c05f581-0061-49bd-a93f-99afb5a6976d-kube-api-access-p7sj7\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:34.774104 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.773997 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c05f581-0061-49bd-a93f-99afb5a6976d-tls-certs\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:34.774264 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:48:34.774188 2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 01:48:34.774397 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:48:34.774279 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c05f581-0061-49bd-a93f-99afb5a6976d-tls-certs podName:3c05f581-0061-49bd-a93f-99afb5a6976d nodeName:}" failed. No retries permitted until 2026-06-02 01:48:35.27425442 +0000 UTC m=+444.611936195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3c05f581-0061-49bd-a93f-99afb5a6976d-tls-certs") pod "model-serving-api-6577596cd5-fhbsl" (UID: "3c05f581-0061-49bd-a93f-99afb5a6976d") : secret "model-serving-api-tls" not found Jun 02 01:48:34.784347 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:34.784322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7sj7\" (UniqueName: \"kubernetes.io/projected/3c05f581-0061-49bd-a93f-99afb5a6976d-kube-api-access-p7sj7\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:35.279365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.279314 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c05f581-0061-49bd-a93f-99afb5a6976d-tls-certs\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:35.282187 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.282164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c05f581-0061-49bd-a93f-99afb5a6976d-tls-certs\") pod \"model-serving-api-6577596cd5-fhbsl\" (UID: \"3c05f581-0061-49bd-a93f-99afb5a6976d\") " pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:35.470456 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.470425 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:35.821670 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.821630 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q"] Jun 02 01:48:35.837597 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.837553 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q"] Jun 02 01:48:35.837790 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.837737 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:35.840480 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.840451 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hq84\"" Jun 02 01:48:35.840631 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.840451 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:48:35.840829 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.840804 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:48:35.985626 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.985586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:35.985814 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.985641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:35.985814 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:35.985671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn6f9\" (UniqueName: \"kubernetes.io/projected/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-kube-api-access-wn6f9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.086985 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.086946 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.087164 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.087009 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.087471 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.087347 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn6f9\" (UniqueName: \"kubernetes.io/projected/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-kube-api-access-wn6f9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.087471 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.087414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.087471 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.087359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.095243 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.095213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn6f9\" (UniqueName: \"kubernetes.io/projected/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-kube-api-access-wn6f9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.152161 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.152127 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:36.219974 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.219936 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-fhbsl"] Jun 02 01:48:36.295966 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:36.295937 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q"] Jun 02 01:48:36.828095 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:36.828059 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c05f581_0061_49bd_a93f_99afb5a6976d.slice/crio-8b2a60ad3d5459644feb6a72ece417640f651637a3e6ab64fd645d82ac606e95 WatchSource:0}: Error finding container 8b2a60ad3d5459644feb6a72ece417640f651637a3e6ab64fd645d82ac606e95: Status 404 returned error can't find the container with id 8b2a60ad3d5459644feb6a72ece417640f651637a3e6ab64fd645d82ac606e95 Jun 02 01:48:36.828929 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:36.828765 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb93ee9_5b83_41fe_9586_22f3d29e0f7a.slice/crio-55d1437bca01a8a92b8258e7b37fa58bd8ffed428a49efb67d094d6c44523414 WatchSource:0}: Error finding container 55d1437bca01a8a92b8258e7b37fa58bd8ffed428a49efb67d094d6c44523414: Status 404 returned error can't find the container with id 55d1437bca01a8a92b8258e7b37fa58bd8ffed428a49efb67d094d6c44523414 Jun 02 01:48:37.714567 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:37.714531 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" event={"ID":"bb05e835-b158-4efb-8a37-855e9fb55e74","Type":"ContainerStarted","Data":"a6ca0fd127552a918d02409d9db28f2ac486635b88b5a688ffb09b35bd599e5f"} Jun 02 01:48:37.716067 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:37.716041 2563 generic.go:358] "Generic (PLEG): container finished" podID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerID="bdab483676d7d92b8e9a457dc8c733a4cf97cdcd5f2644e50e8a6425af924b27" exitCode=0 Jun 02 01:48:37.716188 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:37.716133 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" event={"ID":"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a","Type":"ContainerDied","Data":"bdab483676d7d92b8e9a457dc8c733a4cf97cdcd5f2644e50e8a6425af924b27"} Jun 02 01:48:37.716188 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:37.716169 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" event={"ID":"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a","Type":"ContainerStarted","Data":"55d1437bca01a8a92b8258e7b37fa58bd8ffed428a49efb67d094d6c44523414"} Jun 02 01:48:37.717540 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:37.717517 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" event={"ID":"3c05f581-0061-49bd-a93f-99afb5a6976d","Type":"ContainerStarted","Data":"8b2a60ad3d5459644feb6a72ece417640f651637a3e6ab64fd645d82ac606e95"} Jun 02 01:48:37.730727 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:37.730664 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f795fc994-6h9fx" podStartSLOduration=2.024711751 podStartE2EDuration="4.730650023s" podCreationTimestamp="2026-06-02 01:48:33 +0000 UTC" firstStartedPulling="2026-06-02 01:48:34.158459345 +0000 UTC m=+443.496141103" lastFinishedPulling="2026-06-02 01:48:36.864397619 +0000 UTC m=+446.202079375" observedRunningTime="2026-06-02 01:48:37.729282329 +0000 UTC m=+447.066964107" watchObservedRunningTime="2026-06-02 01:48:37.730650023 +0000 UTC m=+447.068331799" Jun 02 01:48:38.722509 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:38.722467 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" event={"ID":"3c05f581-0061-49bd-a93f-99afb5a6976d","Type":"ContainerStarted","Data":"b5895d40f609aae5c0316ee93a389d33c8eb53a68ea43e17d92149e5bc1f924d"} Jun 02 01:48:38.722898 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:38.722736 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:38.738424 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:38.738377 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" podStartSLOduration=2.960005029 podStartE2EDuration="4.738364611s" podCreationTimestamp="2026-06-02 01:48:34 +0000 UTC" firstStartedPulling="2026-06-02 01:48:36.829925236 +0000 UTC m=+446.167606995" lastFinishedPulling="2026-06-02 01:48:38.608284819 +0000 UTC m=+447.945966577" observedRunningTime="2026-06-02 01:48:38.73758136 +0000 UTC m=+448.075263134" watchObservedRunningTime="2026-06-02 01:48:38.738364611 +0000 UTC m=+448.076046388" Jun 02 01:48:39.727889 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:39.727859 2563 generic.go:358] "Generic (PLEG): container finished" podID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerID="c6d44d9dbc5754a7a8e4756a103e7ca8de6da91d8d0c3e26b9590a888f0e3d73" exitCode=0 Jun 02 01:48:39.728285 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:39.727946 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" event={"ID":"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a","Type":"ContainerDied","Data":"c6d44d9dbc5754a7a8e4756a103e7ca8de6da91d8d0c3e26b9590a888f0e3d73"} Jun 02 01:48:40.733742 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:40.733683 2563 generic.go:358] "Generic (PLEG): container finished" podID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerID="5afb022f0b5c00c8b5da3d7aa8eabeee98ce1c9b936d619bd71629998acbf3c4" exitCode=0 Jun 02 01:48:40.734115 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:40.733779 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" event={"ID":"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a","Type":"ContainerDied","Data":"5afb022f0b5c00c8b5da3d7aa8eabeee98ce1c9b936d619bd71629998acbf3c4"} Jun 02 01:48:41.864043 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.864016 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:41.939120 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.939083 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-util\") pod \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " Jun 02 01:48:41.939255 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.939159 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-bundle\") pod \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " Jun 02 01:48:41.939255 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.939230 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn6f9\" (UniqueName: \"kubernetes.io/projected/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-kube-api-access-wn6f9\") pod \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\" (UID: \"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a\") " Jun 02 01:48:41.940049 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.940016 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-bundle" (OuterVolumeSpecName: "bundle") pod "0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" (UID: "0cb93ee9-5b83-41fe-9586-22f3d29e0f7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:48:41.941397 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.941368 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-kube-api-access-wn6f9" (OuterVolumeSpecName: "kube-api-access-wn6f9") pod "0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" (UID: "0cb93ee9-5b83-41fe-9586-22f3d29e0f7a"). InnerVolumeSpecName "kube-api-access-wn6f9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:48:41.947430 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:41.947399 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-util" (OuterVolumeSpecName: "util") pod "0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" (UID: "0cb93ee9-5b83-41fe-9586-22f3d29e0f7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:48:42.040525 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:42.040432 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn6f9\" (UniqueName: \"kubernetes.io/projected/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-kube-api-access-wn6f9\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:48:42.040525 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:42.040466 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:48:42.040525 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:42.040481 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0cb93ee9-5b83-41fe-9586-22f3d29e0f7a-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:48:42.742040 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:42.742003 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" event={"ID":"0cb93ee9-5b83-41fe-9586-22f3d29e0f7a","Type":"ContainerDied","Data":"55d1437bca01a8a92b8258e7b37fa58bd8ffed428a49efb67d094d6c44523414"} Jun 02 01:48:42.742040 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:42.742044 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55d1437bca01a8a92b8258e7b37fa58bd8ffed428a49efb67d094d6c44523414" Jun 02 01:48:42.742245 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:42.742074 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q9f5q" Jun 02 01:48:44.376046 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376015 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6"] Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376327 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="extract" Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376338 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="extract" Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376350 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="util" Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376355 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="util" Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376374 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="pull" Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376380 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="pull" Jun 02 01:48:44.376426 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.376428 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="0cb93ee9-5b83-41fe-9586-22f3d29e0f7a" containerName="extract" Jun 02 01:48:44.379007 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.378988 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:44.382574 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.382555 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 01:48:44.383214 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.383192 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bs5xf\"" Jun 02 01:48:44.394107 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.394077 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c"] Jun 02 01:48:44.396302 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.396287 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.399198 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.399178 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 01:48:44.399198 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.399187 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w6ptr\"" Jun 02 01:48:44.404000 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.403977 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6"] Jun 02 01:48:44.430756 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.426811 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c"] Jun 02 01:48:44.460903 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.460871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce65db09-7d6a-4835-8ad6-96aa31592f82-cert\") pod \"llmisvc-controller-manager-c6b9847d7-nll7c\" (UID: \"ce65db09-7d6a-4835-8ad6-96aa31592f82\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.460903 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.460906 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs59k\" (UniqueName: \"kubernetes.io/projected/ce65db09-7d6a-4835-8ad6-96aa31592f82-kube-api-access-bs59k\") pod \"llmisvc-controller-manager-c6b9847d7-nll7c\" (UID: \"ce65db09-7d6a-4835-8ad6-96aa31592f82\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.461093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.460935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9smz\" (UniqueName: \"kubernetes.io/projected/0092768e-0199-40c5-9979-3ffa5dd1ad66-kube-api-access-j9smz\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:44.461093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.460994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0092768e-0199-40c5-9979-3ffa5dd1ad66-cert\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:44.561933 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.561887 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce65db09-7d6a-4835-8ad6-96aa31592f82-cert\") pod \"llmisvc-controller-manager-c6b9847d7-nll7c\" (UID: \"ce65db09-7d6a-4835-8ad6-96aa31592f82\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.562173 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.562139 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs59k\" (UniqueName: \"kubernetes.io/projected/ce65db09-7d6a-4835-8ad6-96aa31592f82-kube-api-access-bs59k\") pod \"llmisvc-controller-manager-c6b9847d7-nll7c\" (UID: \"ce65db09-7d6a-4835-8ad6-96aa31592f82\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.562244 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.562220 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9smz\" (UniqueName: \"kubernetes.io/projected/0092768e-0199-40c5-9979-3ffa5dd1ad66-kube-api-access-j9smz\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:44.562376 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.562357 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0092768e-0199-40c5-9979-3ffa5dd1ad66-cert\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:44.562949 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:48:44.562909 2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 01:48:44.563079 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:48:44.562982 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0092768e-0199-40c5-9979-3ffa5dd1ad66-cert podName:0092768e-0199-40c5-9979-3ffa5dd1ad66 nodeName:}" failed. No retries permitted until 2026-06-02 01:48:45.062961042 +0000 UTC m=+454.400642797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0092768e-0199-40c5-9979-3ffa5dd1ad66-cert") pod "kserve-controller-manager-7c99ffcdcd-hb9m6" (UID: "0092768e-0199-40c5-9979-3ffa5dd1ad66") : secret "kserve-webhook-server-cert" not found Jun 02 01:48:44.565420 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.565395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce65db09-7d6a-4835-8ad6-96aa31592f82-cert\") pod \"llmisvc-controller-manager-c6b9847d7-nll7c\" (UID: \"ce65db09-7d6a-4835-8ad6-96aa31592f82\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.574982 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.574960 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs59k\" (UniqueName: \"kubernetes.io/projected/ce65db09-7d6a-4835-8ad6-96aa31592f82-kube-api-access-bs59k\") pod \"llmisvc-controller-manager-c6b9847d7-nll7c\" (UID: \"ce65db09-7d6a-4835-8ad6-96aa31592f82\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.575074 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.574979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9smz\" (UniqueName: \"kubernetes.io/projected/0092768e-0199-40c5-9979-3ffa5dd1ad66-kube-api-access-j9smz\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:44.706039 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.705996 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:44.865442 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:44.865416 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c"] Jun 02 01:48:44.866490 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:44.866460 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podce65db09_7d6a_4835_8ad6_96aa31592f82.slice/crio-63418edf76036b2a2f1a185e0c8f22b1c9f7d9de3c93c51667052ae71ee4387c WatchSource:0}: Error finding container 63418edf76036b2a2f1a185e0c8f22b1c9f7d9de3c93c51667052ae71ee4387c: Status 404 returned error can't find the container with id 63418edf76036b2a2f1a185e0c8f22b1c9f7d9de3c93c51667052ae71ee4387c Jun 02 01:48:45.068109 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:45.068022 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0092768e-0199-40c5-9979-3ffa5dd1ad66-cert\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:45.070432 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:45.070407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0092768e-0199-40c5-9979-3ffa5dd1ad66-cert\") pod \"kserve-controller-manager-7c99ffcdcd-hb9m6\" (UID: \"0092768e-0199-40c5-9979-3ffa5dd1ad66\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:45.289144 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:45.289094 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:45.441099 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:45.441060 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6"] Jun 02 01:48:45.475902 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:45.475870 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0092768e_0199_40c5_9979_3ffa5dd1ad66.slice/crio-2b04c9e2d271b911e8ad6e7c1f952aa274f7aaa444705cb73de4c8681af9dcc7 WatchSource:0}: Error finding container 2b04c9e2d271b911e8ad6e7c1f952aa274f7aaa444705cb73de4c8681af9dcc7: Status 404 returned error can't find the container with id 2b04c9e2d271b911e8ad6e7c1f952aa274f7aaa444705cb73de4c8681af9dcc7 Jun 02 01:48:45.752862 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:45.752826 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" event={"ID":"0092768e-0199-40c5-9979-3ffa5dd1ad66","Type":"ContainerStarted","Data":"2b04c9e2d271b911e8ad6e7c1f952aa274f7aaa444705cb73de4c8681af9dcc7"} Jun 02 01:48:45.753849 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:45.753815 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" event={"ID":"ce65db09-7d6a-4835-8ad6-96aa31592f82","Type":"ContainerStarted","Data":"63418edf76036b2a2f1a185e0c8f22b1c9f7d9de3c93c51667052ae71ee4387c"} Jun 02 01:48:49.734160 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.734137 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-fhbsl" Jun 02 01:48:49.771494 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.771455 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" event={"ID":"ce65db09-7d6a-4835-8ad6-96aa31592f82","Type":"ContainerStarted","Data":"2e40254f08b5837eb2ef6ef78f286b51e4aefa3780c6ef3e4b1c68e08f1e6a5a"} Jun 02 01:48:49.771672 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.771591 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:48:49.773086 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.773060 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" event={"ID":"0092768e-0199-40c5-9979-3ffa5dd1ad66","Type":"ContainerStarted","Data":"de56f13fd10f5f8fb7510f779383779eca695334d0f7f17d363d8af9ea094ef0"} Jun 02 01:48:49.773250 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.773165 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:48:49.788229 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.788184 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" podStartSLOduration=1.05287107 podStartE2EDuration="5.788170751s" podCreationTimestamp="2026-06-02 01:48:44 +0000 UTC" firstStartedPulling="2026-06-02 01:48:44.86774389 +0000 UTC m=+454.205425661" lastFinishedPulling="2026-06-02 01:48:49.603043584 +0000 UTC m=+458.940725342" observedRunningTime="2026-06-02 01:48:49.787168901 +0000 UTC m=+459.124850678" watchObservedRunningTime="2026-06-02 01:48:49.788170751 +0000 UTC m=+459.125852527" Jun 02 01:48:49.803152 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:49.803105 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" podStartSLOduration=1.672352245 podStartE2EDuration="5.803090774s" podCreationTimestamp="2026-06-02 01:48:44 +0000 UTC" firstStartedPulling="2026-06-02 01:48:45.477519306 +0000 UTC m=+454.815201065" lastFinishedPulling="2026-06-02 01:48:49.608257831 +0000 UTC m=+458.945939594" observedRunningTime="2026-06-02 01:48:49.801913317 +0000 UTC m=+459.139595093" watchObservedRunningTime="2026-06-02 01:48:49.803090774 +0000 UTC m=+459.140772592" Jun 02 01:48:54.392986 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.392930 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7"] Jun 02 01:48:54.396636 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.396613 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.399551 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.399529 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:48:54.399662 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.399537 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:48:54.400475 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.400452 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hq84\"" Jun 02 01:48:54.405217 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.405166 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7"] Jun 02 01:48:54.450481 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.450442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.450637 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.450489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8xfw\" (UniqueName: \"kubernetes.io/projected/d5051905-6af6-4ca9-ad7f-d39e97b08f61-kube-api-access-g8xfw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.450637 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.450598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.551439 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.551397 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.551439 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.551443 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8xfw\" (UniqueName: \"kubernetes.io/projected/d5051905-6af6-4ca9-ad7f-d39e97b08f61-kube-api-access-g8xfw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.551721 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.551510 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.551820 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.551799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.551963 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.551883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.562658 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.562624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8xfw\" (UniqueName: \"kubernetes.io/projected/d5051905-6af6-4ca9-ad7f-d39e97b08f61-kube-api-access-g8xfw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.706540 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.706453 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:48:54.851227 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:54.851200 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7"] Jun 02 01:48:54.852950 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:54.852923 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5051905_6af6_4ca9_ad7f_d39e97b08f61.slice/crio-a393a337aa6c64b49588e03e71fd71a87a72018382f7b2968e0b82ebdc594d4c WatchSource:0}: Error finding container a393a337aa6c64b49588e03e71fd71a87a72018382f7b2968e0b82ebdc594d4c: Status 404 returned error can't find the container with id a393a337aa6c64b49588e03e71fd71a87a72018382f7b2968e0b82ebdc594d4c Jun 02 01:48:55.514711 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.511208 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc"] Jun 02 01:48:55.516221 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.516191 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.519075 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.519052 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rrsmz\"" Jun 02 01:48:55.519257 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.519244 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 01:48:55.519365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.519345 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 01:48:55.527147 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.527120 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc"] Jun 02 01:48:55.560768 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.560731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/28329c0c-0f5d-4d3b-95d0-b3459007c9ca-operator-config\") pod \"servicemesh-operator3-55f49c5f94-jb6qc\" (UID: \"28329c0c-0f5d-4d3b-95d0-b3459007c9ca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.560926 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.560773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mgdh\" (UniqueName: \"kubernetes.io/projected/28329c0c-0f5d-4d3b-95d0-b3459007c9ca-kube-api-access-9mgdh\") pod \"servicemesh-operator3-55f49c5f94-jb6qc\" (UID: \"28329c0c-0f5d-4d3b-95d0-b3459007c9ca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.662016 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.661980 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/28329c0c-0f5d-4d3b-95d0-b3459007c9ca-operator-config\") pod \"servicemesh-operator3-55f49c5f94-jb6qc\" (UID: \"28329c0c-0f5d-4d3b-95d0-b3459007c9ca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.662219 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.662023 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgdh\" (UniqueName: \"kubernetes.io/projected/28329c0c-0f5d-4d3b-95d0-b3459007c9ca-kube-api-access-9mgdh\") pod \"servicemesh-operator3-55f49c5f94-jb6qc\" (UID: \"28329c0c-0f5d-4d3b-95d0-b3459007c9ca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.664541 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.664519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/28329c0c-0f5d-4d3b-95d0-b3459007c9ca-operator-config\") pod \"servicemesh-operator3-55f49c5f94-jb6qc\" (UID: \"28329c0c-0f5d-4d3b-95d0-b3459007c9ca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.669964 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.669942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mgdh\" (UniqueName: \"kubernetes.io/projected/28329c0c-0f5d-4d3b-95d0-b3459007c9ca-kube-api-access-9mgdh\") pod \"servicemesh-operator3-55f49c5f94-jb6qc\" (UID: \"28329c0c-0f5d-4d3b-95d0-b3459007c9ca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.797021 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.796924 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerID="cf22a3a43588de7705cb630ee6576bebe87c246977f685762daf610db89f6c40" exitCode=0 Jun 02 01:48:55.797169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.797011 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" event={"ID":"d5051905-6af6-4ca9-ad7f-d39e97b08f61","Type":"ContainerDied","Data":"cf22a3a43588de7705cb630ee6576bebe87c246977f685762daf610db89f6c40"} Jun 02 01:48:55.797169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.797050 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" event={"ID":"d5051905-6af6-4ca9-ad7f-d39e97b08f61","Type":"ContainerStarted","Data":"a393a337aa6c64b49588e03e71fd71a87a72018382f7b2968e0b82ebdc594d4c"} Jun 02 01:48:55.827614 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.827581 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:55.961128 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:55.961100 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc"] Jun 02 01:48:55.962862 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:48:55.962830 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28329c0c_0f5d_4d3b_95d0_b3459007c9ca.slice/crio-f18658d01de8c5336f18abeb8854a1d39c6e4b601d4032236400b4dd5f2ef8ba WatchSource:0}: Error finding container f18658d01de8c5336f18abeb8854a1d39c6e4b601d4032236400b4dd5f2ef8ba: Status 404 returned error can't find the container with id f18658d01de8c5336f18abeb8854a1d39c6e4b601d4032236400b4dd5f2ef8ba Jun 02 01:48:56.801986 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:56.801961 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" event={"ID":"28329c0c-0f5d-4d3b-95d0-b3459007c9ca","Type":"ContainerStarted","Data":"f18658d01de8c5336f18abeb8854a1d39c6e4b601d4032236400b4dd5f2ef8ba"} Jun 02 01:48:57.809960 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:57.809919 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerID="df2c6ebf3018504dc13d1853b526346f8c9f0dda611d9b69a956e1af8c201d5e" exitCode=0 Jun 02 01:48:57.810372 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:57.809966 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" event={"ID":"d5051905-6af6-4ca9-ad7f-d39e97b08f61","Type":"ContainerDied","Data":"df2c6ebf3018504dc13d1853b526346f8c9f0dda611d9b69a956e1af8c201d5e"} Jun 02 01:48:58.816338 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:58.816295 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerID="8872342d4d52f73be49c59024be3e7d3f29fb421c4b8aa59ca92f9e6023c5690" exitCode=0 Jun 02 01:48:58.816837 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:58.816388 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" event={"ID":"d5051905-6af6-4ca9-ad7f-d39e97b08f61","Type":"ContainerDied","Data":"8872342d4d52f73be49c59024be3e7d3f29fb421c4b8aa59ca92f9e6023c5690"} Jun 02 01:48:59.828069 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:59.828027 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" event={"ID":"28329c0c-0f5d-4d3b-95d0-b3459007c9ca","Type":"ContainerStarted","Data":"e1595e1b83882fa1357bdfd6c434765eecfdc7ec9bf9fa96712448f48e7370b8"} Jun 02 01:48:59.828515 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:59.828319 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:48:59.851117 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:59.851065 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" podStartSLOduration=1.65359773 podStartE2EDuration="4.851049384s" podCreationTimestamp="2026-06-02 01:48:55 +0000 UTC" firstStartedPulling="2026-06-02 01:48:55.965549681 +0000 UTC m=+465.303231436" lastFinishedPulling="2026-06-02 01:48:59.163001332 +0000 UTC m=+468.500683090" observedRunningTime="2026-06-02 01:48:59.849509289 +0000 UTC m=+469.187191091" watchObservedRunningTime="2026-06-02 01:48:59.851049384 +0000 UTC m=+469.188731161" Jun 02 01:48:59.964243 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:48:59.964216 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:49:00.003070 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.003035 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-bundle\") pod \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " Jun 02 01:49:00.003232 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.003125 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-util\") pod \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " Jun 02 01:49:00.003280 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.003227 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8xfw\" (UniqueName: \"kubernetes.io/projected/d5051905-6af6-4ca9-ad7f-d39e97b08f61-kube-api-access-g8xfw\") pod \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\" (UID: \"d5051905-6af6-4ca9-ad7f-d39e97b08f61\") " Jun 02 01:49:00.004190 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.004158 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-bundle" (OuterVolumeSpecName: "bundle") pod "d5051905-6af6-4ca9-ad7f-d39e97b08f61" (UID: "d5051905-6af6-4ca9-ad7f-d39e97b08f61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:00.005366 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.005337 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5051905-6af6-4ca9-ad7f-d39e97b08f61-kube-api-access-g8xfw" (OuterVolumeSpecName: "kube-api-access-g8xfw") pod "d5051905-6af6-4ca9-ad7f-d39e97b08f61" (UID: "d5051905-6af6-4ca9-ad7f-d39e97b08f61"). InnerVolumeSpecName "kube-api-access-g8xfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:49:00.008207 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.008186 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-util" (OuterVolumeSpecName: "util") pod "d5051905-6af6-4ca9-ad7f-d39e97b08f61" (UID: "d5051905-6af6-4ca9-ad7f-d39e97b08f61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:00.104792 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.104667 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8xfw\" (UniqueName: \"kubernetes.io/projected/d5051905-6af6-4ca9-ad7f-d39e97b08f61-kube-api-access-g8xfw\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:00.104792 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.104732 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:00.104792 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.104747 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5051905-6af6-4ca9-ad7f-d39e97b08f61-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:00.833515 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.833485 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" Jun 02 01:49:00.833515 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.833495 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5fmn7" event={"ID":"d5051905-6af6-4ca9-ad7f-d39e97b08f61","Type":"ContainerDied","Data":"a393a337aa6c64b49588e03e71fd71a87a72018382f7b2968e0b82ebdc594d4c"} Jun 02 01:49:00.833977 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:00.833527 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a393a337aa6c64b49588e03e71fd71a87a72018382f7b2968e0b82ebdc594d4c" Jun 02 01:49:04.001572 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.001535 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f9c748996-4dt8t"] Jun 02 01:49:04.002100 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002061 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="pull" Jun 02 01:49:04.002100 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002083 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="pull" Jun 02 01:49:04.002223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002125 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="util" Jun 02 01:49:04.002223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002135 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="util" Jun 02 01:49:04.002223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002150 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="extract" Jun 02 01:49:04.002223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002156 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="extract" Jun 02 01:49:04.002223 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.002223 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5051905-6af6-4ca9-ad7f-d39e97b08f61" containerName="extract" Jun 02 01:49:04.006599 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.006575 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.009292 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.009268 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:49:04.009292 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.009282 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fhxrw\"" Jun 02 01:49:04.016431 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.016408 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f9c748996-4dt8t"] Jun 02 01:49:04.138013 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.137974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grhs8\" (UniqueName: \"kubernetes.io/projected/b7158ecb-4032-46ba-9bc6-3426191cd499-kube-api-access-grhs8\") pod \"dashboard-redirect-5f9c748996-4dt8t\" (UID: \"b7158ecb-4032-46ba-9bc6-3426191cd499\") " pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.138169 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.138043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b7158ecb-4032-46ba-9bc6-3426191cd499-redirect-config\") pod \"dashboard-redirect-5f9c748996-4dt8t\" (UID: \"b7158ecb-4032-46ba-9bc6-3426191cd499\") " pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.238636 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.238606 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grhs8\" (UniqueName: \"kubernetes.io/projected/b7158ecb-4032-46ba-9bc6-3426191cd499-kube-api-access-grhs8\") pod \"dashboard-redirect-5f9c748996-4dt8t\" (UID: \"b7158ecb-4032-46ba-9bc6-3426191cd499\") " pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.238796 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.238664 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b7158ecb-4032-46ba-9bc6-3426191cd499-redirect-config\") pod \"dashboard-redirect-5f9c748996-4dt8t\" (UID: \"b7158ecb-4032-46ba-9bc6-3426191cd499\") " pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.239328 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.239308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b7158ecb-4032-46ba-9bc6-3426191cd499-redirect-config\") pod \"dashboard-redirect-5f9c748996-4dt8t\" (UID: \"b7158ecb-4032-46ba-9bc6-3426191cd499\") " pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.246636 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.246614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grhs8\" (UniqueName: \"kubernetes.io/projected/b7158ecb-4032-46ba-9bc6-3426191cd499-kube-api-access-grhs8\") pod \"dashboard-redirect-5f9c748996-4dt8t\" (UID: \"b7158ecb-4032-46ba-9bc6-3426191cd499\") " pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.319177 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.319095 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" Jun 02 01:49:04.447915 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.447887 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f9c748996-4dt8t"] Jun 02 01:49:04.449595 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:49:04.449571 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7158ecb_4032_46ba_9bc6_3426191cd499.slice/crio-ee9580295d717ecb2f5df67292ec3c3de02f2de1217f3d4263b8f443cc7a3542 WatchSource:0}: Error finding container ee9580295d717ecb2f5df67292ec3c3de02f2de1217f3d4263b8f443cc7a3542: Status 404 returned error can't find the container with id ee9580295d717ecb2f5df67292ec3c3de02f2de1217f3d4263b8f443cc7a3542 Jun 02 01:49:04.858031 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:04.857993 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" event={"ID":"b7158ecb-4032-46ba-9bc6-3426191cd499","Type":"ContainerStarted","Data":"ee9580295d717ecb2f5df67292ec3c3de02f2de1217f3d4263b8f443cc7a3542"} Jun 02 01:49:07.871569 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:07.871537 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" event={"ID":"b7158ecb-4032-46ba-9bc6-3426191cd499","Type":"ContainerStarted","Data":"d4bc40832f48ccf935a5caf4f16e1280bcf1fcafa52e2b1dc909c261211a2780"} Jun 02 01:49:07.887472 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:07.887421 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f9c748996-4dt8t" podStartSLOduration=2.454272819 podStartE2EDuration="4.887407452s" podCreationTimestamp="2026-06-02 01:49:03 +0000 UTC" firstStartedPulling="2026-06-02 01:49:04.450911194 +0000 UTC m=+473.788592949" lastFinishedPulling="2026-06-02 01:49:06.884045822 +0000 UTC m=+476.221727582" observedRunningTime="2026-06-02 01:49:07.886062827 +0000 UTC m=+477.223744619" watchObservedRunningTime="2026-06-02 01:49:07.887407452 +0000 UTC m=+477.225089243" Jun 02 01:49:10.836476 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:10.836428 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-jb6qc" Jun 02 01:49:20.778977 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:20.778943 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-nll7c" Jun 02 01:49:20.782457 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:20.782429 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-hb9m6" Jun 02 01:49:26.730316 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.730275 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg"] Jun 02 01:49:26.732745 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.732725 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.735354 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.735314 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 01:49:26.735354 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.735327 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 01:49:26.735354 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.735327 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 01:49:26.735605 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.735458 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 01:49:26.735667 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.735614 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vphxl\"" Jun 02 01:49:26.743137 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.743112 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg"] Jun 02 01:49:26.836502 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.836740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6fb310-c429-4d0e-b285-a020f2bcf980-local-certs\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.836740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-cacerts\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.836740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nw7m\" (UniqueName: \"kubernetes.io/projected/9e6fb310-c429-4d0e-b285-a020f2bcf980-kube-api-access-2nw7m\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.836740 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-token\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.836912 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.836912 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.836834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937310 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-cacerts\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937315 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nw7m\" (UniqueName: \"kubernetes.io/projected/9e6fb310-c429-4d0e-b285-a020f2bcf980-kube-api-access-2nw7m\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937338 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-token\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937374 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937417 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937469 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.937797 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.937518 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6fb310-c429-4d0e-b285-a020f2bcf980-local-certs\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.938278 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.938222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.940650 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.940601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e6fb310-c429-4d0e-b285-a020f2bcf980-local-certs\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.940883 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.940855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.941033 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.941014 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.941729 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.941708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9e6fb310-c429-4d0e-b285-a020f2bcf980-cacerts\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.945727 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.945704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nw7m\" (UniqueName: \"kubernetes.io/projected/9e6fb310-c429-4d0e-b285-a020f2bcf980-kube-api-access-2nw7m\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:26.945966 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:26.945945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e6fb310-c429-4d0e-b285-a020f2bcf980-istio-token\") pod \"istiod-openshift-gateway-798958bb55-m24jg\" (UID: \"9e6fb310-c429-4d0e-b285-a020f2bcf980\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:27.045466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:27.045367 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:27.182158 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:27.182131 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg"] Jun 02 01:49:27.184622 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:49:27.184593 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6fb310_c429_4d0e_b285_a020f2bcf980.slice/crio-1b8c9715b96ea228e35b6e3a6e27d2a83e238253c812d0c6775b77049a446bd1 WatchSource:0}: Error finding container 1b8c9715b96ea228e35b6e3a6e27d2a83e238253c812d0c6775b77049a446bd1: Status 404 returned error can't find the container with id 1b8c9715b96ea228e35b6e3a6e27d2a83e238253c812d0c6775b77049a446bd1 Jun 02 01:49:27.946727 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:27.946669 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" event={"ID":"9e6fb310-c429-4d0e-b285-a020f2bcf980","Type":"ContainerStarted","Data":"1b8c9715b96ea228e35b6e3a6e27d2a83e238253c812d0c6775b77049a446bd1"} Jun 02 01:49:29.844202 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:29.844163 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:49:29.844504 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:29.844230 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:49:29.957360 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:29.957313 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" event={"ID":"9e6fb310-c429-4d0e-b285-a020f2bcf980","Type":"ContainerStarted","Data":"783f967610d68841d17ad7bf4ec528ee19a2190ec05ca2cd97b535cf3e52d2b1"} Jun 02 01:49:29.957558 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:29.957430 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:29.977218 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:29.977154 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" podStartSLOduration=1.319734964 podStartE2EDuration="3.977137344s" podCreationTimestamp="2026-06-02 01:49:26 +0000 UTC" firstStartedPulling="2026-06-02 01:49:27.186485903 +0000 UTC m=+496.524167658" lastFinishedPulling="2026-06-02 01:49:29.843888283 +0000 UTC m=+499.181570038" observedRunningTime="2026-06-02 01:49:29.975651125 +0000 UTC m=+499.313332901" watchObservedRunningTime="2026-06-02 01:49:29.977137344 +0000 UTC m=+499.314819122" Jun 02 01:49:30.963303 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:30.963261 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-m24jg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 01:49:30.963711 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:30.963340 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" podUID="9e6fb310-c429-4d0e-b285-a020f2bcf980" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:49:33.964256 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:33.964211 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-m24jg" Jun 02 01:49:50.482569 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.482538 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn"] Jun 02 01:49:50.492894 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.492871 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.493879 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.493853 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn"] Jun 02 01:49:50.495755 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.495730 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:49:50.496799 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.496771 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p7wkp\"" Jun 02 01:49:50.496906 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.496816 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:49:50.542836 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.542803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.543008 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.542872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbgb8\" (UniqueName: \"kubernetes.io/projected/190857db-50c0-4e9e-9e8e-3766f6df269d-kube-api-access-qbgb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.543008 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.542974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.643591 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.643553 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbgb8\" (UniqueName: \"kubernetes.io/projected/190857db-50c0-4e9e-9e8e-3766f6df269d-kube-api-access-qbgb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.643778 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.643610 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.643778 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.643642 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.643995 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.643974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.644031 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.644011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.651445 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.651410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbgb8\" (UniqueName: \"kubernetes.io/projected/190857db-50c0-4e9e-9e8e-3766f6df269d-kube-api-access-qbgb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.803179 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.803088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:50.935402 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:50.935372 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn"] Jun 02 01:49:50.937556 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:49:50.937519 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190857db_50c0_4e9e_9e8e_3766f6df269d.slice/crio-8e93570538eb025d634b3cc3d00c1fdafd52c1ffc5f07e5e02aa560b8d886674 WatchSource:0}: Error finding container 8e93570538eb025d634b3cc3d00c1fdafd52c1ffc5f07e5e02aa560b8d886674: Status 404 returned error can't find the container with id 8e93570538eb025d634b3cc3d00c1fdafd52c1ffc5f07e5e02aa560b8d886674 Jun 02 01:49:51.039074 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.039045 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" event={"ID":"190857db-50c0-4e9e-9e8e-3766f6df269d","Type":"ContainerStarted","Data":"98e32f6741f4dd862d7bb3c13c512d16557a4111cccbeb4e49f6edd79ab1b968"} Jun 02 01:49:51.039197 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.039081 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" event={"ID":"190857db-50c0-4e9e-9e8e-3766f6df269d","Type":"ContainerStarted","Data":"8e93570538eb025d634b3cc3d00c1fdafd52c1ffc5f07e5e02aa560b8d886674"} Jun 02 01:49:51.092025 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.091956 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4"] Jun 02 01:49:51.094435 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.094420 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.112914 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.112886 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4"] Jun 02 01:49:51.148263 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.148229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.148263 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.148263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb87g\" (UniqueName: \"kubernetes.io/projected/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-kube-api-access-pb87g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.148466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.148350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.249309 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.249272 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.249309 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.249309 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb87g\" (UniqueName: \"kubernetes.io/projected/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-kube-api-access-pb87g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.249512 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.249366 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.249660 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.249642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.249726 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.249676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.258429 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.258402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb87g\" (UniqueName: \"kubernetes.io/projected/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-kube-api-access-pb87g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.404153 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.404123 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:51.533368 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.533345 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4"] Jun 02 01:49:51.535518 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:49:51.535492 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e878ef_ba33_48f6_8c07_a9ddaea93bd9.slice/crio-94f795fc1895b6c073d5973a378044c1a1311cd47d4ef24eb2cef384f20a482e WatchSource:0}: Error finding container 94f795fc1895b6c073d5973a378044c1a1311cd47d4ef24eb2cef384f20a482e: Status 404 returned error can't find the container with id 94f795fc1895b6c073d5973a378044c1a1311cd47d4ef24eb2cef384f20a482e Jun 02 01:49:51.677523 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.677441 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w"] Jun 02 01:49:51.679992 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.679976 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.689367 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.689338 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w"] Jun 02 01:49:51.754248 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.754219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.754408 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.754278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.754408 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.754355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px75s\" (UniqueName: \"kubernetes.io/projected/580c7420-2dfc-4e0f-8121-c8563e3c5c42-kube-api-access-px75s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.855330 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.855292 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.855507 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.855355 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px75s\" (UniqueName: \"kubernetes.io/projected/580c7420-2dfc-4e0f-8121-c8563e3c5c42-kube-api-access-px75s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.855507 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.855409 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.855717 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.855667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.855792 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.855776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:51.864829 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:51.864809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px75s\" (UniqueName: \"kubernetes.io/projected/580c7420-2dfc-4e0f-8121-c8563e3c5c42-kube-api-access-px75s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:52.003214 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.003129 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:52.045935 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.045889 2563 generic.go:358] "Generic (PLEG): container finished" podID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerID="98e32f6741f4dd862d7bb3c13c512d16557a4111cccbeb4e49f6edd79ab1b968" exitCode=0 Jun 02 01:49:52.046109 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.045965 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" event={"ID":"190857db-50c0-4e9e-9e8e-3766f6df269d","Type":"ContainerDied","Data":"98e32f6741f4dd862d7bb3c13c512d16557a4111cccbeb4e49f6edd79ab1b968"} Jun 02 01:49:52.047522 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.047500 2563 generic.go:358] "Generic (PLEG): container finished" podID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerID="6f7a5c3bbfa12cae4ff27aa6a4c6135227ad59007cab477a7790eec7c37be240" exitCode=0 Jun 02 01:49:52.047638 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.047568 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" event={"ID":"24e878ef-ba33-48f6-8c07-a9ddaea93bd9","Type":"ContainerDied","Data":"6f7a5c3bbfa12cae4ff27aa6a4c6135227ad59007cab477a7790eec7c37be240"} Jun 02 01:49:52.047638 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.047594 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" event={"ID":"24e878ef-ba33-48f6-8c07-a9ddaea93bd9","Type":"ContainerStarted","Data":"94f795fc1895b6c073d5973a378044c1a1311cd47d4ef24eb2cef384f20a482e"} Jun 02 01:49:52.084154 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.084125 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j"] Jun 02 01:49:52.088098 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.088078 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.096675 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.096644 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j"] Jun 02 01:49:52.145928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.145899 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w"] Jun 02 01:49:52.147773 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:49:52.147747 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580c7420_2dfc_4e0f_8121_c8563e3c5c42.slice/crio-e2228f975b1b328a581fc93d9359c95e9eafe1f884e452b3bd7e4d5dec562c6a WatchSource:0}: Error finding container e2228f975b1b328a581fc93d9359c95e9eafe1f884e452b3bd7e4d5dec562c6a: Status 404 returned error can't find the container with id e2228f975b1b328a581fc93d9359c95e9eafe1f884e452b3bd7e4d5dec562c6a Jun 02 01:49:52.158777 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.158750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.158880 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.158847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.158952 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.158914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dsm\" (UniqueName: \"kubernetes.io/projected/826e14c6-1373-4683-9562-d05a2e5a5929-kube-api-access-62dsm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.260623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.260559 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.260623 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.260610 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.260878 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.260645 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62dsm\" (UniqueName: \"kubernetes.io/projected/826e14c6-1373-4683-9562-d05a2e5a5929-kube-api-access-62dsm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.261072 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.261050 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.261116 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.261058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.269062 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.269030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dsm\" (UniqueName: \"kubernetes.io/projected/826e14c6-1373-4683-9562-d05a2e5a5929-kube-api-access-62dsm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.406771 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.406734 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:52.539288 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:52.539259 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j"] Jun 02 01:49:52.541335 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:49:52.541308 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826e14c6_1373_4683_9562_d05a2e5a5929.slice/crio-a354d19463df52e44d1691a5cf44ab6b888cb90f6337d9ace196642ed82a8bac WatchSource:0}: Error finding container a354d19463df52e44d1691a5cf44ab6b888cb90f6337d9ace196642ed82a8bac: Status 404 returned error can't find the container with id a354d19463df52e44d1691a5cf44ab6b888cb90f6337d9ace196642ed82a8bac Jun 02 01:49:53.053362 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.053275 2563 generic.go:358] "Generic (PLEG): container finished" podID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerID="60bf383213679566edabf3e9351247b14c5963df23032cf531cd01e1ef4216e0" exitCode=0 Jun 02 01:49:53.053518 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.053367 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" event={"ID":"190857db-50c0-4e9e-9e8e-3766f6df269d","Type":"ContainerDied","Data":"60bf383213679566edabf3e9351247b14c5963df23032cf531cd01e1ef4216e0"} Jun 02 01:49:53.055038 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.055017 2563 generic.go:358] "Generic (PLEG): container finished" podID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerID="fe550c539cc2102d4e994d928900077b498ec8ca97cbbab8540cca0595517e59" exitCode=0 Jun 02 01:49:53.055159 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.055042 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" event={"ID":"24e878ef-ba33-48f6-8c07-a9ddaea93bd9","Type":"ContainerDied","Data":"fe550c539cc2102d4e994d928900077b498ec8ca97cbbab8540cca0595517e59"} Jun 02 01:49:53.056528 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.056478 2563 generic.go:358] "Generic (PLEG): container finished" podID="826e14c6-1373-4683-9562-d05a2e5a5929" containerID="d77f76a68c8ed438f90bfe6cedc6e2bd3ef40306d4acd7535f4441fa3c605e60" exitCode=0 Jun 02 01:49:53.056730 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.056561 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" event={"ID":"826e14c6-1373-4683-9562-d05a2e5a5929","Type":"ContainerDied","Data":"d77f76a68c8ed438f90bfe6cedc6e2bd3ef40306d4acd7535f4441fa3c605e60"} Jun 02 01:49:53.056730 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.056593 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" event={"ID":"826e14c6-1373-4683-9562-d05a2e5a5929","Type":"ContainerStarted","Data":"a354d19463df52e44d1691a5cf44ab6b888cb90f6337d9ace196642ed82a8bac"} Jun 02 01:49:53.058475 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.058454 2563 generic.go:358] "Generic (PLEG): container finished" podID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerID="84b67f0831e35283367f2cb3c6e30e26e996de34584b9ef025c4b072aacf86a1" exitCode=0 Jun 02 01:49:53.058552 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.058527 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" event={"ID":"580c7420-2dfc-4e0f-8121-c8563e3c5c42","Type":"ContainerDied","Data":"84b67f0831e35283367f2cb3c6e30e26e996de34584b9ef025c4b072aacf86a1"} Jun 02 01:49:53.058594 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:53.058553 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" event={"ID":"580c7420-2dfc-4e0f-8121-c8563e3c5c42","Type":"ContainerStarted","Data":"e2228f975b1b328a581fc93d9359c95e9eafe1f884e452b3bd7e4d5dec562c6a"} Jun 02 01:49:54.064892 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.064813 2563 generic.go:358] "Generic (PLEG): container finished" podID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerID="e1952c90caf7e968419842ea317697c9cb50145c2fadb059634154ce55ccfbb9" exitCode=0 Jun 02 01:49:54.065306 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.064892 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" event={"ID":"190857db-50c0-4e9e-9e8e-3766f6df269d","Type":"ContainerDied","Data":"e1952c90caf7e968419842ea317697c9cb50145c2fadb059634154ce55ccfbb9"} Jun 02 01:49:54.066988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.066952 2563 generic.go:358] "Generic (PLEG): container finished" podID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerID="ca08466b9b2169ed81c55349721c564a1633a11e05474955c7abd1231c179121" exitCode=0 Jun 02 01:49:54.067128 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.067014 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" event={"ID":"24e878ef-ba33-48f6-8c07-a9ddaea93bd9","Type":"ContainerDied","Data":"ca08466b9b2169ed81c55349721c564a1633a11e05474955c7abd1231c179121"} Jun 02 01:49:54.068677 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.068660 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" event={"ID":"826e14c6-1373-4683-9562-d05a2e5a5929","Type":"ContainerStarted","Data":"578d8cb750b569b5e4722cd04207382ea6f13291238223819d24b045ccf1cca1"} Jun 02 01:49:54.070398 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.070377 2563 generic.go:358] "Generic (PLEG): container finished" podID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerID="7fa66333cc127284011b31ec973b57a95b160e054c4588b9f5060213b85295bb" exitCode=0 Jun 02 01:49:54.070479 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:54.070459 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" event={"ID":"580c7420-2dfc-4e0f-8121-c8563e3c5c42","Type":"ContainerDied","Data":"7fa66333cc127284011b31ec973b57a95b160e054c4588b9f5060213b85295bb"} Jun 02 01:49:55.076229 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.076198 2563 generic.go:358] "Generic (PLEG): container finished" podID="826e14c6-1373-4683-9562-d05a2e5a5929" containerID="578d8cb750b569b5e4722cd04207382ea6f13291238223819d24b045ccf1cca1" exitCode=0 Jun 02 01:49:55.076658 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.076261 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" event={"ID":"826e14c6-1373-4683-9562-d05a2e5a5929","Type":"ContainerDied","Data":"578d8cb750b569b5e4722cd04207382ea6f13291238223819d24b045ccf1cca1"} Jun 02 01:49:55.078378 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.078359 2563 generic.go:358] "Generic (PLEG): container finished" podID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerID="ba1f3db00d5b1cff107655da0193f3e030d561dbd7ed6eb8f8c97c15d79b300a" exitCode=0 Jun 02 01:49:55.078471 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.078447 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" event={"ID":"580c7420-2dfc-4e0f-8121-c8563e3c5c42","Type":"ContainerDied","Data":"ba1f3db00d5b1cff107655da0193f3e030d561dbd7ed6eb8f8c97c15d79b300a"} Jun 02 01:49:55.314747 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.314719 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:55.317988 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.317968 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:55.388838 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.388811 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbgb8\" (UniqueName: \"kubernetes.io/projected/190857db-50c0-4e9e-9e8e-3766f6df269d-kube-api-access-qbgb8\") pod \"190857db-50c0-4e9e-9e8e-3766f6df269d\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " Jun 02 01:49:55.388970 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.388856 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-util\") pod \"190857db-50c0-4e9e-9e8e-3766f6df269d\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " Jun 02 01:49:55.388970 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.388891 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-util\") pod \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " Jun 02 01:49:55.389038 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.389009 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb87g\" (UniqueName: \"kubernetes.io/projected/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-kube-api-access-pb87g\") pod \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " Jun 02 01:49:55.389100 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.389074 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-bundle\") pod \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\" (UID: \"24e878ef-ba33-48f6-8c07-a9ddaea93bd9\") " Jun 02 01:49:55.389145 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.389110 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-bundle\") pod \"190857db-50c0-4e9e-9e8e-3766f6df269d\" (UID: \"190857db-50c0-4e9e-9e8e-3766f6df269d\") " Jun 02 01:49:55.389726 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.389651 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-bundle" (OuterVolumeSpecName: "bundle") pod "24e878ef-ba33-48f6-8c07-a9ddaea93bd9" (UID: "24e878ef-ba33-48f6-8c07-a9ddaea93bd9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:55.389924 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.389898 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-bundle" (OuterVolumeSpecName: "bundle") pod "190857db-50c0-4e9e-9e8e-3766f6df269d" (UID: "190857db-50c0-4e9e-9e8e-3766f6df269d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:55.391188 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.391159 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-kube-api-access-pb87g" (OuterVolumeSpecName: "kube-api-access-pb87g") pod "24e878ef-ba33-48f6-8c07-a9ddaea93bd9" (UID: "24e878ef-ba33-48f6-8c07-a9ddaea93bd9"). InnerVolumeSpecName "kube-api-access-pb87g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:49:55.391280 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.391212 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190857db-50c0-4e9e-9e8e-3766f6df269d-kube-api-access-qbgb8" (OuterVolumeSpecName: "kube-api-access-qbgb8") pod "190857db-50c0-4e9e-9e8e-3766f6df269d" (UID: "190857db-50c0-4e9e-9e8e-3766f6df269d"). InnerVolumeSpecName "kube-api-access-qbgb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:49:55.395109 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.395087 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-util" (OuterVolumeSpecName: "util") pod "24e878ef-ba33-48f6-8c07-a9ddaea93bd9" (UID: "24e878ef-ba33-48f6-8c07-a9ddaea93bd9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:55.395162 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.395101 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-util" (OuterVolumeSpecName: "util") pod "190857db-50c0-4e9e-9e8e-3766f6df269d" (UID: "190857db-50c0-4e9e-9e8e-3766f6df269d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:55.490875 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.490842 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:55.490875 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.490869 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:55.490875 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.490881 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbgb8\" (UniqueName: \"kubernetes.io/projected/190857db-50c0-4e9e-9e8e-3766f6df269d-kube-api-access-qbgb8\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:55.491099 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.490891 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/190857db-50c0-4e9e-9e8e-3766f6df269d-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:55.491099 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.490900 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:55.491099 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:55.490908 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb87g\" (UniqueName: \"kubernetes.io/projected/24e878ef-ba33-48f6-8c07-a9ddaea93bd9-kube-api-access-pb87g\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:56.083818 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.083723 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" event={"ID":"24e878ef-ba33-48f6-8c07-a9ddaea93bd9","Type":"ContainerDied","Data":"94f795fc1895b6c073d5973a378044c1a1311cd47d4ef24eb2cef384f20a482e"} Jun 02 01:49:56.083818 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.083752 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4" Jun 02 01:49:56.084320 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.083760 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94f795fc1895b6c073d5973a378044c1a1311cd47d4ef24eb2cef384f20a482e" Jun 02 01:49:56.085564 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.085540 2563 generic.go:358] "Generic (PLEG): container finished" podID="826e14c6-1373-4683-9562-d05a2e5a5929" containerID="f50ebbdd955f29c597cc70ad6b3a29fee2c6626986aaf5117913fc0e0885b30e" exitCode=0 Jun 02 01:49:56.085719 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.085598 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" event={"ID":"826e14c6-1373-4683-9562-d05a2e5a5929","Type":"ContainerDied","Data":"f50ebbdd955f29c597cc70ad6b3a29fee2c6626986aaf5117913fc0e0885b30e"} Jun 02 01:49:56.087275 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.087252 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" event={"ID":"190857db-50c0-4e9e-9e8e-3766f6df269d","Type":"ContainerDied","Data":"8e93570538eb025d634b3cc3d00c1fdafd52c1ffc5f07e5e02aa560b8d886674"} Jun 02 01:49:56.087365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.087280 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e93570538eb025d634b3cc3d00c1fdafd52c1ffc5f07e5e02aa560b8d886674" Jun 02 01:49:56.087365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.087292 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn" Jun 02 01:49:56.214996 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.214972 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:56.296977 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.296942 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px75s\" (UniqueName: \"kubernetes.io/projected/580c7420-2dfc-4e0f-8121-c8563e3c5c42-kube-api-access-px75s\") pod \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " Jun 02 01:49:56.296977 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.296983 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-util\") pod \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " Jun 02 01:49:56.297247 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.297024 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-bundle\") pod \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\" (UID: \"580c7420-2dfc-4e0f-8121-c8563e3c5c42\") " Jun 02 01:49:56.297513 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.297490 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-bundle" (OuterVolumeSpecName: "bundle") pod "580c7420-2dfc-4e0f-8121-c8563e3c5c42" (UID: "580c7420-2dfc-4e0f-8121-c8563e3c5c42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:56.299280 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.299255 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580c7420-2dfc-4e0f-8121-c8563e3c5c42-kube-api-access-px75s" (OuterVolumeSpecName: "kube-api-access-px75s") pod "580c7420-2dfc-4e0f-8121-c8563e3c5c42" (UID: "580c7420-2dfc-4e0f-8121-c8563e3c5c42"). InnerVolumeSpecName "kube-api-access-px75s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:49:56.302572 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.302550 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-util" (OuterVolumeSpecName: "util") pod "580c7420-2dfc-4e0f-8121-c8563e3c5c42" (UID: "580c7420-2dfc-4e0f-8121-c8563e3c5c42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:56.398534 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.398500 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px75s\" (UniqueName: \"kubernetes.io/projected/580c7420-2dfc-4e0f-8121-c8563e3c5c42-kube-api-access-px75s\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:56.398534 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.398533 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:56.398762 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:56.398547 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580c7420-2dfc-4e0f-8121-c8563e3c5c42-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:57.093295 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.093266 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" Jun 02 01:49:57.093295 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.093267 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w" event={"ID":"580c7420-2dfc-4e0f-8121-c8563e3c5c42","Type":"ContainerDied","Data":"e2228f975b1b328a581fc93d9359c95e9eafe1f884e452b3bd7e4d5dec562c6a"} Jun 02 01:49:57.093719 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.093310 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2228f975b1b328a581fc93d9359c95e9eafe1f884e452b3bd7e4d5dec562c6a" Jun 02 01:49:57.222832 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.222811 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:49:57.306575 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.306536 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-util\") pod \"826e14c6-1373-4683-9562-d05a2e5a5929\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " Jun 02 01:49:57.306756 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.306607 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62dsm\" (UniqueName: \"kubernetes.io/projected/826e14c6-1373-4683-9562-d05a2e5a5929-kube-api-access-62dsm\") pod \"826e14c6-1373-4683-9562-d05a2e5a5929\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " Jun 02 01:49:57.306756 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.306643 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-bundle\") pod \"826e14c6-1373-4683-9562-d05a2e5a5929\" (UID: \"826e14c6-1373-4683-9562-d05a2e5a5929\") " Jun 02 01:49:57.307227 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.307188 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-bundle" (OuterVolumeSpecName: "bundle") pod "826e14c6-1373-4683-9562-d05a2e5a5929" (UID: "826e14c6-1373-4683-9562-d05a2e5a5929"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:57.308804 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.308766 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/826e14c6-1373-4683-9562-d05a2e5a5929-kube-api-access-62dsm" (OuterVolumeSpecName: "kube-api-access-62dsm") pod "826e14c6-1373-4683-9562-d05a2e5a5929" (UID: "826e14c6-1373-4683-9562-d05a2e5a5929"). InnerVolumeSpecName "kube-api-access-62dsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:49:57.311901 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.311876 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-util" (OuterVolumeSpecName: "util") pod "826e14c6-1373-4683-9562-d05a2e5a5929" (UID: "826e14c6-1373-4683-9562-d05a2e5a5929"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:49:57.407467 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.407435 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:57.407467 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.407465 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62dsm\" (UniqueName: \"kubernetes.io/projected/826e14c6-1373-4683-9562-d05a2e5a5929-kube-api-access-62dsm\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:57.407467 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:57.407475 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/826e14c6-1373-4683-9562-d05a2e5a5929-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:49:58.098748 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:58.098719 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" event={"ID":"826e14c6-1373-4683-9562-d05a2e5a5929","Type":"ContainerDied","Data":"a354d19463df52e44d1691a5cf44ab6b888cb90f6337d9ace196642ed82a8bac"} Jun 02 01:49:58.098748 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:58.098748 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a354d19463df52e44d1691a5cf44ab6b888cb90f6337d9ace196642ed82a8bac" Jun 02 01:49:58.098748 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:49:58.098749 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j" Jun 02 01:50:13.660230 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660192 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d"] Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660540 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="util" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660550 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="util" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660558 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="extract" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660564 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="extract" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660570 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="extract" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660576 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="extract" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660584 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="util" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660588 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="util" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660593 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="util" Jun 02 01:50:13.660601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660598 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="util" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660608 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660613 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660620 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660625 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660632 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660636 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660650 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660655 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660661 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660666 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660672 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660677 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="pull" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660685 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="util" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660712 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="util" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660788 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="190857db-50c0-4e9e-9e8e-3766f6df269d" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660801 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="580c7420-2dfc-4e0f-8121-c8563e3c5c42" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660811 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="24e878ef-ba33-48f6-8c07-a9ddaea93bd9" containerName="extract" Jun 02 01:50:13.660928 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.660821 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="826e14c6-1373-4683-9562-d05a2e5a5929" containerName="extract" Jun 02 01:50:13.668079 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.668055 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:13.671707 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.671670 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:50:13.672174 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.672157 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 01:50:13.672338 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.672324 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fgl9n\"" Jun 02 01:50:13.676842 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.676818 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:50:13.679560 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.679533 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d"] Jun 02 01:50:13.751473 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.751436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9tjv\" (UniqueName: \"kubernetes.io/projected/a5e58c48-4083-414e-894b-70faf005feed-kube-api-access-r9tjv\") pod \"dns-operator-controller-manager-648d5c98bc-kvt6d\" (UID: \"a5e58c48-4083-414e-894b-70faf005feed\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:13.852322 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.852275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9tjv\" (UniqueName: \"kubernetes.io/projected/a5e58c48-4083-414e-894b-70faf005feed-kube-api-access-r9tjv\") pod \"dns-operator-controller-manager-648d5c98bc-kvt6d\" (UID: \"a5e58c48-4083-414e-894b-70faf005feed\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:13.866935 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.866902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9tjv\" (UniqueName: \"kubernetes.io/projected/a5e58c48-4083-414e-894b-70faf005feed-kube-api-access-r9tjv\") pod \"dns-operator-controller-manager-648d5c98bc-kvt6d\" (UID: \"a5e58c48-4083-414e-894b-70faf005feed\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:13.979814 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:13.979729 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:14.114746 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:14.114722 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d"] Jun 02 01:50:14.116796 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:50:14.116755 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e58c48_4083_414e_894b_70faf005feed.slice/crio-68a90bcac65ce8cf374a401e8f7ef772c1d1b519284bd01fd32081b931373bbe WatchSource:0}: Error finding container 68a90bcac65ce8cf374a401e8f7ef772c1d1b519284bd01fd32081b931373bbe: Status 404 returned error can't find the container with id 68a90bcac65ce8cf374a401e8f7ef772c1d1b519284bd01fd32081b931373bbe Jun 02 01:50:14.169207 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:14.169166 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" event={"ID":"a5e58c48-4083-414e-894b-70faf005feed","Type":"ContainerStarted","Data":"68a90bcac65ce8cf374a401e8f7ef772c1d1b519284bd01fd32081b931373bbe"} Jun 02 01:50:15.776101 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.776041 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z"] Jun 02 01:50:15.779683 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.779661 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:15.782579 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.782553 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wwhhf\"" Jun 02 01:50:15.792265 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.792235 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z"] Jun 02 01:50:15.874321 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.874290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmcp\" (UniqueName: \"kubernetes.io/projected/815e852d-a89b-41cf-a6f0-8bbeb9f562bf-kube-api-access-gtmcp\") pod \"limitador-operator-controller-manager-85c4996f8c-f777z\" (UID: \"815e852d-a89b-41cf-a6f0-8bbeb9f562bf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:15.975228 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.975192 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmcp\" (UniqueName: \"kubernetes.io/projected/815e852d-a89b-41cf-a6f0-8bbeb9f562bf-kube-api-access-gtmcp\") pod \"limitador-operator-controller-manager-85c4996f8c-f777z\" (UID: \"815e852d-a89b-41cf-a6f0-8bbeb9f562bf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:15.986752 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:15.986719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmcp\" (UniqueName: \"kubernetes.io/projected/815e852d-a89b-41cf-a6f0-8bbeb9f562bf-kube-api-access-gtmcp\") pod \"limitador-operator-controller-manager-85c4996f8c-f777z\" (UID: \"815e852d-a89b-41cf-a6f0-8bbeb9f562bf\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:16.095009 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:16.094911 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:16.375770 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:16.375745 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z"] Jun 02 01:50:16.377914 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:50:16.377888 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815e852d_a89b_41cf_a6f0_8bbeb9f562bf.slice/crio-5e0a990bac434a5f8f57c4f8bc2ea6f4addf0c10160cf959b83e7af4fc786ffb WatchSource:0}: Error finding container 5e0a990bac434a5f8f57c4f8bc2ea6f4addf0c10160cf959b83e7af4fc786ffb: Status 404 returned error can't find the container with id 5e0a990bac434a5f8f57c4f8bc2ea6f4addf0c10160cf959b83e7af4fc786ffb Jun 02 01:50:17.186912 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:17.186869 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" event={"ID":"a5e58c48-4083-414e-894b-70faf005feed","Type":"ContainerStarted","Data":"4913d1244fdbe4e41c801d7044c5968ebf10ec0ab16bd6357c54172723011687"} Jun 02 01:50:17.187323 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:17.186981 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:17.188234 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:17.188208 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" event={"ID":"815e852d-a89b-41cf-a6f0-8bbeb9f562bf","Type":"ContainerStarted","Data":"5e0a990bac434a5f8f57c4f8bc2ea6f4addf0c10160cf959b83e7af4fc786ffb"} Jun 02 01:50:17.221984 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:17.221902 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" podStartSLOduration=2.049355276 podStartE2EDuration="4.221878214s" podCreationTimestamp="2026-06-02 01:50:13 +0000 UTC" firstStartedPulling="2026-06-02 01:50:14.118726704 +0000 UTC m=+543.456408459" lastFinishedPulling="2026-06-02 01:50:16.291249623 +0000 UTC m=+545.628931397" observedRunningTime="2026-06-02 01:50:17.207343457 +0000 UTC m=+546.545025244" watchObservedRunningTime="2026-06-02 01:50:17.221878214 +0000 UTC m=+546.559559994" Jun 02 01:50:19.200618 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:19.200572 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" event={"ID":"815e852d-a89b-41cf-a6f0-8bbeb9f562bf","Type":"ContainerStarted","Data":"c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038"} Jun 02 01:50:19.201065 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:19.200663 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:19.219640 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:19.219582 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" podStartSLOduration=2.082166129 podStartE2EDuration="4.219567929s" podCreationTimestamp="2026-06-02 01:50:15 +0000 UTC" firstStartedPulling="2026-06-02 01:50:16.380168518 +0000 UTC m=+545.717850273" lastFinishedPulling="2026-06-02 01:50:18.517570305 +0000 UTC m=+547.855252073" observedRunningTime="2026-06-02 01:50:19.21666029 +0000 UTC m=+548.554342068" watchObservedRunningTime="2026-06-02 01:50:19.219567929 +0000 UTC m=+548.557249767" Jun 02 01:50:28.198629 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.198597 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kvt6d" Jun 02 01:50:28.679896 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.679854 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z"] Jun 02 01:50:28.680428 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.680175 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" containerName="manager" containerID="cri-o://c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038" gracePeriod=2 Jun 02 01:50:28.682069 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.682030 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:28.682645 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.682612 2563 status_manager.go:895] "Failed to get status for pod" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" err="pods \"limitador-operator-controller-manager-85c4996f8c-f777z\" is forbidden: User \"system:node:ip-10-0-136-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-21.ec2.internal' and this object" Jun 02 01:50:28.683572 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.683549 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z"] Jun 02 01:50:28.685823 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.685793 2563 status_manager.go:895] "Failed to get status for pod" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" err="pods \"limitador-operator-controller-manager-85c4996f8c-f777z\" is forbidden: User \"system:node:ip-10-0-136-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-21.ec2.internal' and this object" Jun 02 01:50:28.705909 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.705877 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc"] Jun 02 01:50:28.706323 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.706306 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" containerName="manager" Jun 02 01:50:28.706408 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.706326 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" containerName="manager" Jun 02 01:50:28.706461 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.706417 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" containerName="manager" Jun 02 01:50:28.709757 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.709735 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:28.724061 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.722647 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc"] Jun 02 01:50:28.733679 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.733640 2563 status_manager.go:895] "Failed to get status for pod" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" err="pods \"limitador-operator-controller-manager-85c4996f8c-f777z\" is forbidden: User \"system:node:ip-10-0-136-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-21.ec2.internal' and this object" Jun 02 01:50:28.891237 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.891203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zsv\" (UniqueName: \"kubernetes.io/projected/e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742-kube-api-access-v6zsv\") pod \"limitador-operator-controller-manager-85c4996f8c-dr4kc\" (UID: \"e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:28.919774 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.919753 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:28.922042 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.922017 2563 status_manager.go:895] "Failed to get status for pod" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" err="pods \"limitador-operator-controller-manager-85c4996f8c-f777z\" is forbidden: User \"system:node:ip-10-0-136-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-21.ec2.internal' and this object" Jun 02 01:50:28.992539 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:28.992459 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zsv\" (UniqueName: \"kubernetes.io/projected/e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742-kube-api-access-v6zsv\") pod \"limitador-operator-controller-manager-85c4996f8c-dr4kc\" (UID: \"e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:29.004531 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.004504 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zsv\" (UniqueName: \"kubernetes.io/projected/e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742-kube-api-access-v6zsv\") pod \"limitador-operator-controller-manager-85c4996f8c-dr4kc\" (UID: \"e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:29.060349 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.060314 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:29.093492 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.093458 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtmcp\" (UniqueName: \"kubernetes.io/projected/815e852d-a89b-41cf-a6f0-8bbeb9f562bf-kube-api-access-gtmcp\") pod \"815e852d-a89b-41cf-a6f0-8bbeb9f562bf\" (UID: \"815e852d-a89b-41cf-a6f0-8bbeb9f562bf\") " Jun 02 01:50:29.095547 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.095515 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/815e852d-a89b-41cf-a6f0-8bbeb9f562bf-kube-api-access-gtmcp" (OuterVolumeSpecName: "kube-api-access-gtmcp") pod "815e852d-a89b-41cf-a6f0-8bbeb9f562bf" (UID: "815e852d-a89b-41cf-a6f0-8bbeb9f562bf"). InnerVolumeSpecName "kube-api-access-gtmcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:50:29.194366 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.194328 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtmcp\" (UniqueName: \"kubernetes.io/projected/815e852d-a89b-41cf-a6f0-8bbeb9f562bf-kube-api-access-gtmcp\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:50:29.197313 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.197286 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc"] Jun 02 01:50:29.198574 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:50:29.198552 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fab3e6_243b_4d8e_ac4d_2ccf62b3d742.slice/crio-2ca29b41938ca80183ce3094ae74e412aeb2d9beaa19d9f813289e9072823699 WatchSource:0}: Error finding container 2ca29b41938ca80183ce3094ae74e412aeb2d9beaa19d9f813289e9072823699: Status 404 returned error can't find the container with id 2ca29b41938ca80183ce3094ae74e412aeb2d9beaa19d9f813289e9072823699 Jun 02 01:50:29.238135 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.238099 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" path="/var/lib/kubelet/pods/815e852d-a89b-41cf-a6f0-8bbeb9f562bf/volumes" Jun 02 01:50:29.240467 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.240443 2563 generic.go:358] "Generic (PLEG): container finished" podID="815e852d-a89b-41cf-a6f0-8bbeb9f562bf" containerID="c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038" exitCode=0 Jun 02 01:50:29.240596 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.240492 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f777z" Jun 02 01:50:29.240596 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.240512 2563 scope.go:117] "RemoveContainer" containerID="c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038" Jun 02 01:50:29.241921 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.241897 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" event={"ID":"e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742","Type":"ContainerStarted","Data":"2ca29b41938ca80183ce3094ae74e412aeb2d9beaa19d9f813289e9072823699"} Jun 02 01:50:29.250467 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.250447 2563 scope.go:117] "RemoveContainer" containerID="c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038" Jun 02 01:50:29.250739 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:50:29.250719 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038\": container with ID starting with c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038 not found: ID does not exist" containerID="c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038" Jun 02 01:50:29.250800 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:29.250748 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038"} err="failed to get container status \"c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038\": rpc error: code = NotFound desc = could not find container \"c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038\": container with ID starting with c5209c210383fdf8fd4c0d34186b88c8cf1a3d74a1372dbb38e06b71958c8038 not found: ID does not exist" Jun 02 01:50:30.248351 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:30.248310 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" event={"ID":"e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742","Type":"ContainerStarted","Data":"32ed4c961aa6df0cff0fc2af0e3aa825302260d3893e3eb9e2bd0934856e88bb"} Jun 02 01:50:30.248755 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:30.248425 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:30.272291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:30.272238 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" podStartSLOduration=2.272220151 podStartE2EDuration="2.272220151s" podCreationTimestamp="2026-06-02 01:50:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:30.269462044 +0000 UTC m=+559.607143822" watchObservedRunningTime="2026-06-02 01:50:30.272220151 +0000 UTC m=+559.609901928" Jun 02 01:50:34.373923 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.373870 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7d8dc5ff-gb689"] Jun 02 01:50:34.384042 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.384003 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.387464 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.387433 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7d8dc5ff-gb689"] Jun 02 01:50:34.435754 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-serving-cert\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.435913 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw4mw\" (UniqueName: \"kubernetes.io/projected/f9898d7d-cdca-42c1-9d46-89ffe24dc229-kube-api-access-vw4mw\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.435913 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-oauth-serving-cert\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.435913 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-config\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.436011 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-trusted-ca-bundle\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.436011 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-oauth-config\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.436011 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.435963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-service-ca\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537285 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537241 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vw4mw\" (UniqueName: \"kubernetes.io/projected/f9898d7d-cdca-42c1-9d46-89ffe24dc229-kube-api-access-vw4mw\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537285 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537289 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-oauth-serving-cert\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537491 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537380 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-config\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537491 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537416 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-trusted-ca-bundle\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537491 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537438 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-oauth-config\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537491 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-service-ca\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.537681 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.537542 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-serving-cert\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.538192 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.538161 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-oauth-serving-cert\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.538307 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.538272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-config\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.538376 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.538323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-trusted-ca-bundle\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.538376 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.538326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9898d7d-cdca-42c1-9d46-89ffe24dc229-service-ca\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.540000 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.539974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-serving-cert\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.540090 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.540008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9898d7d-cdca-42c1-9d46-89ffe24dc229-console-oauth-config\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.545174 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.545155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw4mw\" (UniqueName: \"kubernetes.io/projected/f9898d7d-cdca-42c1-9d46-89ffe24dc229-kube-api-access-vw4mw\") pod \"console-7c7d8dc5ff-gb689\" (UID: \"f9898d7d-cdca-42c1-9d46-89ffe24dc229\") " pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.697408 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.697370 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:34.835676 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:34.835648 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7d8dc5ff-gb689"] Jun 02 01:50:34.837638 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:50:34.837610 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9898d7d_cdca_42c1_9d46_89ffe24dc229.slice/crio-c0b3e9bc1e68bfbc5b891e41a10bc1767f4d277f8273b8b01e34601703a37968 WatchSource:0}: Error finding container c0b3e9bc1e68bfbc5b891e41a10bc1767f4d277f8273b8b01e34601703a37968: Status 404 returned error can't find the container with id c0b3e9bc1e68bfbc5b891e41a10bc1767f4d277f8273b8b01e34601703a37968 Jun 02 01:50:35.267908 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:35.267867 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7d8dc5ff-gb689" event={"ID":"f9898d7d-cdca-42c1-9d46-89ffe24dc229","Type":"ContainerStarted","Data":"1ec0228bcc340d38fa19ac9d22aee844b849d46a226960954544f7ae09da1d6a"} Jun 02 01:50:35.267908 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:35.267915 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7d8dc5ff-gb689" event={"ID":"f9898d7d-cdca-42c1-9d46-89ffe24dc229","Type":"ContainerStarted","Data":"c0b3e9bc1e68bfbc5b891e41a10bc1767f4d277f8273b8b01e34601703a37968"} Jun 02 01:50:35.288880 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:35.288835 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c7d8dc5ff-gb689" podStartSLOduration=1.288820382 podStartE2EDuration="1.288820382s" podCreationTimestamp="2026-06-02 01:50:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:35.287082166 +0000 UTC m=+564.624763946" watchObservedRunningTime="2026-06-02 01:50:35.288820382 +0000 UTC m=+564.626502159" Jun 02 01:50:41.254533 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:41.254504 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-dr4kc" Jun 02 01:50:44.698433 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:44.698391 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:44.698433 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:44.698437 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:44.703054 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:44.703030 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:45.310201 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:45.310173 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c7d8dc5ff-gb689" Jun 02 01:50:45.356262 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:50:45.356221 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8574dc99-5sntv"] Jun 02 01:51:02.773302 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.773254 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:02.777176 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.777157 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:02.779961 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.779938 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 01:51:02.780072 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.779997 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p7wkp\"" Jun 02 01:51:02.788254 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.788227 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:02.877346 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.877304 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:02.901369 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.901330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44bae0e6-2029-4853-8635-e99bf01470b2-config-file\") pod \"limitador-limitador-7d549b5b-rfmtv\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:02.901530 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:02.901452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbmz2\" (UniqueName: \"kubernetes.io/projected/44bae0e6-2029-4853-8635-e99bf01470b2-kube-api-access-dbmz2\") pod \"limitador-limitador-7d549b5b-rfmtv\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:03.002382 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.002345 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44bae0e6-2029-4853-8635-e99bf01470b2-config-file\") pod \"limitador-limitador-7d549b5b-rfmtv\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:03.002571 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.002431 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbmz2\" (UniqueName: \"kubernetes.io/projected/44bae0e6-2029-4853-8635-e99bf01470b2-kube-api-access-dbmz2\") pod \"limitador-limitador-7d549b5b-rfmtv\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:03.003017 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.002998 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44bae0e6-2029-4853-8635-e99bf01470b2-config-file\") pod \"limitador-limitador-7d549b5b-rfmtv\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:03.012812 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.012782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbmz2\" (UniqueName: \"kubernetes.io/projected/44bae0e6-2029-4853-8635-e99bf01470b2-kube-api-access-dbmz2\") pod \"limitador-limitador-7d549b5b-rfmtv\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:03.088914 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.088827 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:03.227589 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.227556 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:03.230276 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:51:03.230248 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bae0e6_2029_4853_8635_e99bf01470b2.slice/crio-ea44d175d41b0373bef381cf651e082af58229922c5995fc0a356b14d36e77d2 WatchSource:0}: Error finding container ea44d175d41b0373bef381cf651e082af58229922c5995fc0a356b14d36e77d2: Status 404 returned error can't find the container with id ea44d175d41b0373bef381cf651e082af58229922c5995fc0a356b14d36e77d2 Jun 02 01:51:03.377974 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:03.377881 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" event={"ID":"44bae0e6-2029-4853-8635-e99bf01470b2","Type":"ContainerStarted","Data":"ea44d175d41b0373bef381cf651e082af58229922c5995fc0a356b14d36e77d2"} Jun 02 01:51:06.393375 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:06.393338 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" event={"ID":"44bae0e6-2029-4853-8635-e99bf01470b2","Type":"ContainerStarted","Data":"52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d"} Jun 02 01:51:06.393794 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:06.393464 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:06.410405 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:06.410345 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" podStartSLOduration=1.81022596 podStartE2EDuration="4.410331381s" podCreationTimestamp="2026-06-02 01:51:02 +0000 UTC" firstStartedPulling="2026-06-02 01:51:03.232611588 +0000 UTC m=+592.570293354" lastFinishedPulling="2026-06-02 01:51:05.832717011 +0000 UTC m=+595.170398775" observedRunningTime="2026-06-02 01:51:06.407874927 +0000 UTC m=+595.745556704" watchObservedRunningTime="2026-06-02 01:51:06.410331381 +0000 UTC m=+595.748013192" Jun 02 01:51:10.382086 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.382049 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d8574dc99-5sntv" podUID="b1705197-9c72-431a-96e0-d0bc5bc0cf0f" containerName="console" containerID="cri-o://51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1" gracePeriod=15 Jun 02 01:51:10.631459 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.631430 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d8574dc99-5sntv_b1705197-9c72-431a-96e0-d0bc5bc0cf0f/console/0.log" Jun 02 01:51:10.631601 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.631500 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:51:10.772435 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772401 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-oauth-serving-cert\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.772670 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772481 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-config\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.772670 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772511 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-serving-cert\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.772670 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772549 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-service-ca\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.772670 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772578 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-oauth-config\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.772670 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772607 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qkks\" (UniqueName: \"kubernetes.io/projected/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-kube-api-access-7qkks\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.773002 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.772681 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-trusted-ca-bundle\") pod \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\" (UID: \"b1705197-9c72-431a-96e0-d0bc5bc0cf0f\") " Jun 02 01:51:10.773392 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.773338 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:51:10.773478 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.773422 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:51:10.773681 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.773654 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-config" (OuterVolumeSpecName: "console-config") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:51:10.773787 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.773682 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:51:10.775371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.775347 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:51:10.775371 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.775359 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-kube-api-access-7qkks" (OuterVolumeSpecName: "kube-api-access-7qkks") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "kube-api-access-7qkks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:51:10.775486 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.775365 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b1705197-9c72-431a-96e0-d0bc5bc0cf0f" (UID: "b1705197-9c72-431a-96e0-d0bc5bc0cf0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:51:10.873800 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873756 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-trusted-ca-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:10.873800 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873794 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-oauth-serving-cert\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:10.873800 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873805 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-config\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:10.874093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873814 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-serving-cert\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:10.874093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873824 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-service-ca\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:10.874093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873838 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-console-oauth-config\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:10.874093 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:10.873850 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qkks\" (UniqueName: \"kubernetes.io/projected/b1705197-9c72-431a-96e0-d0bc5bc0cf0f-kube-api-access-7qkks\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:11.138902 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.138880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d8574dc99-5sntv_b1705197-9c72-431a-96e0-d0bc5bc0cf0f/console/0.log" Jun 02 01:51:11.139078 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.138880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d8574dc99-5sntv_b1705197-9c72-431a-96e0-d0bc5bc0cf0f/console/0.log" Jun 02 01:51:11.146266 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.146234 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:51:11.146672 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.146652 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:51:11.416111 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.416021 2563 generic.go:358] "Generic (PLEG): container finished" podID="b1705197-9c72-431a-96e0-d0bc5bc0cf0f" containerID="51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1" exitCode=2 Jun 02 01:51:11.416508 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.416107 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8574dc99-5sntv" Jun 02 01:51:11.416508 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.416106 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8574dc99-5sntv" event={"ID":"b1705197-9c72-431a-96e0-d0bc5bc0cf0f","Type":"ContainerDied","Data":"51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1"} Jun 02 01:51:11.416508 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.416211 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8574dc99-5sntv" event={"ID":"b1705197-9c72-431a-96e0-d0bc5bc0cf0f","Type":"ContainerDied","Data":"3d57c17c2a3871011d24f7a892906d35ae3782c2628080bf422e269c7a56217a"} Jun 02 01:51:11.416508 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.416230 2563 scope.go:117] "RemoveContainer" containerID="51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1" Jun 02 01:51:11.424579 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.424562 2563 scope.go:117] "RemoveContainer" containerID="51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1" Jun 02 01:51:11.424856 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:51:11.424838 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1\": container with ID starting with 51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1 not found: ID does not exist" containerID="51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1" Jun 02 01:51:11.424899 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.424868 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1"} err="failed to get container status \"51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1\": rpc error: code = NotFound desc = could not find container \"51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1\": container with ID starting with 51b3838b57f231adfd7c1fe68b038b5612d9db70761153e6ba755d49e1f829e1 not found: ID does not exist" Jun 02 01:51:11.459306 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.459276 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8574dc99-5sntv"] Jun 02 01:51:11.461549 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:11.461528 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8574dc99-5sntv"] Jun 02 01:51:13.237375 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:13.237344 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1705197-9c72-431a-96e0-d0bc5bc0cf0f" path="/var/lib/kubelet/pods/b1705197-9c72-431a-96e0-d0bc5bc0cf0f/volumes" Jun 02 01:51:17.086175 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.086135 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:17.086664 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.086490 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" podUID="44bae0e6-2029-4853-8635-e99bf01470b2" containerName="limitador" containerID="cri-o://52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d" gracePeriod=30 Jun 02 01:51:17.087259 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.087163 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:17.652891 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.652832 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:17.733963 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.733935 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44bae0e6-2029-4853-8635-e99bf01470b2-config-file\") pod \"44bae0e6-2029-4853-8635-e99bf01470b2\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " Jun 02 01:51:17.734113 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.733980 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbmz2\" (UniqueName: \"kubernetes.io/projected/44bae0e6-2029-4853-8635-e99bf01470b2-kube-api-access-dbmz2\") pod \"44bae0e6-2029-4853-8635-e99bf01470b2\" (UID: \"44bae0e6-2029-4853-8635-e99bf01470b2\") " Jun 02 01:51:17.734366 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.734339 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44bae0e6-2029-4853-8635-e99bf01470b2-config-file" (OuterVolumeSpecName: "config-file") pod "44bae0e6-2029-4853-8635-e99bf01470b2" (UID: "44bae0e6-2029-4853-8635-e99bf01470b2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:51:17.736089 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.736072 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44bae0e6-2029-4853-8635-e99bf01470b2-kube-api-access-dbmz2" (OuterVolumeSpecName: "kube-api-access-dbmz2") pod "44bae0e6-2029-4853-8635-e99bf01470b2" (UID: "44bae0e6-2029-4853-8635-e99bf01470b2"). InnerVolumeSpecName "kube-api-access-dbmz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:51:17.834753 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.834685 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbmz2\" (UniqueName: \"kubernetes.io/projected/44bae0e6-2029-4853-8635-e99bf01470b2-kube-api-access-dbmz2\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:17.834753 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:17.834749 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44bae0e6-2029-4853-8635-e99bf01470b2-config-file\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:18.446813 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.446777 2563 generic.go:358] "Generic (PLEG): container finished" podID="44bae0e6-2029-4853-8635-e99bf01470b2" containerID="52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d" exitCode=0 Jun 02 01:51:18.447324 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.446829 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" event={"ID":"44bae0e6-2029-4853-8635-e99bf01470b2","Type":"ContainerDied","Data":"52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d"} Jun 02 01:51:18.447324 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.446853 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" event={"ID":"44bae0e6-2029-4853-8635-e99bf01470b2","Type":"ContainerDied","Data":"ea44d175d41b0373bef381cf651e082af58229922c5995fc0a356b14d36e77d2"} Jun 02 01:51:18.447324 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.446865 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rfmtv" Jun 02 01:51:18.447324 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.446879 2563 scope.go:117] "RemoveContainer" containerID="52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d" Jun 02 01:51:18.455571 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.455553 2563 scope.go:117] "RemoveContainer" containerID="52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d" Jun 02 01:51:18.455860 ip-10-0-136-21 kubenswrapper[2563]: E0602 01:51:18.455842 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d\": container with ID starting with 52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d not found: ID does not exist" containerID="52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d" Jun 02 01:51:18.455929 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.455870 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d"} err="failed to get container status \"52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d\": rpc error: code = NotFound desc = could not find container \"52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d\": container with ID starting with 52040f78a4e956a17e72dab5287e8f2b2ee9a94db979ac2538027ad8e7f8808d not found: ID does not exist" Jun 02 01:51:18.469445 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.469411 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:18.473533 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.473504 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rfmtv"] Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.767726 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-bv2d7"] Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.768576 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44bae0e6-2029-4853-8635-e99bf01470b2" containerName="limitador" Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.768594 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="44bae0e6-2029-4853-8635-e99bf01470b2" containerName="limitador" Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.768623 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1705197-9c72-431a-96e0-d0bc5bc0cf0f" containerName="console" Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.768631 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1705197-9c72-431a-96e0-d0bc5bc0cf0f" containerName="console" Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.768820 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="44bae0e6-2029-4853-8635-e99bf01470b2" containerName="limitador" Jun 02 01:51:18.770544 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.768833 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1705197-9c72-431a-96e0-d0bc5bc0cf0f" containerName="console" Jun 02 01:51:18.774723 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.774665 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:18.778227 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.778196 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 01:51:18.778517 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.778491 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-bv2d7"] Jun 02 01:51:18.843154 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.843118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7h7f\" (UniqueName: \"kubernetes.io/projected/d82df115-927c-41d6-acd6-a41237f93c64-kube-api-access-h7h7f\") pod \"postgres-68c4fbbd6f-bv2d7\" (UID: \"d82df115-927c-41d6-acd6-a41237f93c64\") " pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:18.843329 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.843191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d82df115-927c-41d6-acd6-a41237f93c64-data\") pod \"postgres-68c4fbbd6f-bv2d7\" (UID: \"d82df115-927c-41d6-acd6-a41237f93c64\") " pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:18.944025 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.943990 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d82df115-927c-41d6-acd6-a41237f93c64-data\") pod \"postgres-68c4fbbd6f-bv2d7\" (UID: \"d82df115-927c-41d6-acd6-a41237f93c64\") " pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:18.944172 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.944051 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7h7f\" (UniqueName: \"kubernetes.io/projected/d82df115-927c-41d6-acd6-a41237f93c64-kube-api-access-h7h7f\") pod \"postgres-68c4fbbd6f-bv2d7\" (UID: \"d82df115-927c-41d6-acd6-a41237f93c64\") " pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:18.944387 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.944366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d82df115-927c-41d6-acd6-a41237f93c64-data\") pod \"postgres-68c4fbbd6f-bv2d7\" (UID: \"d82df115-927c-41d6-acd6-a41237f93c64\") " pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:18.952428 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:18.952397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7h7f\" (UniqueName: \"kubernetes.io/projected/d82df115-927c-41d6-acd6-a41237f93c64-kube-api-access-h7h7f\") pod \"postgres-68c4fbbd6f-bv2d7\" (UID: \"d82df115-927c-41d6-acd6-a41237f93c64\") " pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:19.088029 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:19.087939 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:19.220413 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:19.220386 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-bv2d7"] Jun 02 01:51:19.221572 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:51:19.221546 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82df115_927c_41d6_acd6_a41237f93c64.slice/crio-a823ba8dde5b42a583a7f01dbf244d617b22dacf149845352d4c2aaf012df31c WatchSource:0}: Error finding container a823ba8dde5b42a583a7f01dbf244d617b22dacf149845352d4c2aaf012df31c: Status 404 returned error can't find the container with id a823ba8dde5b42a583a7f01dbf244d617b22dacf149845352d4c2aaf012df31c Jun 02 01:51:19.238028 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:19.238003 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44bae0e6-2029-4853-8635-e99bf01470b2" path="/var/lib/kubelet/pods/44bae0e6-2029-4853-8635-e99bf01470b2/volumes" Jun 02 01:51:19.452751 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:19.452713 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" event={"ID":"d82df115-927c-41d6-acd6-a41237f93c64","Type":"ContainerStarted","Data":"a823ba8dde5b42a583a7f01dbf244d617b22dacf149845352d4c2aaf012df31c"} Jun 02 01:51:22.467461 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:22.467420 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" event={"ID":"d82df115-927c-41d6-acd6-a41237f93c64","Type":"ContainerStarted","Data":"8e082819336c9b406027bf823bd17c494cf1bf7c190c3a6047fff051648b812f"} Jun 02 01:51:22.467945 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:22.467516 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:22.482167 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:22.482112 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" podStartSLOduration=2.143614354 podStartE2EDuration="4.482082957s" podCreationTimestamp="2026-06-02 01:51:18 +0000 UTC" firstStartedPulling="2026-06-02 01:51:19.222929923 +0000 UTC m=+608.560611678" lastFinishedPulling="2026-06-02 01:51:21.561398511 +0000 UTC m=+610.899080281" observedRunningTime="2026-06-02 01:51:22.481425696 +0000 UTC m=+611.819107476" watchObservedRunningTime="2026-06-02 01:51:22.482082957 +0000 UTC m=+611.819764735" Jun 02 01:51:28.501281 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:28.501207 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-bv2d7" Jun 02 01:51:29.855792 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.855760 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr"] Jun 02 01:51:29.862555 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.862535 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:29.869780 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.869747 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:51:29.870743 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.870717 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:51:29.871063 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.870795 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hq84\"" Jun 02 01:51:29.872830 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.872809 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr"] Jun 02 01:51:29.951852 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.951813 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:29.952024 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.951858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:29.952024 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:29.951984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw6qr\" (UniqueName: \"kubernetes.io/projected/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-kube-api-access-gw6qr\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.052466 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.052424 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gw6qr\" (UniqueName: \"kubernetes.io/projected/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-kube-api-access-gw6qr\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.052668 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.052497 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.052668 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.052530 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.052940 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.052917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.053023 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.053002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.061736 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.061684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw6qr\" (UniqueName: \"kubernetes.io/projected/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-kube-api-access-gw6qr\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.178971 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.178938 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:30.315515 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.315487 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr"] Jun 02 01:51:30.317159 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:51:30.317118 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8827d5_851e_48b3_8b5f_aa4ac4b27d6e.slice/crio-153bbfe4644b0deb6aeb1ae1cb5d3797e72be2927ad18dbc99b7f4142ffec066 WatchSource:0}: Error finding container 153bbfe4644b0deb6aeb1ae1cb5d3797e72be2927ad18dbc99b7f4142ffec066: Status 404 returned error can't find the container with id 153bbfe4644b0deb6aeb1ae1cb5d3797e72be2927ad18dbc99b7f4142ffec066 Jun 02 01:51:30.499861 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.499769 2563 generic.go:358] "Generic (PLEG): container finished" podID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerID="2925d81b4dcec4dd565029a6733f6e20a423df21a69cbd56c5f4debcbf63eede" exitCode=0 Jun 02 01:51:30.499861 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.499813 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" event={"ID":"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e","Type":"ContainerDied","Data":"2925d81b4dcec4dd565029a6733f6e20a423df21a69cbd56c5f4debcbf63eede"} Jun 02 01:51:30.499861 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:30.499844 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" event={"ID":"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e","Type":"ContainerStarted","Data":"153bbfe4644b0deb6aeb1ae1cb5d3797e72be2927ad18dbc99b7f4142ffec066"} Jun 02 01:51:31.505309 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:31.505266 2563 generic.go:358] "Generic (PLEG): container finished" podID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerID="a20d030d48caa86da5d56137fcea37463f389e9c081bf00ebb4cf9e084c93389" exitCode=0 Jun 02 01:51:31.505726 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:31.505344 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" event={"ID":"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e","Type":"ContainerDied","Data":"a20d030d48caa86da5d56137fcea37463f389e9c081bf00ebb4cf9e084c93389"} Jun 02 01:51:32.512291 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:32.512260 2563 generic.go:358] "Generic (PLEG): container finished" podID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerID="61eb6ed8a44128ab9ef27880bbf06a35c5314e9a1c07be6e8eb7b08858195530" exitCode=0 Jun 02 01:51:32.512675 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:32.512353 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" event={"ID":"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e","Type":"ContainerDied","Data":"61eb6ed8a44128ab9ef27880bbf06a35c5314e9a1c07be6e8eb7b08858195530"} Jun 02 01:51:33.673556 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.673531 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:33.783878 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.783800 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-bundle\") pod \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " Jun 02 01:51:33.783878 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.783839 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-util\") pod \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " Jun 02 01:51:33.784058 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.783932 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw6qr\" (UniqueName: \"kubernetes.io/projected/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-kube-api-access-gw6qr\") pod \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\" (UID: \"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e\") " Jun 02 01:51:33.784368 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.784336 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-bundle" (OuterVolumeSpecName: "bundle") pod "4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" (UID: "4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:51:33.786085 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.786058 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-kube-api-access-gw6qr" (OuterVolumeSpecName: "kube-api-access-gw6qr") pod "4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" (UID: "4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e"). InnerVolumeSpecName "kube-api-access-gw6qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:51:33.789414 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.789391 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-util" (OuterVolumeSpecName: "util") pod "4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" (UID: "4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:51:33.885079 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.885044 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw6qr\" (UniqueName: \"kubernetes.io/projected/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-kube-api-access-gw6qr\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:33.885079 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.885073 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-bundle\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:33.885079 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:33.885085 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e-util\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 01:51:34.521549 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:34.521521 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" Jun 02 01:51:34.521736 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:34.521524 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b6tzr" event={"ID":"4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e","Type":"ContainerDied","Data":"153bbfe4644b0deb6aeb1ae1cb5d3797e72be2927ad18dbc99b7f4142ffec066"} Jun 02 01:51:34.521736 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:34.521628 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="153bbfe4644b0deb6aeb1ae1cb5d3797e72be2927ad18dbc99b7f4142ffec066" Jun 02 01:51:37.220880 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.220845 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-2bpsl"] Jun 02 01:51:37.221262 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221235 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="extract" Jun 02 01:51:37.221262 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221247 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="extract" Jun 02 01:51:37.221365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221267 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="pull" Jun 02 01:51:37.221365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221273 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="pull" Jun 02 01:51:37.221365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221282 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="util" Jun 02 01:51:37.221365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221287 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="util" Jun 02 01:51:37.221365 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.221364 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a8827d5-851e-48b3-8b5f-aa4ac4b27d6e" containerName="extract" Jun 02 01:51:37.230060 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.230032 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" Jun 02 01:51:37.233006 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.232978 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:51:37.233372 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.233008 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-2gdr8\"" Jun 02 01:51:37.233517 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.233128 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:51:37.239856 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.239340 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-2bpsl"] Jun 02 01:51:37.315201 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.315163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpqx\" (UniqueName: \"kubernetes.io/projected/7af22f76-6a20-4ad9-b45f-9fcb1e3af18d-kube-api-access-sxpqx\") pod \"keycloak-operator-7864d68cbd-2bpsl\" (UID: \"7af22f76-6a20-4ad9-b45f-9fcb1e3af18d\") " pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" Jun 02 01:51:37.416551 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.416512 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpqx\" (UniqueName: \"kubernetes.io/projected/7af22f76-6a20-4ad9-b45f-9fcb1e3af18d-kube-api-access-sxpqx\") pod \"keycloak-operator-7864d68cbd-2bpsl\" (UID: \"7af22f76-6a20-4ad9-b45f-9fcb1e3af18d\") " pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" Jun 02 01:51:37.425750 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.425721 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpqx\" (UniqueName: \"kubernetes.io/projected/7af22f76-6a20-4ad9-b45f-9fcb1e3af18d-kube-api-access-sxpqx\") pod \"keycloak-operator-7864d68cbd-2bpsl\" (UID: \"7af22f76-6a20-4ad9-b45f-9fcb1e3af18d\") " pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" Jun 02 01:51:37.543872 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.543780 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" Jun 02 01:51:37.674576 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:37.674553 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-2bpsl"] Jun 02 01:51:37.676649 ip-10-0-136-21 kubenswrapper[2563]: W0602 01:51:37.676621 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af22f76_6a20_4ad9_b45f_9fcb1e3af18d.slice/crio-6a7d84a9e6b149b66e111b35711d0105cc40c2d1bb39e792b77b6606baf753e5 WatchSource:0}: Error finding container 6a7d84a9e6b149b66e111b35711d0105cc40c2d1bb39e792b77b6606baf753e5: Status 404 returned error can't find the container with id 6a7d84a9e6b149b66e111b35711d0105cc40c2d1bb39e792b77b6606baf753e5 Jun 02 01:51:38.546018 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:38.545970 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" event={"ID":"7af22f76-6a20-4ad9-b45f-9fcb1e3af18d","Type":"ContainerStarted","Data":"6a7d84a9e6b149b66e111b35711d0105cc40c2d1bb39e792b77b6606baf753e5"} Jun 02 01:51:43.569358 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:43.569262 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" event={"ID":"7af22f76-6a20-4ad9-b45f-9fcb1e3af18d","Type":"ContainerStarted","Data":"aa07ffd20c0bdd132c6a00aee9aab2723225b070d86e82a43b87907a2856c31d"} Jun 02 01:51:43.586249 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:51:43.586198 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-2bpsl" podStartSLOduration=0.962100867 podStartE2EDuration="6.586182061s" podCreationTimestamp="2026-06-02 01:51:37 +0000 UTC" firstStartedPulling="2026-06-02 01:51:37.678036611 +0000 UTC m=+627.015718365" lastFinishedPulling="2026-06-02 01:51:43.302117799 +0000 UTC m=+632.639799559" observedRunningTime="2026-06-02 01:51:43.584218986 +0000 UTC m=+632.921900762" watchObservedRunningTime="2026-06-02 01:51:43.586182061 +0000 UTC m=+632.923863837" Jun 02 01:56:11.181277 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:56:11.181187 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 01:56:11.183477 ip-10-0-136-21 kubenswrapper[2563]: I0602 01:56:11.183452 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 02:00:00.150398 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.150359 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29672760-xkcq9"] Jun 02 02:00:00.153769 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.153751 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:00.156499 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.156479 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-85n2b\"" Jun 02 02:00:00.169167 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.169137 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29672760-xkcq9"] Jun 02 02:00:00.298543 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.298507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf5lh\" (UniqueName: \"kubernetes.io/projected/9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6-kube-api-access-cf5lh\") pod \"maas-api-key-cleanup-29672760-xkcq9\" (UID: \"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6\") " pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:00.399357 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.399318 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf5lh\" (UniqueName: \"kubernetes.io/projected/9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6-kube-api-access-cf5lh\") pod \"maas-api-key-cleanup-29672760-xkcq9\" (UID: \"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6\") " pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:00.407892 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.407822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf5lh\" (UniqueName: \"kubernetes.io/projected/9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6-kube-api-access-cf5lh\") pod \"maas-api-key-cleanup-29672760-xkcq9\" (UID: \"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6\") " pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:00.464551 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.464509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:00.600615 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.600588 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29672760-xkcq9"] Jun 02 02:00:00.601913 ip-10-0-136-21 kubenswrapper[2563]: W0602 02:00:00.601881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f56438a_2e63_4ef9_832e_ff9ac1a7cfd6.slice/crio-53a63b71273be3ffde3d71e0b586a8cde40058a6089fb74451de262aa976520d WatchSource:0}: Error finding container 53a63b71273be3ffde3d71e0b586a8cde40058a6089fb74451de262aa976520d: Status 404 returned error can't find the container with id 53a63b71273be3ffde3d71e0b586a8cde40058a6089fb74451de262aa976520d Jun 02 02:00:00.603463 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:00.603448 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:00:01.605644 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:01.605607 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" event={"ID":"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6","Type":"ContainerStarted","Data":"53a63b71273be3ffde3d71e0b586a8cde40058a6089fb74451de262aa976520d"} Jun 02 02:00:29.718322 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:29.718281 2563 generic.go:358] "Generic (PLEG): container finished" podID="9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6" containerID="528f2bd39f20cef9966366a700c5ff7f3737474e22af958b5550abae0074c585" exitCode=0 Jun 02 02:00:29.718784 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:29.718366 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" event={"ID":"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6","Type":"ContainerDied","Data":"528f2bd39f20cef9966366a700c5ff7f3737474e22af958b5550abae0074c585"} Jun 02 02:00:30.852944 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:30.852918 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:30.968095 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:30.968061 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf5lh\" (UniqueName: \"kubernetes.io/projected/9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6-kube-api-access-cf5lh\") pod \"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6\" (UID: \"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6\") " Jun 02 02:00:30.970245 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:30.970211 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6-kube-api-access-cf5lh" (OuterVolumeSpecName: "kube-api-access-cf5lh") pod "9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6" (UID: "9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6"). InnerVolumeSpecName "kube-api-access-cf5lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:31.069348 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:31.069312 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf5lh\" (UniqueName: \"kubernetes.io/projected/9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6-kube-api-access-cf5lh\") on node \"ip-10-0-136-21.ec2.internal\" DevicePath \"\"" Jun 02 02:00:31.727004 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:31.726964 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" event={"ID":"9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6","Type":"ContainerDied","Data":"53a63b71273be3ffde3d71e0b586a8cde40058a6089fb74451de262aa976520d"} Jun 02 02:00:31.727004 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:31.726999 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53a63b71273be3ffde3d71e0b586a8cde40058a6089fb74451de262aa976520d" Jun 02 02:00:31.727004 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:31.727000 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672760-xkcq9" Jun 02 02:00:36.391057 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:36.391020 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f9c748996-4dt8t_b7158ecb-4032-46ba-9bc6-3426191cd499/nginx/0.log" Jun 02 02:00:36.624836 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:36.624795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-hb9m6_0092768e-0199-40c5-9979-3ffa5dd1ad66/manager/0.log" Jun 02 02:00:36.737144 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:36.737064 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-nll7c_ce65db09-7d6a-4835-8ad6-96aa31592f82/manager/0.log" Jun 02 02:00:36.947279 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:36.947249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29672760-xkcq9_9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6/cleanup/0.log" Jun 02 02:00:37.161722 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:37.161663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-fhbsl_3c05f581-0061-49bd-a93f-99afb5a6976d/server/0.log" Jun 02 02:00:37.648354 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:37.648330 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-jglsf_04627260-935c-44db-8ba6-3b063120d637/copy-manifests/0.log" Jun 02 02:00:37.655236 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:37.655208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-jglsf_04627260-935c-44db-8ba6-3b063120d637/manager/0.log" Jun 02 02:00:37.760210 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:37.760179 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-bv2d7_d82df115-927c-41d6-acd6-a41237f93c64/postgres/0.log" Jun 02 02:00:38.510091 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.510058 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w_580c7420-2dfc-4e0f-8121-c8563e3c5c42/util/0.log" Jun 02 02:00:38.517125 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.517100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w_580c7420-2dfc-4e0f-8121-c8563e3c5c42/pull/0.log" Jun 02 02:00:38.526306 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.526285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w_580c7420-2dfc-4e0f-8121-c8563e3c5c42/extract/0.log" Jun 02 02:00:38.638142 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.638117 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4_24e878ef-ba33-48f6-8c07-a9ddaea93bd9/util/0.log" Jun 02 02:00:38.644587 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.644568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4_24e878ef-ba33-48f6-8c07-a9ddaea93bd9/pull/0.log" Jun 02 02:00:38.650474 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.650456 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4_24e878ef-ba33-48f6-8c07-a9ddaea93bd9/extract/0.log" Jun 02 02:00:38.758811 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.758786 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn_190857db-50c0-4e9e-9e8e-3766f6df269d/util/0.log" Jun 02 02:00:38.765495 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.765437 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn_190857db-50c0-4e9e-9e8e-3766f6df269d/pull/0.log" Jun 02 02:00:38.771462 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.771433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn_190857db-50c0-4e9e-9e8e-3766f6df269d/extract/0.log" Jun 02 02:00:38.875445 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.875419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j_826e14c6-1373-4683-9562-d05a2e5a5929/pull/0.log" Jun 02 02:00:38.881349 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.881326 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j_826e14c6-1373-4683-9562-d05a2e5a5929/extract/0.log" Jun 02 02:00:38.887471 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:38.887453 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j_826e14c6-1373-4683-9562-d05a2e5a5929/util/0.log" Jun 02 02:00:39.232960 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:39.232918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-kvt6d_a5e58c48-4083-414e-894b-70faf005feed/manager/0.log" Jun 02 02:00:39.794224 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:39.794192 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-dr4kc_e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742/manager/0.log" Jun 02 02:00:40.247019 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:40.246987 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-m24jg_9e6fb310-c429-4d0e-b285-a020f2bcf980/discovery/0.log" Jun 02 02:00:40.354995 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:40.354966 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f795fc994-6h9fx_bb05e835-b158-4efb-8a37-855e9fb55e74/kube-auth-proxy/0.log" Jun 02 02:00:40.929703 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:40.929665 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9444674f7-4r8rm_f9645f7f-2922-45cd-ad7a-1a82e58b8de0/router/0.log" Jun 02 02:00:45.877447 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.877410 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7ftlk/must-gather-q5gx8"] Jun 02 02:00:45.878011 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.877991 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6" containerName="cleanup" Jun 02 02:00:45.878092 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.878014 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6" containerName="cleanup" Jun 02 02:00:45.878153 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.878142 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6" containerName="cleanup" Jun 02 02:00:45.882348 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.882328 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:45.887114 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.887093 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7ftlk\"/\"kube-root-ca.crt\"" Jun 02 02:00:45.888011 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.887984 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7ftlk\"/\"openshift-service-ca.crt\"" Jun 02 02:00:45.888427 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.888410 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7ftlk\"/\"default-dockercfg-gns69\"" Jun 02 02:00:45.896102 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:45.896068 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ftlk/must-gather-q5gx8"] Jun 02 02:00:46.001912 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.001872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce0ea902-910a-4fb0-a8f1-0138c4c83c63-must-gather-output\") pod \"must-gather-q5gx8\" (UID: \"ce0ea902-910a-4fb0-a8f1-0138c4c83c63\") " pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.002080 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.001915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjnl\" (UniqueName: \"kubernetes.io/projected/ce0ea902-910a-4fb0-a8f1-0138c4c83c63-kube-api-access-zmjnl\") pod \"must-gather-q5gx8\" (UID: \"ce0ea902-910a-4fb0-a8f1-0138c4c83c63\") " pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.102752 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.102709 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce0ea902-910a-4fb0-a8f1-0138c4c83c63-must-gather-output\") pod \"must-gather-q5gx8\" (UID: \"ce0ea902-910a-4fb0-a8f1-0138c4c83c63\") " pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.102931 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.102825 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjnl\" (UniqueName: \"kubernetes.io/projected/ce0ea902-910a-4fb0-a8f1-0138c4c83c63-kube-api-access-zmjnl\") pod \"must-gather-q5gx8\" (UID: \"ce0ea902-910a-4fb0-a8f1-0138c4c83c63\") " pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.103056 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.103032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce0ea902-910a-4fb0-a8f1-0138c4c83c63-must-gather-output\") pod \"must-gather-q5gx8\" (UID: \"ce0ea902-910a-4fb0-a8f1-0138c4c83c63\") " pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.126310 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.126278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjnl\" (UniqueName: \"kubernetes.io/projected/ce0ea902-910a-4fb0-a8f1-0138c4c83c63-kube-api-access-zmjnl\") pod \"must-gather-q5gx8\" (UID: \"ce0ea902-910a-4fb0-a8f1-0138c4c83c63\") " pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.192382 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.192342 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ftlk/must-gather-q5gx8" Jun 02 02:00:46.345615 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.345581 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ftlk/must-gather-q5gx8"] Jun 02 02:00:46.347554 ip-10-0-136-21 kubenswrapper[2563]: W0602 02:00:46.347514 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce0ea902_910a_4fb0_a8f1_0138c4c83c63.slice/crio-72a5a02a19a78e58822d18418addc0f73fb0fe2296568e74aba32a815f54fa17 WatchSource:0}: Error finding container 72a5a02a19a78e58822d18418addc0f73fb0fe2296568e74aba32a815f54fa17: Status 404 returned error can't find the container with id 72a5a02a19a78e58822d18418addc0f73fb0fe2296568e74aba32a815f54fa17 Jun 02 02:00:46.795006 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:46.794970 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/must-gather-q5gx8" event={"ID":"ce0ea902-910a-4fb0-a8f1-0138c4c83c63","Type":"ContainerStarted","Data":"72a5a02a19a78e58822d18418addc0f73fb0fe2296568e74aba32a815f54fa17"} Jun 02 02:00:47.802654 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:47.802600 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/must-gather-q5gx8" event={"ID":"ce0ea902-910a-4fb0-a8f1-0138c4c83c63","Type":"ContainerStarted","Data":"647ad22cfcd2bab0252856534eaf3bbb2cca3971b22c3f31336d9bf5a8e8fd50"} Jun 02 02:00:47.802654 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:47.802660 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/must-gather-q5gx8" event={"ID":"ce0ea902-910a-4fb0-a8f1-0138c4c83c63","Type":"ContainerStarted","Data":"02be54b55978047e989b104abc05fe23ff24826f52ebf9462d54d50932604ae9"} Jun 02 02:00:47.826750 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:47.826677 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7ftlk/must-gather-q5gx8" podStartSLOduration=1.870382582 podStartE2EDuration="2.826660731s" podCreationTimestamp="2026-06-02 02:00:45 +0000 UTC" firstStartedPulling="2026-06-02 02:00:46.349406122 +0000 UTC m=+1175.687087894" lastFinishedPulling="2026-06-02 02:00:47.305684288 +0000 UTC m=+1176.643366043" observedRunningTime="2026-06-02 02:00:47.823002655 +0000 UTC m=+1177.160684432" watchObservedRunningTime="2026-06-02 02:00:47.826660731 +0000 UTC m=+1177.164342507" Jun 02 02:00:49.288882 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:49.288855 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s22s5_ef2189f3-a073-4b40-a460-31b5a3dfa4a0/global-pull-secret-syncer/0.log" Jun 02 02:00:49.349960 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:49.349927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7lw8m_9bff18d3-6203-492f-80f3-64b9af1944dc/konnectivity-agent/0.log" Jun 02 02:00:49.534545 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:49.534503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-21.ec2.internal_60c1d0764ab816f2414eebb439f0782a/haproxy/0.log" Jun 02 02:00:53.596787 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.596751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w_580c7420-2dfc-4e0f-8121-c8563e3c5c42/extract/0.log" Jun 02 02:00:53.624188 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.624156 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w_580c7420-2dfc-4e0f-8121-c8563e3c5c42/util/0.log" Jun 02 02:00:53.658862 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.658832 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdc4w_580c7420-2dfc-4e0f-8121-c8563e3c5c42/pull/0.log" Jun 02 02:00:53.698769 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.698672 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4_24e878ef-ba33-48f6-8c07-a9ddaea93bd9/extract/0.log" Jun 02 02:00:53.725842 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.725806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4_24e878ef-ba33-48f6-8c07-a9ddaea93bd9/util/0.log" Jun 02 02:00:53.754666 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.754639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0stcm4_24e878ef-ba33-48f6-8c07-a9ddaea93bd9/pull/0.log" Jun 02 02:00:53.789659 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.789586 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn_190857db-50c0-4e9e-9e8e-3766f6df269d/extract/0.log" Jun 02 02:00:53.814144 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.814111 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn_190857db-50c0-4e9e-9e8e-3766f6df269d/util/0.log" Jun 02 02:00:53.843138 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.843104 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lrlbn_190857db-50c0-4e9e-9e8e-3766f6df269d/pull/0.log" Jun 02 02:00:53.885084 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.885044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j_826e14c6-1373-4683-9562-d05a2e5a5929/extract/0.log" Jun 02 02:00:53.929836 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.929809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j_826e14c6-1373-4683-9562-d05a2e5a5929/util/0.log" Jun 02 02:00:53.965920 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:53.965868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1s9n9j_826e14c6-1373-4683-9562-d05a2e5a5929/pull/0.log" Jun 02 02:00:54.075646 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:54.075620 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-kvt6d_a5e58c48-4083-414e-894b-70faf005feed/manager/0.log" Jun 02 02:00:54.246914 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:54.246838 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-dr4kc_e8fab3e6-243b-4d8e-ac4d-2ccf62b3d742/manager/0.log" Jun 02 02:00:56.051190 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.051154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-qhbcj_31f15f8f-cced-4706-a903-5db568e914b5/kube-state-metrics/0.log" Jun 02 02:00:56.087209 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.087183 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-qhbcj_31f15f8f-cced-4706-a903-5db568e914b5/kube-rbac-proxy-main/0.log" Jun 02 02:00:56.121337 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.121302 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-qhbcj_31f15f8f-cced-4706-a903-5db568e914b5/kube-rbac-proxy-self/0.log" Jun 02 02:00:56.496374 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.496348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6n8bz_d65036a8-cf7f-40d0-9440-a608a3636cf7/node-exporter/0.log" Jun 02 02:00:56.549899 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.549871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6n8bz_d65036a8-cf7f-40d0-9440-a608a3636cf7/kube-rbac-proxy/0.log" Jun 02 02:00:56.587471 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.587442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6n8bz_d65036a8-cf7f-40d0-9440-a608a3636cf7/init-textfile/0.log" Jun 02 02:00:56.628431 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.628398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-vf8hq_1d694045-32e6-4a83-8afd-176be335965b/kube-rbac-proxy-main/0.log" Jun 02 02:00:56.664124 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.664086 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-vf8hq_1d694045-32e6-4a83-8afd-176be335965b/kube-rbac-proxy-self/0.log" Jun 02 02:00:56.696630 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:56.696602 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-vf8hq_1d694045-32e6-4a83-8afd-176be335965b/openshift-state-metrics/0.log" Jun 02 02:00:57.105496 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:57.105470 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd5d9c769-gl9gh_a6ca165b-4a48-477a-b682-9e32f8f83a7e/thanos-query/0.log" Jun 02 02:00:57.130385 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:57.130359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd5d9c769-gl9gh_a6ca165b-4a48-477a-b682-9e32f8f83a7e/kube-rbac-proxy-web/0.log" Jun 02 02:00:57.155493 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:57.155457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd5d9c769-gl9gh_a6ca165b-4a48-477a-b682-9e32f8f83a7e/kube-rbac-proxy/0.log" Jun 02 02:00:57.181236 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:57.181206 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd5d9c769-gl9gh_a6ca165b-4a48-477a-b682-9e32f8f83a7e/prom-label-proxy/0.log" Jun 02 02:00:57.204839 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:57.204798 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd5d9c769-gl9gh_a6ca165b-4a48-477a-b682-9e32f8f83a7e/kube-rbac-proxy-rules/0.log" Jun 02 02:00:57.229710 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:57.229660 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dd5d9c769-gl9gh_a6ca165b-4a48-477a-b682-9e32f8f83a7e/kube-rbac-proxy-metrics/0.log" Jun 02 02:00:58.334063 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.334035 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-vz8sd_a3f5e34b-1473-47a6-a00a-597800b9b2d2/networking-console-plugin/0.log" Jun 02 02:00:58.711967 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.711924 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr"] Jun 02 02:00:58.718345 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.718321 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.735411 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.735380 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr"] Jun 02 02:00:58.839526 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.839477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-proc\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.839749 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.839562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfx9\" (UniqueName: \"kubernetes.io/projected/2abef3db-2d05-4d52-8133-cfc4dc44ce95-kube-api-access-5mfx9\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.839749 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.839591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-sys\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.839749 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.839630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-podres\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.839749 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.839716 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-lib-modules\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940558 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940519 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-proc\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940783 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940579 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfx9\" (UniqueName: \"kubernetes.io/projected/2abef3db-2d05-4d52-8133-cfc4dc44ce95-kube-api-access-5mfx9\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940783 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-sys\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940783 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940625 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-podres\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940783 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940658 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-lib-modules\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940783 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-proc\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.940783 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940713 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-sys\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.941041 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-podres\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.941041 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.940826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2abef3db-2d05-4d52-8133-cfc4dc44ce95-lib-modules\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.950411 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.950387 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 02:00:58.952348 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.952322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfx9\" (UniqueName: \"kubernetes.io/projected/2abef3db-2d05-4d52-8133-cfc4dc44ce95-kube-api-access-5mfx9\") pod \"perf-node-gather-daemonset-48jnr\" (UID: \"2abef3db-2d05-4d52-8133-cfc4dc44ce95\") " pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:58.956799 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:58.956778 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/2.log" Jun 02 02:00:59.030477 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.030397 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:59.192536 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.192503 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr"] Jun 02 02:00:59.194415 ip-10-0-136-21 kubenswrapper[2563]: W0602 02:00:59.194386 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2abef3db_2d05_4d52_8133_cfc4dc44ce95.slice/crio-44fcab895e3fbde7e2b2ddc3adfb510915960890e7119149fd9595a36d5882e9 WatchSource:0}: Error finding container 44fcab895e3fbde7e2b2ddc3adfb510915960890e7119149fd9595a36d5882e9: Status 404 returned error can't find the container with id 44fcab895e3fbde7e2b2ddc3adfb510915960890e7119149fd9595a36d5882e9 Jun 02 02:00:59.470643 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.470617 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c7d8dc5ff-gb689_f9898d7d-cdca-42c1-9d46-89ffe24dc229/console/0.log" Jun 02 02:00:59.866962 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.866928 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" event={"ID":"2abef3db-2d05-4d52-8133-cfc4dc44ce95","Type":"ContainerStarted","Data":"35b48f5b232688786b26f6e82632e1420b1a5883a64b94113cfd05bedaa195d4"} Jun 02 02:00:59.866962 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.866965 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" event={"ID":"2abef3db-2d05-4d52-8133-cfc4dc44ce95","Type":"ContainerStarted","Data":"44fcab895e3fbde7e2b2ddc3adfb510915960890e7119149fd9595a36d5882e9"} Jun 02 02:00:59.867181 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.867061 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:00:59.890399 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:00:59.890333 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" podStartSLOduration=1.890313451 podStartE2EDuration="1.890313451s" podCreationTimestamp="2026-06-02 02:00:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:00:59.886865744 +0000 UTC m=+1189.224547534" watchObservedRunningTime="2026-06-02 02:00:59.890313451 +0000 UTC m=+1189.227995229" Jun 02 02:01:00.016885 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:00.016843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-s56fc_e9164e49-6759-4a87-82d5-3adcb7969c82/volume-data-source-validator/0.log" Jun 02 02:01:00.793593 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:00.793567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pc4p_6d883de3-4af9-45ea-a9bd-a742008ac77a/dns/0.log" Jun 02 02:01:00.817628 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:00.817604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pc4p_6d883de3-4af9-45ea-a9bd-a742008ac77a/kube-rbac-proxy/0.log" Jun 02 02:01:01.017804 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:01.017772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7tsb_643acb0c-7c2f-44ae-b679-debd7548436e/dns-node-resolver/0.log" Jun 02 02:01:01.564649 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:01.564619 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2fvx9_13f2ae2d-6ac9-46b2-ad29-cfcf51af7465/node-ca/0.log" Jun 02 02:01:02.612030 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:02.611996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-m24jg_9e6fb310-c429-4d0e-b285-a020f2bcf980/discovery/0.log" Jun 02 02:01:02.636234 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:02.636202 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f795fc994-6h9fx_bb05e835-b158-4efb-8a37-855e9fb55e74/kube-auth-proxy/0.log" Jun 02 02:01:02.789808 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:02.789778 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9444674f7-4r8rm_f9645f7f-2922-45cd-ad7a-1a82e58b8de0/router/0.log" Jun 02 02:01:03.391966 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:03.391942 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hptd8_b01cecc0-1c8f-4cb9-9de7-8e9c6f0c5805/serve-healthcheck-canary/0.log" Jun 02 02:01:03.967222 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:03.967194 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7l8r8_b43ccf85-8c64-4b23-9174-f4ca774591ff/kube-rbac-proxy/0.log" Jun 02 02:01:03.993253 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:03.993219 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7l8r8_b43ccf85-8c64-4b23-9174-f4ca774591ff/exporter/0.log" Jun 02 02:01:04.017977 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:04.017953 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7l8r8_b43ccf85-8c64-4b23-9174-f4ca774591ff/extractor/0.log" Jun 02 02:01:05.882581 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:05.882547 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7ftlk/perf-node-gather-daemonset-48jnr" Jun 02 02:01:06.269669 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.269637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f9c748996-4dt8t_b7158ecb-4032-46ba-9bc6-3426191cd499/nginx/0.log" Jun 02 02:01:06.328976 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.328944 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-hb9m6_0092768e-0199-40c5-9979-3ffa5dd1ad66/manager/0.log" Jun 02 02:01:06.365213 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.365178 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-nll7c_ce65db09-7d6a-4835-8ad6-96aa31592f82/manager/0.log" Jun 02 02:01:06.408891 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.408863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29672760-xkcq9_9f56438a-2e63-4ef9-832e-ff9ac1a7cfd6/cleanup/0.log" Jun 02 02:01:06.462289 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.462262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-fhbsl_3c05f581-0061-49bd-a93f-99afb5a6976d/server/0.log" Jun 02 02:01:06.698566 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.698529 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-jglsf_04627260-935c-44db-8ba6-3b063120d637/manager/0.log" Jun 02 02:01:06.722350 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.722319 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdd9d74b4-jglsf_04627260-935c-44db-8ba6-3b063120d637/copy-manifests/0.log" Jun 02 02:01:06.751684 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:06.751649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-bv2d7_d82df115-927c-41d6-acd6-a41237f93c64/postgres/0.log" Jun 02 02:01:08.502633 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:08.502568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-45v52_f70eb576-2e8b-4e7f-8b53-aa9f32dc7bb4/openshift-lws-operator/0.log" Jun 02 02:01:11.256712 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:11.256425 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 02:01:11.259055 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:11.259029 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-vsnvg_ca253491-8ecd-4250-8265-9c4f8786b163/console-operator/1.log" Jun 02 02:01:13.890155 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:13.890125 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-xrxqk_aa9c6fc0-a360-4f73-8e87-6aa2941a8934/kube-storage-version-migrator-operator/1.log" Jun 02 02:01:13.891153 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:13.891134 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-xrxqk_aa9c6fc0-a360-4f73-8e87-6aa2941a8934/kube-storage-version-migrator-operator/0.log" Jun 02 02:01:14.931299 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:14.931271 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-27lt8_37486945-b5e9-492b-a3b6-5e6fc8387821/kube-multus/0.log" Jun 02 02:01:14.985259 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:14.985223 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/kube-multus-additional-cni-plugins/0.log" Jun 02 02:01:15.008245 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.008213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/egress-router-binary-copy/0.log" Jun 02 02:01:15.044704 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.044663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/cni-plugins/0.log" Jun 02 02:01:15.092542 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.092518 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/bond-cni-plugin/0.log" Jun 02 02:01:15.147000 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.146971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/routeoverride-cni/0.log" Jun 02 02:01:15.171085 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.171056 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/whereabouts-cni-bincopy/0.log" Jun 02 02:01:15.195853 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.195777 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p82jm_69def33a-baf2-4860-bfb2-aba5fc3fbc6e/whereabouts-cni/0.log" Jun 02 02:01:15.677107 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.677078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fz4zd_c961f928-3c35-495d-b28c-0e59d04c8e3a/network-metrics-daemon/0.log" Jun 02 02:01:15.710425 ip-10-0-136-21 kubenswrapper[2563]: I0602 02:01:15.710398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fz4zd_c961f928-3c35-495d-b28c-0e59d04c8e3a/kube-rbac-proxy/0.log"